Profiling results ----------------- Total cpu time observed: 158914ms (out of 159972ms) Number of samples taken: 450 (once every 353ms) (Hiding functions with self<1.0% and local<2.0%: 8 of 205 hidden) ============================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================ ??? [51] 100.0% [1] 142246(89.5%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [13] 100.0% ---------------------------------------------------------------------------- ??? [51] 100.0% [2] 103490(65.1%) 0(0.0%) run-improve50 ...e/logb-bug/src/mainloop.rkt:234:0 for-loop [14] 97.4% get-final-combination [20] 1.3% loop [60] 0.9% ---------------------------------------------------------------------------- ->flonum [98] 100.0% [3] 8888(5.6%) 0(0.0%) loop ...erbie/logb-bug/src/core/simplify.rkt:215:2 pass [15] 100.0% ---------------------------------------------------------------------------- ??? [93] 100.0% [4] 5480(3.4%) 0(0.0%) approximate9 .../logb-bug/src/core/taylor.rkt:12:0 loop [16] 93.9% taylor-quotient [21] 6.1% ---------------------------------------------------------------------------- hash-ref! [100] 100.0% [5] 4514(2.8%) 0(0.0%) ??? .../herbie/logb-bug/src/core/taylor.rkt:295:23 for-loop [17] 100.0% ---------------------------------------------------------------------------- hash-ref! [100] 100.0% [6] 3800(2.4%) 0(0.0%) ??? .../herbie/logb-bug/src/core/taylor.rkt:285:26 for-loop [18] 100.0% ---------------------------------------------------------------------------- substitute-e [140] 9.4% match-e [136] 90.6% [7] 3434(2.2%) 0(0.0%) variable? .../logb-bug/src/syntax/syntax.rkt:567:0 ??? [44] 100.0% ---------------------------------------------------------------------------- hash-ref! [100] 100.0% [8] 2442(1.5%) 0(0.0%) ??? .../herbie/logb-bug/src/core/taylor.rkt:392:23 for-loop [19] 100.0% ---------------------------------------------------------------------------- hash-ref! [100] 100.0% [9] 2018(1.3%) 0(0.0%) ??? .../herbie/logb-bug/src/core/taylor.rkt:338:33 hash-ref! [100] 85.1% for-loop [24] 14.9% ---------------------------------------------------------------------------- copying-mergesort [77] 100.0% [10] 696(0.4%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [88] 100.0% ---------------------------------------------------------------------------- hash-ref! [100] 100.0% [11] 332(0.2%) 0(0.0%) ??? .../herbie/logb-bug/src/core/taylor.rkt:322:33 for-loop [23] 100.0% ---------------------------------------------------------------------------- hash-ref! [100] 100.0% [12] 332(0.2%) 0(0.0%) ??? .../herbie/logb-bug/src/core/taylor.rkt:483:23 for-loop [22] 100.0% ---------------------------------------------------------------------------- profile-thunk16 [1] 99.8% [13] 142546(89.7%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [51] 100.0% ---------------------------------------------------------------------------- run-improve50 [2] 100.0% [14] 100810(63.4%) 0(0.0%) for-loop ...erbie/logb-bug/src/mainloop.rkt:249:10 run-iter! [25] 100.0% ---------------------------------------------------------------------------- loop [3] 100.0% [15] 8888(5.6%) 0(0.0%) pass ...erbie/logb-bug/src/core/simplify.rkt:205:2 for-loop [26] 100.0% ---------------------------------------------------------------------------- approximate9 [4] 100.0% [16] 5146(3.2%) 0(0.0%) loop ...s/herbie/logb-bug/src/core/taylor.rkt:86:4 ??? [93] 100.0% ---------------------------------------------------------------------------- ??? [5] 100.0% [17] 4514(2.8%) 0(0.0%) for-loop ...ie/logb-bug/src/core/taylor.rkt:298:27 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- ??? [6] 100.0% [18] 3800(2.4%) 0(0.0%) for-loop ...ie/logb-bug/src/core/taylor.rkt:285:52 hash-ref! [100] 91.2% ??? [31] 8.8% ---------------------------------------------------------------------------- ??? [8] 100.0% [19] 2442(1.5%) 0(0.0%) for-loop ...ie/logb-bug/src/core/taylor.rkt:396:33 for-loop [28] 100.0% ---------------------------------------------------------------------------- run-improve50 [2] 100.0% [20] 1358(0.9%) 0(0.0%) get-final-combination ...ug/src/mainloop.rkt:264:0 split-table [29] 75.6% extract-alt [32] 24.4% ---------------------------------------------------------------------------- approximate9 [4] 100.0% [21] 334(0.2%) 0(0.0%) taylor-quotient ...b-bug/src/core/taylor.rkt:328:0 first-nonzero-exp [30] 100.0% ---------------------------------------------------------------------------- ??? [12] 100.0% [22] 332(0.2%) 0(0.0%) for-loop ...ie/logb-bug/src/core/taylor.rkt:487:35 parse-loop12 [105] 100.0% ---------------------------------------------------------------------------- ??? [11] 100.0% [23] 332(0.2%) 0(0.0%) for-loop ...ie/logb-bug/src/core/taylor.rkt:324:46 simplify [27] 100.0% ---------------------------------------------------------------------------- ??? [9] 100.0% [24] 300(0.2%) 0(0.0%) for-loop ...ie/logb-bug/src/core/taylor.rkt:341:46 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- for-loop [14] 100.0% [25] 100810(63.4%) 0(0.0%) run-iter! ...erbie/logb-bug/src/mainloop.rkt:215:0 simplify! [33] 83.4% finalize-iter! [34] 8.8% gen-series! [37] 5.4% gen-rewrites! [38] 1.7% localize-error [41] 0.7% ---------------------------------------------------------------------------- pass [15] 100.0% [26] 8888(5.6%) 0(0.0%) for-loop .../logb-bug/src/core/simplify.rkt:208:29 argmin [35] 84.5% for-loop [39] 7.8% loop [40] 7.7% ---------------------------------------------------------------------------- for-loop [23] 6.1% hash-ref! [100] 93.9% [27] 5480(3.4%) 0(0.0%) simplify ...rbie/logb-bug/src/core/reduce.rkt:16:0 parse-loop12 [105] 50.1% f6 [36] 49.9% ---------------------------------------------------------------------------- for-loop [19] 100.0% [28] 2442(1.5%) 0(0.0%) for-loop ...ie/logb-bug/src/core/taylor.rkt:398:39 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- get-final-combination [20] 100.0% [29] 1026(0.6%) 0(0.0%) split-table .../herbie/logb-bug/src/glue.rkt:162:0 f6 [36] 100.0% ---------------------------------------------------------------------------- taylor-quotient [21] 100.0% [30] 334(0.2%) 0(0.0%) first-nonzero-exp ...bug/src/core/taylor.rkt:260:0 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- for-loop [18] 100.0% [31] 334(0.2%) 0(0.0%) ??? .../herbie/logb-bug/src/core/taylor.rkt:288:19 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- get-final-combination [20] 100.0% [32] 332(0.2%) 0(0.0%) extract-alt ...s/herbie/logb-bug/src/glue.rkt:55:0 argmins [42] 100.0% ---------------------------------------------------------------------------- run-iter! [25] 100.0% [33] 84096(52.9%) 0(0.0%) simplify! ...erbie/logb-bug/src/mainloop.rkt:155:0 for-loop [43] 100.0% ---------------------------------------------------------------------------- run-iter! [25] 100.0% [34] 8898(5.6%) 0(0.0%) finalize-iter! .../logb-bug/src/mainloop.rkt:169:0 ??? [44] 100.0% ---------------------------------------------------------------------------- for-loop [26] 100.0% [35] 7514(4.7%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [45] 81.0% expression-cost [48] 19.0% ---------------------------------------------------------------------------- parse-loop12 [105] 2.9% rewriter [63] 5.5% for-loop [79] 5.8% hash-ref! [100] 5.9% eval-prog [85] 6.3% map [82] 7.2% loop [86] 8.4% split-table [29] 17.9% simplify [27] 40.2% [36] 5742(3.6%) 666(0.4%) f6 ...et/collects/racket/match/compiler.rkt:507:40 map [82] 55.9% option-on-expr [49] 17.9% ??? [93] 6.3% ??? [172] 5.8% ->flonum [98] 5.5% ---------------------------------------------------------------------------- run-iter! [25] 100.0% [37] 5480(3.4%) 0(0.0%) gen-series! ...bie/logb-bug/src/mainloop.rkt:129:0 for-loop [46] 100.0% ---------------------------------------------------------------------------- run-iter! [25] 100.0% [38] 1666(1.0%) 0(0.0%) gen-rewrites! ...e/logb-bug/src/mainloop.rkt:142:0 for-loop [47] 100.0% ---------------------------------------------------------------------------- for-loop [26] 100.0% [39] 690(0.4%) 690(0.4%) for-loop .../logb-bug/src/core/simplify.rkt:195:13 ---------------------------------------------------------------------------- for-loop [26] 100.0% [40] 684(0.4%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [45] 100.0% ---------------------------------------------------------------------------- run-iter! [25] 100.0% [41] 670(0.4%) 0(0.0%) localize-error ...b-bug/src/core/localize.rkt:47:0 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- extract-alt [32] 100.0% [42] 332(0.2%) 0(0.0%) argmins ...es/herbie/logb-bug/src/common.rkt:145:0 composed [50] 100.0% ---------------------------------------------------------------------------- simplify! [33] 100.0% [43] 84096(52.9%) 0(0.0%) for-loop ...herbie/logb-bug/src/mainloop.rkt:159:6 ??? [51] 100.0% ---------------------------------------------------------------------------- substitute-e [140] 1.7% get-sigs [168] 14.2% variable? [7] 17.5% match-e [136] 19.5% finalize-iter! [34] 45.3% [44] 19658(12.4%) 5224(3.3%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [52] 41.9% hash-has-key? [54] 24.7% atab-add-altns [58] 3.3% make-alt-table [59] 1.8% ??? [189] 1.6% ---------------------------------------------------------------------------- loop [40] 10.1% argmin [35] 89.9% [45] 6770(4.3%) 360(0.2%) for-loop ...herbie/logb-bug/src/programs.rkt:199:2 ->flonum [98] 69.0% ...b-bug/src/common.rkt:47:2 [174] 15.0% ??? [172] 10.7% ---------------------------------------------------------------------------- gen-series! [37] 100.0% [46] 5480(3.4%) 0(0.0%) for-loop ...herbie/logb-bug/src/mainloop.rkt:135:7 taylor-alt [53] 100.0% ---------------------------------------------------------------------------- gen-rewrites! [38] 100.0% [47] 1666(1.0%) 0(0.0%) for-loop ...erbie/logb-bug/src/mainloop.rkt:147:11 ??? [55] 100.0% ---------------------------------------------------------------------------- argmin [35] 100.0% [48] 1428(0.9%) 0(0.0%) expression-cost ...logb-bug/src/programs.rkt:198:0 compile [56] 100.0% ---------------------------------------------------------------------------- f6 [36] 100.0% [49] 1026(0.6%) 0(0.0%) option-on-expr ...b-bug/src/core/regimes.rkt:103:0 sort-context-on-expr [57] 100.0% ---------------------------------------------------------------------------- argmins [42] 100.0% [50] 332(0.2%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [75] 100.0% ---------------------------------------------------------------------------- for-loop [43] 17.8% run [13] 36.5% [51] 157252(99.0%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 36.3% ->flonum [98] 27.0% run-improve50 [2] 24.1% loop [60] 12.6% ---------------------------------------------------------------------------- ??? [44] 100.0% [52] 8240(5.2%) 0(0.0%) for-loop ...e/logb-bug/src/core/alt-table.rkt:51:2 atab-add-altn [61] 100.0% ---------------------------------------------------------------------------- for-loop [46] 100.0% [53] 5480(3.4%) 0(0.0%) taylor-alt ...s/herbie/logb-bug/src/glue.rkt:134:0 for-loop [62] 100.0% ---------------------------------------------------------------------------- mk-enode! [143] 6.2% ??? [44] 93.8% [54] 5186(3.3%) 1334(0.8%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [104] 67.3% ??? [112] 7.0% ---------------------------------------------------------------------------- for-loop [47] 100.0% [55] 1666(1.0%) 0(0.0%) ??? ...es/herbie/logb-bug/src/alternative.rkt:88:0 rewriter [63] 100.0% ---------------------------------------------------------------------------- expression-cost [48] 100.0% [56] 1428(0.9%) 370(0.2%) compile .../herbie/logb-bug/src/programs.rkt:175:0 hash-ref! [100] 74.1% ---------------------------------------------------------------------------- option-on-expr [49] 100.0% [57] 1026(0.6%) 0(0.0%) sort-context-on-expr ...b-bug/src/points.rkt:115:0 ??? [64] 100.0% ---------------------------------------------------------------------------- ??? [44] 100.0% [58] 658(0.4%) 0(0.0%) atab-add-altns ...-bug/src/core/alt-table.rkt:50:0 atab-add-altn [61] 100.0% ---------------------------------------------------------------------------- ??? [44] 100.0% [59] 350(0.2%) 0(0.0%) make-alt-table ...-bug/src/core/alt-table.rkt:32:0 errors [75] 100.0% ---------------------------------------------------------------------------- run-improve50 [2] 2.4% ??? [51] 97.6% [60] 40360(25.4%) 0(0.0%) loop ...tlies/herbie/logb-bug/src/points.rkt:193:2 make-exacts* [73] 43.8% loop [65] 35.7% loop [74] 18.9% for-loop [70] 0.8% filter-points [72] 0.7% ---------------------------------------------------------------------------- atab-add-altns [58] 7.4% for-loop [52] 92.6% [61] 8898(5.6%) 0(0.0%) atab-add-altn ...-bug/src/core/alt-table.rkt:208:0 best-and-tied-at-points [66] 96.0% loop [86] 4.0% ---------------------------------------------------------------------------- taylor-alt [53] 100.0% [62] 5480(3.4%) 0(0.0%) for-loop ...ies/herbie/logb-bug/src/glue.rkt:139:6 ??? [93] 100.0% ---------------------------------------------------------------------------- ??? [55] 37.9% matcher [76] 62.1% [63] 1666(1.0%) 658(0.4%) rewriter ...ie/logb-bug/src/core/matcher.rkt:131:2 for-loop [67] 62.1% expression->type [71] 10.0% *rules* [69] 7.2% f6 [36] 6.4% ---------------------------------------------------------------------------- sort-context-on-expr [57] 100.0% [64] 1026(0.6%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [68] 100.0% ---------------------------------------------------------------------------- loop [60] 100.0% [65] 14402(9.1%) 0(0.0%) loop ...tlies/herbie/logb-bug/src/points.rkt:151:2 loop [74] 53.7% make-exacts* [73] 44.0% eval-prog [85] 2.3% ---------------------------------------------------------------------------- atab-add-altn [61] 100.0% [66] 8538(5.4%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [75] 100.0% ---------------------------------------------------------------------------- rewriter [63] 100.0% [67] 1666(1.0%) 0(0.0%) for-loop ...e/logb-bug/src/core/matcher.rkt:134:10 matcher [76] 100.0% ---------------------------------------------------------------------------- ??? [64] 100.0% [68] 1026(0.6%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [77] 67.8% loop [80] 32.2% ---------------------------------------------------------------------------- rewriter [63] 100.0% [69] 358(0.2%) 0(0.0%) *rules* ...bie/logb-bug/src/syntax/rules.rkt:484:0 for-loop [150] 100.0% ---------------------------------------------------------------------------- loop [60] 100.0% [70] 342(0.2%) 0(0.0%) for-loop .../herbie/logb-bug/src/points.rkt:200:24 for-loop [78] 100.0% ---------------------------------------------------------------------------- for-loop [79] 50.0% rewriter [63] 50.0% [71] 332(0.2%) 0(0.0%) expression->type ...gb-bug/src/type-check.rkt:45:0 for-loop [79] 100.0% ---------------------------------------------------------------------------- loop [60] 100.0% [72] 300(0.2%) 0(0.0%) filter-points ...bie/logb-bug/src/points.rkt:159:0 for-loop [81] 100.0% ---------------------------------------------------------------------------- loop [65] 26.4% loop [60] 73.6% [73] 24008(15.1%) 0(0.0%) make-exacts* ...rbie/logb-bug/src/points.rkt:138:0 loop [86] 52.3% map [82] 47.7% ---------------------------------------------------------------------------- loop [60] 49.7% loop [65] 50.3% [74] 15376(9.7%) 0(0.0%) loop ...tlies/herbie/logb-bug/src/points.rkt:141:4 map [82] 100.0% ---------------------------------------------------------------------------- composed [50] 3.6% make-alt-table [59] 3.8% best-and-tied-at-points [66] 92.6% [75] 9220(5.8%) 0(0.0%) errors ...ies/herbie/logb-bug/src/points.rkt:218:0 for-loop [83] 96.1% eval-prog [85] 3.9% ---------------------------------------------------------------------------- matcher [76] 17.4% for-loop [84] 32.6% for-loop [67] 50.0% [76] 1666(1.0%) 0(0.0%) matcher ...bie/logb-bug/src/core/matcher.rkt:167:2 rewriter [63] 50.0% for-loop [84] 32.6% matcher [76] 17.4% ---------------------------------------------------------------------------- generic-sort/key [68] 25.0% copying-mergesort [77] 75.0% [77] 696(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [77] 75.0% jloop [10] 25.0% ---------------------------------------------------------------------------- for-loop [70] 100.0% [78] 342(0.2%) 0(0.0%) for-loop .../herbie/logb-bug/src/points.rkt:201:26 ??? [93] 100.0% ---------------------------------------------------------------------------- expression->type [71] 100.0% [79] 332(0.2%) 0(0.0%) for-loop ...erbie/logb-bug/src/type-check.rkt:52:5 expression->type [71] 50.0% f6 [36] 50.0% ---------------------------------------------------------------------------- generic-sort/key [68] 100.0% [80] 330(0.2%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [88] 100.0% ---------------------------------------------------------------------------- filter-points [72] 100.0% [81] 300(0.2%) 300(0.2%) for-loop ...s/herbie/logb-bug/src/points.rkt:162:4 ---------------------------------------------------------------------------- parse-loop12 [105] 1.1% f6 [36] 11.0% make-exacts* [73] 37.5% loop [74] 50.3% [82] 30542(19.2%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [86] 89.0% parse-loop12 [105] 7.8% f6 [36] 1.9% ??? [90] 1.1% ---------------------------------------------------------------------------- errors [75] 100.0% [83] 8860(5.6%) 290(0.2%) for-loop ...s/herbie/logb-bug/src/points.rkt:221:4 ??? [88] 85.3% ulp-difference [87] 7.7% ??? [93] 3.7% ---------------------------------------------------------------------------- matcher [76] 100.0% [84] 1366(0.9%) 0(0.0%) for-loop ...e/logb-bug/src/core/matcher.rkt:183:21 matcher [76] 100.0% ---------------------------------------------------------------------------- loop [65] 48.1% errors [75] 51.9% [85] 694(0.4%) 334(0.2%) eval-prog ...erbie/logb-bug/src/programs.rkt:148:0 f6 [36] 51.9% ---------------------------------------------------------------------------- atab-add-altn [61] 0.7% match-e [136] 1.5% make-exacts* [73] 1.5% for-loop [138] 1.5% loop! [156] 2.6% map [82] 2.6% parse-loop12 [105] 3.0% loop [86] 85.9% [86] 50706(31.9%) 1388(0.9%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [86] 85.9% ??? [88] 3.4% loop! [156] 2.6% parse-loop12 [105] 2.1% foldl [151] 0.9% f6 [36] 0.8% ??? [90] 0.7% for-loop [89] 0.6% ??? [93] 0.1% ??? [91] 0.0% ---------------------------------------------------------------------------- for-loop [83] 100.0% [87] 684(0.4%) 0(0.0%) ulp-difference ...rbie/logb-bug/src/float.rkt:19:0 ??? [111] 52.6% return/no-unsupplied [109] 47.4% ---------------------------------------------------------------------------- loop [80] 0.7% jloop [10] 1.5% for-loop [83] 16.6% loop [86] 81.2% [88] 45554(28.7%) 330(0.2%) ??? ...lies/herbie/logb-bug/src/programs.rkt:154:4 ??? [92] 86.7% ??? [118] 8.9% ??? [93] 2.9% ??? [95] 0.8% ---------------------------------------------------------------------------- loop [86] 100.0% [89] 1370(0.9%) 0(0.0%) for-loop ...e/logb-bug/src/core/simplify.rkt:173:2 setfindf [94] 76.2% eval-const-expr [97] 23.8% ---------------------------------------------------------------------------- map [82] 16.7% loop [86] 83.3% [90] 670(0.4%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- loop [86] 100.0% [91] 334(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [96] 100.0% ---------------------------------------------------------------------------- ??? [88] 100.0% [92] 39518(24.9%) 10432(6.6%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [99] 66.0% ??? [101] 6.7% ---------------------------------------------------------------------------- for-loop [83] 3.4% for-loop [78] 3.5% f6 [36] 3.6% ??? [88] 13.4% loop [16] 17.4% ->flonum [98] 19.0% for-loop [62] 19.0% loop [86] 20.7% [93] 9884(6.2%) 662(0.4%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ->flonum [98] 53.3% approximate9 [4] 19.0% hash-ref! [100] 17.4% ...b-bug/src/common.rkt:47:2 [174] 3.6% ---------------------------------------------------------------------------- for-loop [89] 100.0% [94] 1044(0.7%) 1044(0.7%) setfindf ...s/herbie/logb-bug/src/common.rkt:179:0 ---------------------------------------------------------------------------- ??? [88] 100.0% [95] 344(0.2%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:145:21 ??? [189] 100.0% ---------------------------------------------------------------------------- ??? [91] 100.0% [96] 334(0.2%) 334(0.2%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ---------------------------------------------------------------------------- for-loop [89] 100.0% [97] 326(0.2%) 326(0.2%) eval-const-expr ...logb-bug/src/programs.rkt:166:0 ---------------------------------------------------------------------------- f6 [36] 0.3% for-loop [45] 1.4% get-sigs [168] 1.9% ??? [93] 6.4% ->flonum [98] 9.2% for-loop [103] 36.7% ??? [51] 43.5% [98] 108952(68.6%) 3960(2.5%) ->flonum ...s/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [102] 40.3% for-loop [103] 36.7% ->flonum [98] 9.2% loop [3] 3.4% ??? [93] 3.3% ??? [104] 2.7% ??? [111] 0.6% mk-egraph [110] 0.5% return/no-unsupplied [109] 0.4% list-member? [141] 0.3% loop [113] 0.3% ??? [112] 0.1% ---------------------------------------------------------------------------- ??? [92] 100.0% [99] 26100(16.4%) 17326(10.9%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfexp [106] 21.1% bfsub [108] 12.5% ---------------------------------------------------------------------------- for-loop [124] 0.6% for-loop [24] 1.0% ??? [31] 2.3% first-nonzero-exp [30] 2.3% ??? [114] 3.1% ??? [9] 3.4% localize-error [41] 3.5% for-loop [28] 4.7% ??? [90] 5.8% for-loop [18] 10.6% compile [56] 11.6% ??? [107] 16.5% ??? [93] 16.5% for-loop [17] 17.9% [100] 7208(4.5%) 1058(0.7%) hash-ref! ...racket/private/more-scheme.rkt:373:13 simplify [27] 18.3% ??? [5] 17.9% ??? [107] 16.5% ??? [6] 13.0% parse-loop12 [105] 7.0% ??? [8] 4.7% ??? [9] 4.5% ??? [114] 3.1% f6 [36] 1.2% ??? [115] 1.2% ??? [12] 0.6% ??? [11] 0.6% ---------------------------------------------------------------------------- ??? [92] 100.0% [101] 2656(1.7%) 1668(1.0%) ??? ...erbie/logb-bug/src/syntax/syntax.rkt:122:17 return/no-unsupplied [109] 37.2% ---------------------------------------------------------------------------- ->flonum [98] 100.0% [102] 89550(56.4%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:102:0 one-iter [116] 98.5% ---------------------------------------------------------------------------- ->flonum [98] 100.0% [103] 83060(52.3%) 0(0.0%) for-loop ...e/logb-bug/src/core/simplify.rkt:63:12 ->flonum [98] 100.0% ---------------------------------------------------------------------------- hash-has-key? [54] 29.9% ->flonum [98] 70.1% [104] 11680(7.3%) 4396(2.8%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [117] 51.3% ??? [129] 11.1% ---------------------------------------------------------------------------- for-loop [22] 5.7% loop [86] 8.9% hash-ref! [100] 11.5% map [82] 21.1% simplify [27] 25.8% parse-loop12 [105] 27.0% [105] 5818(3.7%) 3882(2.4%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 parse-loop12 [105] 27.0% loop [86] 22.3% f6 [36] 5.7% for-loop [124] 5.7% make-multiplication-node [125] 2.6% map [82] 1.4% ---------------------------------------------------------------------------- ??? [99] 100.0% [106] 5514(3.5%) 3742(2.4%) bfexp ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [119] 32.1% ---------------------------------------------------------------------------- hash-ref! [100] 100.0% [107] 5146(3.2%) 0(0.0%) ??? ...s/herbie/logb-bug/src/core/taylor.rkt:44:15 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- ??? [99] 100.0% [108] 3260(2.1%) 2514(1.6%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [119] 22.9% ---------------------------------------------------------------------------- ulp-difference [87] 16.6% ->flonum [98] 32.6% ??? [101] 50.7% [109] 1948(1.2%) 1276(0.8%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [122] 34.5% ---------------------------------------------------------------------------- ->flonum [98] 100.0% [110] 1334(0.8%) 0(0.0%) mk-egraph ...ie/logb-bug/src/core/egraph.rkt:123:0 expr->enode [120] 100.0% ---------------------------------------------------------------------------- ulp-difference [87] 34.0% ->flonum [98] 66.0% [111] 1060(0.7%) 360(0.2%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [121] 66.0% ---------------------------------------------------------------------------- ->flonum [98] 48.1% hash-has-key? [54] 51.9% [112] 698(0.4%) 698(0.4%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ---------------------------------------------------------------------------- ->flonum [98] 100.0% [113] 342(0.2%) 0(0.0%) loop ...htlies/herbie/logb-bug/src/points.rkt:66:6 random-exp [123] 100.0% ---------------------------------------------------------------------------- hash-ref! [100] 100.0% [114] 338(0.2%) 0(0.0%) ??? ...lies/herbie/logb-bug/src/programs.rkt:183:5 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- hash-ref! [100] 100.0% [115] 336(0.2%) 0(0.0%) ??? ...herbie/logb-bug/src/core/localize.rkt:22:13 ??? [118] 100.0% ---------------------------------------------------------------------------- iterate-egraph!13 [102] 100.0% [116] 88180(55.5%) 1052(0.7%) one-iter ...e/logb-bug/src/core/simplify.rkt:113:0 loop [126] 55.1% for-loop [127] 39.4% apply-match [132] 3.5% ---------------------------------------------------------------------------- ??? [104] 100.0% [117] 5992(3.8%) 2412(1.5%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [129] 32.6% for-loop [177] 21.6% arrow-higher-order:lnp [130] 5.5% ---------------------------------------------------------------------------- ??? [115] 7.7% ??? [88] 92.3% [118] 4372(2.8%) 1036(0.7%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [128] 76.3% ---------------------------------------------------------------------------- bfsub [108] 29.6% bfexp [106] 70.4% [119] 2518(1.6%) 2518(1.6%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ---------------------------------------------------------------------------- expr->enode [120] 41.6% mk-egraph [110] 58.4% [120] 1334(0.8%) 0(0.0%) expr->enode .../logb-bug/src/core/egraph.rkt:124:2 mk-enode! [143] 58.4% expr->enode [120] 41.6% ---------------------------------------------------------------------------- ??? [111] 100.0% [121] 700(0.4%) 700(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ---------------------------------------------------------------------------- return/no-unsupplied [109] 100.0% [122] 672(0.4%) 672(0.4%) filter ...t/collects/racket/private/list.rkt:256:2 ---------------------------------------------------------------------------- loop [113] 100.0% [123] 342(0.2%) 342(0.2%) random-exp ...herbie/logb-bug/src/common.rkt:246:0 ---------------------------------------------------------------------------- parse-loop12 [105] 100.0% [124] 332(0.2%) 0(0.0%) for-loop ...ie/logb-bug/src/core/taylor.rkt:490:59 hash-ref! [100] 100.0% ---------------------------------------------------------------------------- parse-loop12 [105] 100.0% [125] 300(0.2%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [131] 100.0% ---------------------------------------------------------------------------- one-iter [116] 100.0% [126] 48554(30.6%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:52:19 apply-match [132] 100.0% ---------------------------------------------------------------------------- for-loop [127] 49.5% one-iter [116] 50.5% [127] 34786(21.9%) 10270(6.5%) for-loop .../logb-bug/src/core/simplify.rkt:123:12 for-loop [127] 49.5% match-e [136] 35.2% ---------------------------------------------------------------------------- ??? [118] 100.0% [128] 3336(2.1%) 3336(2.1%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ---------------------------------------------------------------------------- ??? [104] 39.8% for-loop [117] 60.2% [129] 3248(2.0%) 1624(1.0%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [133] 50.0% ---------------------------------------------------------------------------- for-loop [117] 100.0% [130] 330(0.2%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [134] 100.0% ---------------------------------------------------------------------------- make-multiplication-node [125] 100.0% [131] 300(0.2%) 300(0.2%) make-multiplication-subnode ...re/reduce.rkt:240:0 ---------------------------------------------------------------------------- one-iter [116] 6.0% loop [126] 94.0% [132] 51658(32.5%) 0(0.0%) apply-match ...ogb-bug/src/core/simplify.rkt:130:2 for-loop [135] 83.5% match-e [136] 15.2% reduce-to-single! [137] 1.3% ---------------------------------------------------------------------------- ??? [129] 100.0% [133] 1624(1.0%) 1624(1.0%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ---------------------------------------------------------------------------- arrow-higher-order:lnp [130] 100.0% [134] 330(0.2%) 330(0.2%) ??? ...et/contract/private/arity-checking.rkt:19:2 ---------------------------------------------------------------------------- apply-match [132] 100.0% [135] 43130(27.1%) 0(0.0%) for-loop .../logb-bug/src/core/simplify.rkt:145:10 merge-egraph-nodes! [139] 30.4% mk-enode! [143] 30.0% substitute-e [140] 22.9% loop! [156] 15.1% list-member? [141] 1.6% ---------------------------------------------------------------------------- apply-match [132] 16.4% for-loop [144] 23.3% for-loop [127] 60.2% [136] 32348(20.4%) 12438(7.8%) match-e ...erbie/logb-bug/src/core/ematch.rkt:46:0 for-loop [138] 41.9% for-loop [144] 7.8% ??? [44] 6.3% variable? [7] 4.1% loop [86] 3.2% list-cartesian-product [146] 2.2% curry* [152] 1.0% ---------------------------------------------------------------------------- apply-match [132] 100.0% [137] 696(0.4%) 370(0.2%) reduce-to-single! ...bug/src/core/egraph.rkt:324:0 for-loop [142] 46.8% ---------------------------------------------------------------------------- match-e [136] 100.0% [138] 18156(11.4%) 5102(3.2%) for-loop ...bie/logb-bug/src/core/ematch.rkt:59:11 for-loop [144] 52.3% list-cartesian-product [146] 9.2% loop [86] 5.7% curry* [152] 3.8% foldl [151] 1.8% ---------------------------------------------------------------------------- merge-egraph-nodes! [139] 3.9% for-loop [149] 5.2% for-loop [135] 90.9% [139] 13100(8.2%) 362(0.2%) merge-egraph-nodes! ...g/src/core/egraph.rkt:152:0 update-leader! [145] 39.4% enode-merge! [147] 16.1% for-loop [148] 15.6% for-loop [149] 10.4% for-loop [150] 6.7% loop! [156] 5.2% merge-egraph-nodes! [139] 3.9% ---------------------------------------------------------------------------- substitute-e [140] 6.7% for-loop [135] 93.3% [140] 9874(6.2%) 328(0.2%) substitute-e .../logb-bug/src/core/ematch.rkt:71:0 mk-enode! [143] 90.0% substitute-e [140] 6.7% ??? [44] 1.1% variable? [7] 1.1% ---------------------------------------------------------------------------- ->flonum [98] 34.1% for-loop [135] 65.9% [141] 1056(0.7%) 360(0.2%) list-member? ...llects/racket/private/set.rkt:24:0 member [153] 34.1% loop [154] 31.8% ---------------------------------------------------------------------------- reduce-to-single! [137] 100.0% [142] 326(0.2%) 326(0.2%) for-loop ...bie/logb-bug/src/core/egraph.rkt:325:8 ---------------------------------------------------------------------------- expr->enode [120] 5.8% substitute-e [140] 38.4% for-loop [135] 55.8% [143] 23148(14.6%) 2150(1.4%) mk-enode! ...ie/logb-bug/src/core/egraph.rkt:101:0 new-enode [155] 89.3% hash-has-key? [54] 1.4% ---------------------------------------------------------------------------- match-e [136] 30.9% for-loop [138] 69.1% [144] 14442(9.1%) 362(0.2%) for-loop ...bie/logb-bug/src/core/ematch.rkt:65:37 match-e [136] 97.5% ---------------------------------------------------------------------------- merge-egraph-nodes! [139] 100.0% [145] 5850(3.7%) 360(0.2%) update-leader! ...gb-bug/src/core/egraph.rkt:217:0 for-loop [157] 93.8% ---------------------------------------------------------------------------- match-e [136] 10.6% list-cartesian-product [146] 35.7% for-loop [138] 53.7% [146] 3386(2.1%) 2692(1.7%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [146] 35.7% for-loop [159] 10.2% ---------------------------------------------------------------------------- merge-egraph-nodes! [139] 100.0% [147] 2110(1.3%) 1052(0.7%) enode-merge! .../logb-bug/src/core/enode.rkt:129:0 adopt-enode! [160] 32.7% custom-set-intersect! [161] 17.4% ---------------------------------------------------------------------------- merge-egraph-nodes! [139] 100.0% [148] 2044(1.3%) 2044(1.3%) for-loop ...bie/logb-bug/src/core/egraph.rkt:232:6 ---------------------------------------------------------------------------- merge-egraph-nodes! [139] 100.0% [149] 2040(1.3%) 0(0.0%) for-loop ...ie/logb-bug/src/core/egraph.rkt:200:10 merge-egraph-nodes! [139] 66.5% loop! [156] 33.5% ---------------------------------------------------------------------------- *rules* [69] 25.3% merge-egraph-nodes! [139] 74.7% [150] 1414(0.9%) 1056(0.7%) for-loop ...es/herbie/logb-bug/src/common.rkt:94:9 ormap [162] 25.3% ---------------------------------------------------------------------------- for-loop [138] 32.5% loop [86] 67.5% [151] 1028(0.6%) 694(0.4%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [163] 32.5% ---------------------------------------------------------------------------- match-e [136] 32.6% for-loop [138] 67.4% [152] 1018(0.6%) 0(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [158] 100.0% ---------------------------------------------------------------------------- list-member? [141] 100.0% [153] 360(0.2%) 360(0.2%) member (unknown source) ---------------------------------------------------------------------------- list-member? [141] 100.0% [154] 336(0.2%) 336(0.2%) loop (unknown source) ---------------------------------------------------------------------------- mk-enode! [143] 100.0% [155] 20674(13.0%) 0(0.0%) new-enode ...rbie/logb-bug/src/core/enode.rkt:97:0 type-of-enode-expr [164] 98.3% set [167] 1.7% ---------------------------------------------------------------------------- for-loop [149] 3.4% merge-egraph-nodes! [139] 6.1% loop [86] 27.7% for-loop [135] 62.8% [156] 8212(5.2%) 1052(0.7%) loop! .../herbie/logb-bug/src/core/enode.rkt:192:2 custom-set-union [166] 43.1% loop [86] 27.7% update-en-expr [184] 10.7% set [167] 9.9% ---------------------------------------------------------------------------- update-leader! [145] 100.0% [157] 5490(3.5%) 0(0.0%) for-loop ...bie/logb-bug/src/core/egraph.rkt:222:6 for-loop [165] 100.0% ---------------------------------------------------------------------------- curry* [152] 100.0% [158] 1018(0.6%) 1018(0.6%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ---------------------------------------------------------------------------- list-cartesian-product [146] 100.0% [159] 694(0.4%) 694(0.4%) for-loop ...rbie/logb-bug/src/core/ematch.rkt:24:8 ---------------------------------------------------------------------------- enode-merge! [147] 100.0% [160] 690(0.4%) 0(0.0%) adopt-enode! .../logb-bug/src/core/enode.rkt:105:0 custom-set-union [166] 100.0% ---------------------------------------------------------------------------- enode-merge! [147] 100.0% [161] 368(0.2%) 368(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ---------------------------------------------------------------------------- for-loop [150] 100.0% [162] 358(0.2%) 358(0.2%) ormap ...et/collects/racket/private/map.rkt:105:13 ---------------------------------------------------------------------------- foldl [151] 100.0% [163] 334(0.2%) 334(0.2%) merge2 ...herbie/logb-bug/src/core/ematch.rkt:31:0 ---------------------------------------------------------------------------- new-enode [155] 100.0% [164] 20314(12.8%) 368(0.2%) type-of-enode-expr ...-bug/src/core/enode.rkt:68:0 get-sigs [168] 98.2% ---------------------------------------------------------------------------- for-loop [157] 100.0% [165] 5490(3.5%) 0(0.0%) for-loop ...bie/logb-bug/src/core/egraph.rkt:223:8 hash-update! [169] 100.0% ---------------------------------------------------------------------------- adopt-enode! [160] 15.5% loop! [156] 84.5% [166] 4464(2.8%) 1682(1.1%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [170] 47.0% for-loop [171] 15.3% ---------------------------------------------------------------------------- new-enode [155] 18.1% loop! [156] 81.9% [167] 1992(1.3%) 1992(1.3%) set ...collects/racket/private/set-types.rkt:981:0 ---------------------------------------------------------------------------- type-of-enode-expr [164] 100.0% [168] 19946(12.6%) 360(0.2%) get-sigs ...herbie/logb-bug/src/type-check.rkt:5:0 ??? [172] 41.0% ->flonum [98] 30.8% ??? [44] 14.0% ...b-bug/src/common.rkt:47:2 [174] 12.3% ---------------------------------------------------------------------------- for-loop [165] 100.0% [169] 5490(3.5%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [173] 100.0% ---------------------------------------------------------------------------- custom-set-union [166] 100.0% [170] 2098(1.3%) 672(0.4%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [175] 68.0% ---------------------------------------------------------------------------- custom-set-union [166] 100.0% [171] 684(0.4%) 684(0.4%) for-loop ...cts/racket/private/set-types.rkt:152:2 ---------------------------------------------------------------------------- f6 [36] 3.6% for-loop [45] 7.8% get-sigs [168] 88.6% [172] 9236(5.8%) 1080(0.7%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [178] 44.1% for-loop [177] 37.4% get/build-late-neg-projection [191] 6.8% ---------------------------------------------------------------------------- hash-update! [169] 100.0% [173] 5490(3.5%) 296(0.2%) ??? .../herbie/logb-bug/src/core/egraph.rkt:225:24 for-loop [176] 94.6% ---------------------------------------------------------------------------- ??? [93] 9.4% for-loop [45] 26.5% get-sigs [168] 64.1% [174] 3828(2.4%) 1426(0.9%) ...b-bug/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [179] 35.3% ??? [180] 18.1% coerce-contract [181] 9.4% ---------------------------------------------------------------------------- for-loop [170] 100.0% [175] 1426(0.9%) 1426(0.9%) for-loop ...cts/racket/private/set-types.rkt:178:5 ---------------------------------------------------------------------------- ??? [173] 100.0% [176] 5194(3.3%) 4170(2.6%) for-loop ...ie/logb-bug/src/core/egraph.rkt:226:26 update-en-expr [184] 19.7% ---------------------------------------------------------------------------- for-loop [117] 27.3% ??? [172] 72.7% [177] 4748(3.0%) 974(0.6%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [182] 79.5% ---------------------------------------------------------------------------- ??? [172] 100.0% [178] 4076(2.6%) 362(0.2%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [183] 91.1% ---------------------------------------------------------------------------- ...b-bug/src/common.rkt:47:2 [174] 100.0% [179] 1350(0.8%) 990(0.6%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 assoc-ref [185] 26.7% ---------------------------------------------------------------------------- for-loop [188] 24.0% ...b-bug/src/common.rkt:47:2 [174] 76.0% [180] 692(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [182] 76.0% ??? [189] 24.0% ---------------------------------------------------------------------------- ...b-bug/src/common.rkt:47:2 [174] 100.0% [181] 360(0.2%) 360(0.2%) coerce-contract ...contract/private/guts.rkt:257:0 ---------------------------------------------------------------------------- ??? [180] 15.5% for-loop [177] 84.5% [182] 4466(2.8%) 658(0.4%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [187] 69.8% for-loop [188] 15.5% ---------------------------------------------------------------------------- ??? [178] 100.0% [183] 3714(2.3%) 360(0.2%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [186] 90.3% ---------------------------------------------------------------------------- for-loop [176] 36.9% loop! [156] 63.1% [184] 2778(1.7%) 2778(1.7%) update-en-expr ...gb-bug/src/core/egraph.rkt:211:0 ---------------------------------------------------------------------------- ??? [179] 100.0% [185] 360(0.2%) 360(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ---------------------------------------------------------------------------- ??? [183] 100.0% [186] 3354(2.1%) 360(0.2%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [190] 89.3% ---------------------------------------------------------------------------- ??? [182] 100.0% [187] 3116(2.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [189] 100.0% ---------------------------------------------------------------------------- ??? [182] 100.0% [188] 692(0.4%) 360(0.2%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [180] 48.0% ---------------------------------------------------------------------------- ??? [44] 7.9% ??? [180] 8.1% ??? [95] 8.4% ??? [187] 75.7% [189] 4116(2.6%) 3784(2.4%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [193] 8.1% ---------------------------------------------------------------------------- ??? [186] 100.0% [190] 2994(1.9%) 0(0.0%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [192] 54.6% get/build-late-neg-projection [191] 45.4% ---------------------------------------------------------------------------- ??? [195] 7.6% ??? [172] 23.9% for-loop [190] 68.4% [191] 1984(1.2%) 362(0.2%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [194] 57.8% ??? [195] 23.9% ---------------------------------------------------------------------------- for-loop [190] 100.0% [192] 1636(1.0%) 1636(1.0%) add-list-context ...ontract/private/list.rkt:752:0 ---------------------------------------------------------------------------- ??? [189] 100.0% [193] 332(0.2%) 332(0.2%) contract? ...acket/contract/private/guts.rkt:109:0 ---------------------------------------------------------------------------- get/build-late-neg-projection [191]100.0% [194] 1298(0.8%) 696(0.4%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [196] 46.4% ---------------------------------------------------------------------------- get/build-late-neg-projection [191]100.0% [195] 626(0.4%) 324(0.2%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [191] 48.2% ---------------------------------------------------------------------------- contract-struct-name [197] 24.9% ??? [194] 75.1% [196] 602(0.4%) 602(0.4%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [197] 24.9% ---------------------------------------------------------------------------- build-compound-type-name [196] 100.0% [197] 300(0.2%) 0(0.0%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [196] 100.0% ----------------------------------------------------------------------------