Profiling results ----------------- Total cpu time observed: 220516ms (out of 222212ms) Number of samples taken: 608 (once every 363ms) (Hiding functions with self<1.0% and local<2.0%: 12 of 206 hidden) =========================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================== ??? [62] 100.0% [1] 198906(90.2%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [17] 100.0% --------------------------------------------------------------------------- ??? [62] 100.0% [2] 131514(59.6%) 0(0.0%) run-improve50 ...mplify-bug/src/mainloop.rkt:234:0 for-loop [19] 54.0% get-final-combination [20] 43.8% loop [69] 1.9% ??? [54] 0.3% --------------------------------------------------------------------------- ??? [92] 100.0% [3] 13334(6.0%) 0(0.0%) approximate9 ...plify-bug/src/core/taylor.rkt:12:0 loop [21] 89.3% f6 [40] 8.0% for-loop [28] 2.7% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [4] 9858(4.5%) 0(0.0%) ??? ...bie/simplify-bug/src/core/taylor.rkt:285:26 for-loop [22] 100.0% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [5] 8810(4.0%) 0(0.0%) ??? ...bie/simplify-bug/src/core/taylor.rkt:295:23 for-loop [23] 100.0% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [6] 6742(3.1%) 0(0.0%) ??? ...rbie/simplify-bug/src/core/taylor.rkt:67:15 hash-ref! [154] 51.7% ??? [92] 48.3% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [7] 4044(1.8%) 0(0.0%) ??? ...bie/simplify-bug/src/core/taylor.rkt:392:23 for-loop [24] 100.0% --------------------------------------------------------------------------- location-do [70] 100.0% [8] 3758(1.7%) 0(0.0%) loop ...e/simplify-bug/src/core/simplify.rkt:214:2 pass [25] 100.0% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [9] 2700(1.2%) 0(0.0%) ??? ...bie/simplify-bug/src/core/taylor.rkt:338:33 hash-ref! [154] 89.0% for-loop [31] 11.0% --------------------------------------------------------------------------- copying-mergesort [155] 100.0% [10] 1720(0.8%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [18] 100.0% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [11] 1410(0.6%) 0(0.0%) ??? ...bie/simplify-bug/src/core/taylor.rkt:408:23 for-loop [26] 100.0% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [12] 694(0.3%) 0(0.0%) ??? ...bie/simplify-bug/src/core/taylor.rkt:483:23 for-loop [27] 100.0% --------------------------------------------------------------------------- parse-loop12 [174] 2.3% loop [13] 97.7% [13] 684(0.3%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [13] 97.7% ->flonum [173] 2.3% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [14] 362(0.2%) 0(0.0%) ??? ...bie/simplify-bug/src/core/taylor.rkt:322:33 for-loop [29] 100.0% --------------------------------------------------------------------------- f6 [40] 100.0% [15] 358(0.2%) 0(0.0%) taylor-invert ...ify-bug/src/core/taylor.rkt:312:0 simplify [163] 100.0% --------------------------------------------------------------------------- f6 [40] 100.0% [16] 300(0.1%) 0(0.0%) taylor-quotient ...y-bug/src/core/taylor.rkt:328:0 first-nonzero-exp [30] 100.0% --------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [17] 198906(90.2%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [62] 100.0% --------------------------------------------------------------------------- map [91] 0.7% for-loop [132] 1.1% jloop [10] 1.8% loop [165] 9.6% for-loop [133] 20.0% loop [98] 66.8% [18] 95654(43.4%) 674(0.3%) ??? .../herbie/simplify-bug/src/programs.rkt:155:4 ??? [32] 81.3% ??? [108] 8.5% ->flonum [173] 5.9% loop [98] 3.6% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [19] 71046(32.2%) 0(0.0%) for-loop ...e/simplify-bug/src/mainloop.rkt:249:10 run-iter! [33] 100.0% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [20] 57566(26.1%) 0(0.0%) get-final-combination ...ug/src/mainloop.rkt:264:0 split-table [34] 99.4% extract-alt [39] 0.6% --------------------------------------------------------------------------- approximate9 [3] 100.0% [21] 11906(5.4%) 0(0.0%) loop ...rbie/simplify-bug/src/core/taylor.rkt:86:4 hash-ref! [154] 56.6% ??? [92] 43.4% --------------------------------------------------------------------------- ??? [4] 100.0% [22] 9858(4.5%) 692(0.3%) for-loop ...implify-bug/src/core/taylor.rkt:285:52 hash-ref! [154] 85.9% ??? [37] 8.8% --------------------------------------------------------------------------- ??? [5] 100.0% [23] 8810(4.0%) 0(0.0%) for-loop ...implify-bug/src/core/taylor.rkt:298:27 hash-ref! [154] 100.0% --------------------------------------------------------------------------- ??? [7] 100.0% [24] 4044(1.8%) 0(0.0%) for-loop ...implify-bug/src/core/taylor.rkt:396:33 for-loop [35] 100.0% --------------------------------------------------------------------------- loop [8] 100.0% [25] 3758(1.7%) 0(0.0%) pass ...e/simplify-bug/src/core/simplify.rkt:204:2 for-loop [36] 100.0% --------------------------------------------------------------------------- ??? [11] 100.0% [26] 1410(0.6%) 0(0.0%) for-loop ...implify-bug/src/core/taylor.rkt:411:30 for-loop [38] 100.0% --------------------------------------------------------------------------- ??? [12] 100.0% [27] 694(0.3%) 0(0.0%) for-loop ...implify-bug/src/core/taylor.rkt:487:35 parse-loop12 [174] 100.0% --------------------------------------------------------------------------- approximate9 [3] 100.0% [28] 364(0.2%) 0(0.0%) for-loop ...simplify-bug/src/core/taylor.rkt:29:18 f6 [40] 100.0% --------------------------------------------------------------------------- ??? [14] 100.0% [29] 362(0.2%) 0(0.0%) for-loop ...implify-bug/src/core/taylor.rkt:324:46 simplify [163] 100.0% --------------------------------------------------------------------------- taylor-quotient [16] 100.0% [30] 300(0.1%) 0(0.0%) first-nonzero-exp ...bug/src/core/taylor.rkt:260:0 hash-ref! [154] 100.0% --------------------------------------------------------------------------- ??? [9] 100.0% [31] 298(0.1%) 0(0.0%) for-loop ...implify-bug/src/core/taylor.rkt:341:46 hash-ref! [154] 100.0% --------------------------------------------------------------------------- ??? [18] 100.0% [32] 77768(35.3%) 18104(8.2%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [105] 55.3% ??? [44] 14.9% bf* [45] 3.8% ??? [48] 2.1% ...higher-order.rkt:346:33 [52] 0.6% --------------------------------------------------------------------------- for-loop [19] 100.0% [33] 71046(32.2%) 0(0.0%) run-iter! ...e/simplify-bug/src/mainloop.rkt:215:0 simplify! [41] 57.7% finalize-iter! [42] 19.7% gen-series! [43] 18.8% localize-error [49] 1.9% gen-rewrites! [50] 1.4% --------------------------------------------------------------------------- get-final-combination [20] 100.0% [34] 57204(25.9%) 0(0.0%) split-table ...bie/simplify-bug/src/glue.rkt:162:0 f6 [40] 100.0% --------------------------------------------------------------------------- for-loop [24] 100.0% [35] 4044(1.8%) 0(0.0%) for-loop ...implify-bug/src/core/taylor.rkt:398:39 hash-ref! [154] 100.0% --------------------------------------------------------------------------- pass [25] 100.0% [36] 3758(1.7%) 0(0.0%) for-loop ...plify-bug/src/core/simplify.rkt:207:29 argmin [47] 54.3% loop [46] 45.7% --------------------------------------------------------------------------- for-loop [22] 100.0% [37] 2086(0.9%) 0(0.0%) ??? ...bie/simplify-bug/src/core/taylor.rkt:288:19 hash-ref! [154] 100.0% --------------------------------------------------------------------------- for-loop [26] 100.0% [38] 1410(0.6%) 0(0.0%) for-loop ...implify-bug/src/core/taylor.rkt:414:42 hash-ref! [154] 100.0% --------------------------------------------------------------------------- get-final-combination [20] 100.0% [39] 362(0.2%) 0(0.0%) extract-alt ...rbie/simplify-bug/src/glue.rkt:54:0 loop [51] 100.0% --------------------------------------------------------------------------- ??? [109] 0.1% for-loop [28] 0.3% approximate9 [3] 0.7% hash-ref! [154] 1.1% loop [98] 1.2% parse-loop12 [174] 1.7% map [91] 3.0% simplify [163] 5.1% eval-prog [147] 6.0% f6 [40] 9.2% split-table [34] 71.7% [40] 67832(30.8%) 1402(0.6%) f6 ...et/collects/racket/match/compiler.rkt:507:40 loop [98] 63.3% map [91] 10.8% f6 [40] 9.2% option-on-expr [104] 7.8% ??? [92] 5.6% taylor [59] 0.8% loop [46] 0.5% taylor-invert [15] 0.1% composed [57] 0.1% taylor-quotient [16] 0.0% --------------------------------------------------------------------------- run-iter! [33] 100.0% [41] 40966(18.6%) 0(0.0%) simplify! ...e/simplify-bug/src/mainloop.rkt:155:0 for-loop [53] 100.0% --------------------------------------------------------------------------- run-iter! [33] 100.0% [42] 13980(6.3%) 0(0.0%) finalize-iter! ...plify-bug/src/mainloop.rkt:169:0 ??? [54] 100.0% --------------------------------------------------------------------------- run-iter! [33] 100.0% [43] 13334(6.0%) 0(0.0%) gen-series! ...simplify-bug/src/mainloop.rkt:129:0 for-loop [55] 100.0% --------------------------------------------------------------------------- ??? [32] 100.0% [44] 11626(5.3%) 6390(2.9%) ??? ...e/simplify-bug/src/syntax/syntax.rkt:118:17 ??? [183] 24.1% return/no-unsupplied [184] 18.2% list-member? [127] 2.7% --------------------------------------------------------------------------- ??? [32] 100.0% [45] 2990(1.4%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [105] 100.0% --------------------------------------------------------------------------- f6 [40] 17.3% for-loop [36] 82.7% [46] 2078(0.9%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [56] 65.4% errors-score [61] 17.3% expression-cost [60] 17.3% --------------------------------------------------------------------------- for-loop [36] 100.0% [47] 2040(0.9%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [56] 83.8% expression-cost [60] 16.2% --------------------------------------------------------------------------- ??? [32] 100.0% [48] 1648(0.7%) 1648(0.7%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 --------------------------------------------------------------------------- run-iter! [33] 100.0% [49] 1378(0.6%) 0(0.0%) localize-error ...y-bug/src/core/localize.rkt:47:0 hash-ref! [154] 100.0% --------------------------------------------------------------------------- run-iter! [33] 100.0% [50] 1028(0.5%) 0(0.0%) gen-rewrites! ...mplify-bug/src/mainloop.rkt:142:0 for-loop [58] 100.0% --------------------------------------------------------------------------- best-alt [101] 48.0% extract-alt [39] 52.0% [51] 696(0.3%) 0(0.0%) loop ...s/herbie/simplify-bug/src/common.rkt:142:2 composed [57] 100.0% --------------------------------------------------------------------------- ??? [32] 100.0% [52] 432(0.2%) 0(0.0%) ...higher-order.rkt:346:33 (unknown source) ??? [124] 100.0% --------------------------------------------------------------------------- simplify! [41] 93.5% [53] 43828(19.9%) 0(0.0%) for-loop ...ie/simplify-bug/src/mainloop.rkt:159:6 ??? [62] 100.0% --------------------------------------------------------------------------- run-improve50 [2] 1.6% variable? [138] 7.7% match-e [106] 11.1% ??? [191] 15.6% finalize-iter! [42] 62.3% [54] 21878(9.9%) 3102(1.4%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [64] 57.4% hash-has-key? [65] 18.9% atab-add-altns [66] 6.5% ??? [191] 1.4% --------------------------------------------------------------------------- gen-series! [43] 100.0% [55] 13334(6.0%) 0(0.0%) for-loop ...ie/simplify-bug/src/mainloop.rkt:135:7 taylor-alt [63] 100.0% --------------------------------------------------------------------------- loop [46] 44.3% argmin [47] 55.7% [56] 3068(1.4%) 0(0.0%) for-loop ...ie/simplify-bug/src/programs.rkt:200:2 location-do [70] 54.1% ...y-bug/src/common.rkt:47:2 [100] 34.2% ??? [102] 11.7% --------------------------------------------------------------------------- f6 [40] 25.3% argmins [114] 25.5% loop [51] 49.2% [57] 1414(0.6%) 358(0.2%) composed ...ollects/racket/private/list.rkt:321:16 errors [117] 74.7% --------------------------------------------------------------------------- gen-rewrites! [50] 100.0% [58] 1028(0.5%) 0(0.0%) for-loop ...e/simplify-bug/src/mainloop.rkt:147:11 ??? [67] 100.0% --------------------------------------------------------------------------- f6 [40] 100.0% [59] 710(0.3%) 0(0.0%) taylor ...e/simplify-bug/src/core/taylor.rkt:163:0 debug-print [180] 51.3% debug7 [179] 48.7% --------------------------------------------------------------------------- argmin [47] 47.8% loop [46] 52.2% [60] 690(0.3%) 0(0.0%) expression-cost ...lify-bug/src/programs.rkt:199:0 compile [68] 100.0% --------------------------------------------------------------------------- loop [46] 100.0% [61] 360(0.2%) 360(0.2%) errors-score .../simplify-bug/src/points.rkt:228:0 --------------------------------------------------------------------------- for-loop [53] 8.0% run [17] 44.7% [62] 207216(94.0%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 44.7% run-improve50 [2] 28.7% loop [69] 17.1% location-do [70] 9.4% --------------------------------------------------------------------------- for-loop [55] 100.0% [63] 13334(6.0%) 0(0.0%) taylor-alt ...rbie/simplify-bug/src/glue.rkt:139:0 for-loop [72] 100.0% --------------------------------------------------------------------------- ??? [54] 100.0% [64] 12902(5.9%) 0(0.0%) for-loop ...mplify-bug/src/core/alt-table.rkt:51:2 atab-add-altn [71] 100.0% --------------------------------------------------------------------------- ??? [54] 100.0% [65] 4478(2.0%) 1076(0.5%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [78] 76.0% --------------------------------------------------------------------------- ??? [54] 100.0% [66] 1430(0.6%) 0(0.0%) atab-add-altns ...-bug/src/core/alt-table.rkt:50:0 atab-add-altn [71] 100.0% --------------------------------------------------------------------------- for-loop [58] 100.0% [67] 1028(0.5%) 0(0.0%) ??? ...erbie/simplify-bug/src/alternative.rkt:88:0 rewriter [73] 100.0% --------------------------------------------------------------------------- expression-cost [60] 100.0% [68] 690(0.3%) 0(0.0%) compile ...bie/simplify-bug/src/programs.rkt:176:0 hash-ref! [154] 100.0% --------------------------------------------------------------------------- run-improve50 [2] 3.5% ??? [62] 96.5% [69] 72390(32.8%) 0(0.0%) loop ...s/herbie/simplify-bug/src/points.rkt:193:2 loop [75] 45.0% make-exacts* [84] 36.5% loop [85] 15.8% for-loop [79] 2.8% --------------------------------------------------------------------------- for-loop [56] 0.8% location-do [70] 20.0% for-loop [76] 20.9% ??? [92] 22.8% ??? [62] 35.4% [70] 65380(29.6%) 2108(1.0%) location-do ...acket/private/norm-define.rkt:53:83 iterate-egraph!13 [74] 32.7% for-loop [76] 20.9% location-do [70] 20.0% ??? [92] 14.3% ??? [78] 5.5% loop [8] 2.5% debug7 [179] 0.3% --------------------------------------------------------------------------- atab-add-altns [66] 10.0% for-loop [64] 90.0% [71] 14332(6.5%) 0(0.0%) atab-add-altn ...-bug/src/core/alt-table.rkt:208:0 best-and-tied-at-points [77] 92.4% override-at-pnts [80] 7.6% --------------------------------------------------------------------------- taylor-alt [63] 100.0% [72] 13334(6.0%) 0(0.0%) for-loop ...herbie/simplify-bug/src/glue.rkt:141:2 ??? [92] 100.0% --------------------------------------------------------------------------- ??? [67] 23.3% matcher [88] 76.7% [73] 1028(0.5%) 0(0.0%) rewriter ...implify-bug/src/core/matcher.rkt:127:2 for-loop [82] 76.7% *rules* [81] 23.3% --------------------------------------------------------------------------- location-do [70] 100.0% [74] 42710(19.4%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:102:0 one-iter [83] 97.7% map-enodes [89] 2.3% --------------------------------------------------------------------------- loop [69] 100.0% [75] 32554(14.8%) 0(0.0%) loop ...s/herbie/simplify-bug/src/points.rkt:151:2 loop [85] 53.3% make-exacts* [84] 37.4% eval-prog [147] 9.3% --------------------------------------------------------------------------- location-do [70] 100.0% [76] 27604(12.5%) 0(0.0%) for-loop ...mplify-bug/src/core/simplify.rkt:63:12 location-do [70] 100.0% --------------------------------------------------------------------------- atab-add-altn [71] 100.0% [77] 13246(6.0%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [117] 100.0% --------------------------------------------------------------------------- hash-has-key? [65] 43.3% location-do [70] 56.7% [78] 7852(3.6%) 3418(1.6%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [86] 52.1% ??? [110] 4.4% --------------------------------------------------------------------------- loop [69] 100.0% [79] 2002(0.9%) 0(0.0%) for-loop ...bie/simplify-bug/src/points.rkt:200:24 for-loop [87] 100.0% --------------------------------------------------------------------------- atab-add-altn [71] 100.0% [80] 1086(0.5%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:145:0 errors [117] 100.0% --------------------------------------------------------------------------- rewriter [73] 100.0% [81] 1028(0.5%) 0(0.0%) *rules* ...simplify-bug/src/syntax/rules.rkt:455:0 for-loop [90] 64.8% ormap [96] 35.2% --------------------------------------------------------------------------- rewriter [73] 100.0% [82] 1028(0.5%) 0(0.0%) for-loop ...mplify-bug/src/core/matcher.rkt:130:10 matcher [88] 100.0% --------------------------------------------------------------------------- iterate-egraph!13 [74] 100.0% [83] 41722(18.9%) 686(0.3%) one-iter ...mplify-bug/src/core/simplify.rkt:113:0 loop [93] 50.6% for-loop [94] 46.9% --------------------------------------------------------------------------- loop [75] 31.6% loop [69] 68.4% [84] 38584(17.5%) 0(0.0%) make-exacts* .../simplify-bug/src/points.rkt:138:0 map [91] 52.7% loop [98] 47.3% --------------------------------------------------------------------------- loop [69] 39.7% loop [75] 60.3% [85] 28776(13.0%) 0(0.0%) loop ...s/herbie/simplify-bug/src/points.rkt:141:4 map [91] 100.0% --------------------------------------------------------------------------- ??? [78] 100.0% [86] 4088(1.9%) 2766(1.3%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [110] 25.0% for-loop [97] 7.4% --------------------------------------------------------------------------- for-loop [79] 100.0% [87] 2002(0.9%) 0(0.0%) for-loop ...bie/simplify-bug/src/points.rkt:201:26 ??? [92] 100.0% --------------------------------------------------------------------------- for-loop [95] 23.4% matcher [88] 26.6% for-loop [82] 50.0% [88] 1028(0.5%) 0(0.0%) matcher ...simplify-bug/src/core/matcher.rkt:163:2 rewriter [73] 50.0% matcher [88] 26.6% for-loop [95] 23.4% --------------------------------------------------------------------------- iterate-egraph!13 [74] 100.0% [89] 988(0.4%) 0(0.0%) map-enodes ...mplify-bug/src/core/egraph.rkt:139:0 loop [98] 100.0% --------------------------------------------------------------------------- *rules* [81] 100.0% [90] 666(0.3%) 336(0.2%) for-loop ...erbie/simplify-bug/src/common.rkt:94:9 ormap [96] 49.5% --------------------------------------------------------------------------- ??? [109] 0.1% parse-loop12 [174] 3.5% f6 [40] 13.2% make-exacts* [84] 34.4% loop [85] 48.7% [91] 59028(26.8%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [98] 84.4% parse-loop12 [174] 5.6% f6 [40] 4.2% ??? [109] 2.6% simplify* [176] 2.0% ??? [18] 1.1% ->flonum [173] 0.1% --------------------------------------------------------------------------- loop [21] 6.0% for-loop [87] 7.0% ??? [6] 7.8% location-do [70] 15.1% for-loop [72] 16.3% f6 [40] 44.1% [92] 28700(13.0%) 2602(1.2%) ??? ...tract/private/arrow-higher-order.rkt:342:33 location-do [70] 34.5% approximate9 [3] 16.3% hash-ref! [154] 13.8% ??? [191] 13.1% ...y-bug/src/common.rkt:47:2 [100] 8.4% best-alt [101] 2.4% ->flonum [173] 1.2% ??? [102] 1.2% --------------------------------------------------------------------------- one-iter [83] 100.0% [93] 21094(9.6%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:52:19 apply-match [99] 100.0% --------------------------------------------------------------------------- for-loop [94] 46.5% one-iter [83] 53.5% [94] 19580(8.9%) 5684(2.6%) for-loop ...plify-bug/src/core/simplify.rkt:123:12 for-loop [94] 46.5% match-e [106] 35.5% --------------------------------------------------------------------------- matcher [88] 100.0% [95] 1028(0.5%) 0(0.0%) for-loop ...mplify-bug/src/core/matcher.rkt:179:21 matcher [88] 100.0% --------------------------------------------------------------------------- for-loop [90] 47.7% *rules* [81] 52.3% [96] 692(0.3%) 362(0.2%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [103] 47.7% --------------------------------------------------------------------------- for-loop [86] 100.0% [97] 302(0.1%) 302(0.1%) for-loop ...racket/contract/private/hash.rkt:239:6 --------------------------------------------------------------------------- for-loop [120] 0.0% make-exacts* [84] 0.1% map-enodes [89] 0.2% ??? [18] 0.4% loop! [148] 1.1% map [91] 1.6% option-on-expr [104] 1.6% parse-loop12 [174] 2.4% ??? [166] 2.6% f6 [40] 18.8% loop [98] 71.3% [98] 134938(61.2%) 2040(0.9%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [98] 71.3% option-on-expr [104] 18.8% hash-ref! [154] 2.5% errors [117] 1.6% parse-loop12 [174] 1.4% f6 [40] 1.3% loop! [148] 0.9% ??? [18] 0.9% ->flonum [173] 0.4% ??? [109] 0.3% for-loop [112] 0.2% ??? [105] 0.1% foldl [115] 0.0% ??? [108] 0.0% --------------------------------------------------------------------------- loop [93] 100.0% [99] 21094(9.6%) 690(0.3%) apply-match ...ify-bug/src/core/simplify.rkt:129:2 for-loop [107] 80.5% match-e [106] 14.6% update-leader! [137] 1.6% --------------------------------------------------------------------------- for-loop [56] 30.3% ??? [92] 69.7% [100] 3464(1.6%) 1720(0.8%) ...y-bug/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [111] 40.0% ??? [113] 10.4% --------------------------------------------------------------------------- ??? [92] 100.0% [101] 694(0.3%) 0(0.0%) best-alt .../herbie/simplify-bug/src/glue.rkt:76:0 argmins [114] 51.9% loop [51] 48.1% --------------------------------------------------------------------------- ??? [92] 48.0% for-loop [56] 52.0% [102] 692(0.3%) 360(0.2%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [110] 48.0% --------------------------------------------------------------------------- ormap [96] 100.0% [103] 330(0.1%) 0(0.0%) flag-set? ...rbie/simplify-bug/src/config.rkt:32:0 return/no-unsupplied [184] 100.0% --------------------------------------------------------------------------- f6 [40] 10.7% loop [98] 89.3% [104] 56844(25.8%) 0(0.0%) option-on-expr ...fy-bug/src/core/regimes.rkt:92:0 pick-errors [116] 56.1% sort-context-on-expr [118] 20.9% loop [98] 10.5% errors [117] 9.5% err-lsts->split-indices [125] 2.9% --------------------------------------------------------------------------- loop [98] 0.8% bf* [45] 6.5% ??? [32] 92.8% [105] 46318(21.0%) 31552(14.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [121] 19.8% bfcos [123] 12.1% --------------------------------------------------------------------------- apply-match [99] 7.7% for-loop [135] 26.3% for-loop [94] 66.0% [106] 16982(7.7%) 6568(3.0%) match-e ...e/simplify-bug/src/core/ematch.rkt:46:0 for-loop [120] 46.0% for-loop [135] 8.9% ??? [54] 7.4% variable? [138] 3.4% curry* [131] 1.9% --------------------------------------------------------------------------- apply-match [99] 100.0% [107] 16980(7.7%) 0(0.0%) for-loop ...plify-bug/src/core/simplify.rkt:144:10 loop! [148] 51.6% merge-egraph-nodes! [122] 42.6% substitute-e [129] 3.7% list-member? [127] 2.2% --------------------------------------------------------------------------- loop [98] 23.4% ??? [18] 76.6% [108] 10592(4.8%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [119] 100.0% --------------------------------------------------------------------------- loop [98] 18.6% map [91] 81.4% [109] 1736(0.8%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [154] 74.6% f6 [40] 20.6% map [91] 4.8% --------------------------------------------------------------------------- ??? [102] 19.6% ??? [78] 20.4% for-loop [86] 60.1% [110] 1698(0.8%) 694(0.3%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [126] 59.1% --------------------------------------------------------------------------- ??? [124] 11.9% for-loop [145] 12.1% ...y-bug/src/common.rkt:47:2 [100] 76.0% [111] 1384(0.6%) 334(0.2%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [124] 76.0% ??? [191] 11.9% --------------------------------------------------------------------------- loop [98] 100.0% [112] 988(0.4%) 326(0.1%) for-loop ...mplify-bug/src/core/simplify.rkt:172:2 setfindf [128] 67.0% --------------------------------------------------------------------------- ...y-bug/src/common.rkt:47:2 [100]100.0% [113] 360(0.2%) 360(0.2%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 --------------------------------------------------------------------------- best-alt [101] 100.0% [114] 360(0.2%) 0(0.0%) argmins ...erbie/simplify-bug/src/common.rkt:141:0 composed [57] 100.0% --------------------------------------------------------------------------- loop [98] 100.0% [115] 348(0.2%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [130] 100.0% --------------------------------------------------------------------------- option-on-expr [104] 100.0% [116] 31914(14.5%) 0(0.0%) pick-errors ...lify-bug/src/core/regimes.rkt:160:0 for-loop [132] 99.0% eval-prog [147] 1.0% --------------------------------------------------------------------------- composed [57] 3.9% override-at-pnts [80] 4.1% option-on-expr [104] 20.1% loop [98] 22.4% best-and-tied-at-points [77] 49.5% [117] 26762(12.1%) 0(0.0%) errors ...herbie/simplify-bug/src/points.rkt:218:0 for-loop [133] 83.1% eval-prog [147] 16.9% --------------------------------------------------------------------------- option-on-expr [104] 100.0% [118] 11908(5.4%) 0(0.0%) sort-context-on-expr ...y-bug/src/points.rkt:115:0 ??? [134] 100.0% --------------------------------------------------------------------------- ??? [108] 100.0% [119] 10592(4.8%) 8490(3.9%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [136] 19.8% --------------------------------------------------------------------------- match-e [106] 100.0% [120] 10434(4.7%) 4494(2.0%) for-loop ...simplify-bug/src/core/ematch.rkt:59:11 for-loop [135] 49.9% list-cartesian-product [140] 6.9% loop [98] 3.3% --------------------------------------------------------------------------- ??? [105] 100.0% [121] 9152(4.2%) 5920(2.7%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [136] 35.3% --------------------------------------------------------------------------- for-loop [141] 2.4% merge-egraph-nodes! [122] 7.3% for-loop [107] 90.2% [122] 7226(3.3%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:152:0 update-leader! [137] 60.1% loop! [148] 11.4% enode-merge! [142] 9.2% merge-egraph-nodes! [122] 7.3% for-loop [141] 7.0% for-loop [144] 5.0% --------------------------------------------------------------------------- ??? [105] 100.0% [123] 5614(2.5%) 4096(1.9%) bfcos ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [136] 27.0% --------------------------------------------------------------------------- ...higher-order.rkt:346:33 [52] 23.8% ??? [111] 76.2% [124] 1816(0.8%) 720(0.3%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [191] 23.8% for-loop [145] 18.4% ??? [111] 18.2% --------------------------------------------------------------------------- option-on-expr [104] 100.0% [125] 1648(0.7%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:214:0 add-splitpoint [139] 100.0% --------------------------------------------------------------------------- ??? [110] 100.0% [126] 1004(0.5%) 1004(0.5%) make-keyword-procedure ...ket/private/kw.rkt:260:4 --------------------------------------------------------------------------- ??? [44] 46.0% for-loop [107] 54.0% [127] 682(0.3%) 314(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 member [143] 54.0% --------------------------------------------------------------------------- for-loop [112] 100.0% [128] 662(0.3%) 662(0.3%) setfindf ...rbie/simplify-bug/src/common.rkt:175:0 --------------------------------------------------------------------------- for-loop [107] 42.0% substitute-e [129] 58.0% [129] 628(0.3%) 0(0.0%) substitute-e ...plify-bug/src/core/ematch.rkt:71:0 substitute-e [129] 58.0% variable? [138] 42.0% --------------------------------------------------------------------------- foldl [115] 100.0% [130] 348(0.2%) 348(0.2%) merge2 ...ie/simplify-bug/src/core/ematch.rkt:31:0 --------------------------------------------------------------------------- match-e [106] 100.0% [131] 326(0.1%) 0(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [146] 100.0% --------------------------------------------------------------------------- pick-errors [116] 100.0% [132] 31580(14.3%) 0(0.0%) for-loop ...implify-bug/src/core/regimes.rkt:163:6 eval-prog [147] 96.7% ??? [18] 3.3% --------------------------------------------------------------------------- errors [117] 100.0% [133] 22234(10.1%) 1740(0.8%) for-loop ...rbie/simplify-bug/src/points.rkt:221:4 ??? [18] 85.9% ->flonum [173] 4.7% --------------------------------------------------------------------------- sort-context-on-expr [118] 100.0% [134] 11908(5.4%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [149] 80.4% loop [165] 19.6% --------------------------------------------------------------------------- match-e [106] 32.9% for-loop [120] 67.1% [135] 7998(3.6%) 0(0.0%) for-loop ...simplify-bug/src/core/ematch.rkt:65:37 match-e [106] 100.0% --------------------------------------------------------------------------- bfcos [123] 22.2% real->bigfloat [119] 30.7% bfmul [121] 47.2% [136] 6852(3.1%) 6852(3.1%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 --------------------------------------------------------------------------- apply-match [99] 6.5% merge-egraph-nodes! [122] 93.5% [137] 5208(2.4%) 684(0.3%) update-leader! ...fy-bug/src/core/egraph.rkt:217:0 for-loop [150] 79.9% hash-ref! [154] 7.0% --------------------------------------------------------------------------- substitute-e [129] 31.4% match-e [106] 68.6% [138] 2000(0.9%) 326(0.1%) variable? ...plify-bug/src/syntax/syntax.rkt:529:0 ??? [54] 83.7% --------------------------------------------------------------------------- err-lsts->split-indices [125] 100.0% [139] 1648(0.7%) 0(0.0%) add-splitpoint ...y-bug/src/core/regimes.rkt:227:2 for-loop [151] 100.0% --------------------------------------------------------------------------- list-cartesian-product [140] 16.7% for-loop [120] 83.3% [140] 1078(0.5%) 722(0.3%) list-cartesian-product ...src/core/ematch.rkt:20:0 for-loop [152] 33.0% list-cartesian-product [140] 16.7% --------------------------------------------------------------------------- merge-egraph-nodes! [122] 100.0% [141] 684(0.3%) 0(0.0%) for-loop ...implify-bug/src/core/egraph.rkt:200:10 merge-egraph-nodes! [122] 51.2% loop! [148] 48.8% --------------------------------------------------------------------------- merge-egraph-nodes! [122] 100.0% [142] 664(0.3%) 334(0.2%) enode-merge! ...plify-bug/src/core/enode.rkt:100:0 custom-set-intersect! [153] 49.7% --------------------------------------------------------------------------- list-member? [127] 100.0% [143] 368(0.2%) 368(0.2%) member (unknown source) --------------------------------------------------------------------------- merge-egraph-nodes! [122] 100.0% [144] 358(0.2%) 358(0.2%) for-loop ...simplify-bug/src/core/egraph.rkt:232:6 --------------------------------------------------------------------------- ??? [124] 100.0% [145] 334(0.2%) 0(0.0%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [111] 100.0% --------------------------------------------------------------------------- curry* [131] 100.0% [146] 326(0.1%) 326(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 --------------------------------------------------------------------------- pick-errors [116] 0.9% loop [75] 7.9% errors [117] 11.8% for-loop [132] 79.5% [147] 38416(17.4%) 15634(7.1%) eval-prog ...e/simplify-bug/src/programs.rkt:149:0 f6 [40] 34.9% hash-ref! [154] 9.8% ??? [158] 9.3% go [160] 1.8% --------------------------------------------------------------------------- for-loop [141] 3.3% merge-egraph-nodes! [122] 6.5% loop [98] 26.0% for-loop [107] 64.2% [148] 10092(4.6%) 1410(0.6%) loop! ...bie/simplify-bug/src/core/enode.rkt:163:2 loop [98] 35.9% custom-set-union [156] 34.9% set [159] 13.3% update-en-expr [193] 7.0% --------------------------------------------------------------------------- ??? [134] 100.0% [149] 9578(4.3%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [155] 71.7% loop [165] 28.3% --------------------------------------------------------------------------- update-leader! [137] 100.0% [150] 4162(1.9%) 0(0.0%) for-loop ...simplify-bug/src/core/egraph.rkt:222:6 for-loop [157] 100.0% --------------------------------------------------------------------------- add-splitpoint [139] 100.0% [151] 1648(0.7%) 694(0.3%) for-loop ...implify-bug/src/core/regimes.rkt:229:4 for-loop [161] 38.0% loop [162] 19.9% --------------------------------------------------------------------------- list-cartesian-product [140] 100.0% [152] 356(0.2%) 356(0.2%) for-loop .../simplify-bug/src/core/ematch.rkt:24:8 --------------------------------------------------------------------------- enode-merge! [142] 100.0% [153] 330(0.1%) 330(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 --------------------------------------------------------------------------- for-loop [31] 0.2% first-nonzero-exp [30] 0.2% for-loop [187] 0.4% for-loop [38] 0.6% ??? [37] 1.2% ??? [9] 1.2% update-leader! [137] 2.0% localize-error [49] 2.5% compile [68] 3.7% for-loop [35] 3.8% loop [21] 4.0% ??? [109] 5.0% ??? [6] 5.4% eval-prog [147] 7.1% ??? [164] 11.0% for-loop [23] 11.1% for-loop [22] 12.3% ??? [92] 13.1% loop [98] 13.3% [154] 18456(8.4%) 716(0.3%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [166] 17.9% ??? [4] 14.2% simplify [163] 14.2% ??? [5] 11.1% ??? [164] 11.0% ??? [6] 9.4% parse-loop12 [174] 6.3% bigfloat-hash [169] 5.7% ??? [7] 3.8% ??? [9] 1.4% f6 [40] 1.3% ??? [11] 0.6% ??? [12] 0.4% ??? [14] 0.2% --------------------------------------------------------------------------- copying-mergesort [155] 43.0% generic-sort/key [149] 57.0% [155] 6864(3.1%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 loop [165] 50.8% copying-mergesort [155] 43.0% jloop [10] 6.3% --------------------------------------------------------------------------- loop! [148] 100.0% [156] 4254(1.9%) 1770(0.8%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [170] 41.5% for-loop [171] 16.9% --------------------------------------------------------------------------- for-loop [150] 100.0% [157] 4162(1.9%) 0(0.0%) for-loop ...simplify-bug/src/core/egraph.rkt:223:8 hash-update! [167] 100.0% --------------------------------------------------------------------------- eval-prog [147] 100.0% [158] 3558(1.6%) 360(0.2%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [168] 89.9% --------------------------------------------------------------------------- loop! [148] 100.0% [159] 2368(1.1%) 2368(1.1%) set ...collects/racket/private/set-types.rkt:981:0 --------------------------------------------------------------------------- eval-prog [147] 100.0% [160] 698(0.3%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [172] 100.0% --------------------------------------------------------------------------- for-loop [151] 100.0% [161] 626(0.3%) 626(0.3%) for-loop ...implify-bug/src/core/regimes.rkt:233:8 --------------------------------------------------------------------------- for-loop [151] 10.0% loop [162] 90.0% [162] 328(0.1%) 328(0.1%) loop ...hare/racket/collects/racket/list.rkt:154:2 loop [162] 90.0% --------------------------------------------------------------------------- taylor-invert [15] 3.0% for-loop [29] 3.0% hash-ref! [154] 94.0% [163] 11932(5.4%) 0(0.0%) simplify .../simplify-bug/src/core/reduce.rkt:15:0 f6 [40] 56.7% parse-loop12 [174] 28.7% debug-print [180] 5.5% simplify-node [182] 3.0% simplify* [176] 3.0% debug7 [179] 3.0% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [164] 11246(5.1%) 0(0.0%) ??? ...rbie/simplify-bug/src/core/taylor.rkt:44:15 hash-ref! [154] 100.0% --------------------------------------------------------------------------- ??? [134] 22.9% generic-sort/key [149] 26.6% copying-mergesort [155] 50.5% [165] 10188(4.6%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [18] 90.6% ->flonum [173] 9.4% --------------------------------------------------------------------------- hash-ref! [154] 100.0% [166] 4450(2.0%) 690(0.3%) ??? .../herbie/simplify-bug/src/programs.rkt:184:5 loop [98] 84.5% --------------------------------------------------------------------------- for-loop [157] 100.0% [167] 4162(1.9%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [175] 100.0% --------------------------------------------------------------------------- ??? [158] 100.0% [168] 3198(1.5%) 3198(1.5%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 --------------------------------------------------------------------------- hash-ref! [154] 100.0% [169] 2704(1.2%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 sig+exp->bigfloat [177] 75.6% bfcanonicalize [181] 24.4% --------------------------------------------------------------------------- custom-set-union [156] 100.0% [170] 1764(0.8%) 670(0.3%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [178] 62.0% --------------------------------------------------------------------------- custom-set-union [156] 100.0% [171] 720(0.3%) 720(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 --------------------------------------------------------------------------- loop [172] 46.7% go [160] 53.3% [172] 698(0.3%) 698(0.3%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [172] 46.7% --------------------------------------------------------------------------- map [91] 2.6% ??? [92] 2.6% loop [13] 5.4% loop [165] 7.5% for-loop [133] 8.2% loop [98] 29.4% ??? [18] 44.3% [173] 12776(5.8%) 7060(3.2%) ->flonum ...bie/simplify-bug/src/programs.rkt:37:0 ??? [183] 26.0% return/no-unsupplied [184] 18.7% --------------------------------------------------------------------------- for-loop [27] 5.4% loop [98] 10.7% parse-loop12 [174] 12.3% hash-ref! [154] 14.1% simplify [163] 16.3% map [91] 41.3% [174] 9800(4.4%) 5682(2.6%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [98] 28.9% map [91] 13.5% parse-loop12 [174] 12.3% f6 [40] 7.1% for-loop [187] 5.4% loop [13] 2.9% --------------------------------------------------------------------------- hash-update! [167] 100.0% [175] 4162(1.9%) 334(0.2%) ??? ...bie/simplify-bug/src/core/egraph.rkt:225:24 for-loop [185] 92.0% --------------------------------------------------------------------------- simplify [163] 11.3% map [91] 88.7% [176] 3196(1.4%) 1786(0.8%) simplify* ...simplify-bug/src/core/reduce.rkt:20:0 ??? [186] 44.1% --------------------------------------------------------------------------- bigfloat-hash [169] 100.0% [177] 2044(0.9%) 2044(0.9%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 --------------------------------------------------------------------------- for-loop [170] 100.0% [178] 1094(0.5%) 1094(0.5%) for-loop ...cts/racket/private/set-types.rkt:178:5 --------------------------------------------------------------------------- taylor [59] 32.5% simplify [163] 33.8% location-do [70] 33.8% [179] 1066(0.5%) 0(0.0%) debug7 .../herbie/simplify-bug/src/debug.rkt:102:0 return/no-unsupplied [184] 67.5% ??? [183] 32.5% --------------------------------------------------------------------------- taylor [59] 35.7% simplify [163] 64.3% [180] 1020(0.5%) 656(0.3%) debug-print ...ie/simplify-bug/src/debug.rkt:107:0 for-loop [188] 35.7% --------------------------------------------------------------------------- bigfloat-hash [169] 100.0% [181] 660(0.3%) 660(0.3%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 --------------------------------------------------------------------------- simplify [163] 100.0% [182] 362(0.2%) 0(0.0%) simplify-node ...lify-bug/src/core/reduce.rkt:39:0 combine-aterms [189] 100.0% --------------------------------------------------------------------------- debug7 [179] 5.3% ??? [44] 43.3% ->flonum [173] 51.3% [183] 6474(2.9%) 1022(0.5%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [190] 79.1% ??? [191] 5.2% --------------------------------------------------------------------------- flag-set? [103] 5.9% debug7 [179] 12.9% ??? [44] 38.1% ->flonum [173] 43.1% [184] 5560(2.5%) 3452(1.6%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [192] 37.9% --------------------------------------------------------------------------- ??? [175] 100.0% [185] 3828(1.7%) 3490(1.6%) for-loop ...implify-bug/src/core/egraph.rkt:226:26 update-en-expr [193] 8.8% --------------------------------------------------------------------------- simplify* [176] 100.0% [186] 1410(0.6%) 0(0.0%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [190] 100.0% --------------------------------------------------------------------------- parse-loop12 [174] 100.0% [187] 694(0.3%) 0(0.0%) for-loop ...implify-bug/src/core/taylor.rkt:490:59 hash-ref! [154] 100.0% --------------------------------------------------------------------------- debug-print [180] 100.0% [188] 364(0.2%) 364(0.2%) for-loop ...erbie/simplify-bug/src/debug.rkt:113:2 --------------------------------------------------------------------------- simplify-node [182] 100.0% [189] 362(0.2%) 362(0.2%) combine-aterms ...fy-bug/src/core/reduce.rkt:172:0 --------------------------------------------------------------------------- ??? [186] 21.6% ??? [183] 78.4% [190] 6528(3.0%) 6528(3.0%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 --------------------------------------------------------------------------- ??? [54] 5.8% ??? [111] 6.4% ??? [183] 6.5% ??? [124] 8.4% ??? [92] 73.0% [191] 5166(2.3%) 1066(0.5%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [54] 73.0% contract? [194] 6.4% --------------------------------------------------------------------------- return/no-unsupplied [184] 100.0% [192] 2108(1.0%) 2108(1.0%) filter ...t/collects/racket/private/list.rkt:256:2 --------------------------------------------------------------------------- for-loop [185] 24.2% loop! [148] 75.8% [193] 1394(0.6%) 1394(0.6%) update-en-expr ...fy-bug/src/core/egraph.rkt:211:0 --------------------------------------------------------------------------- ??? [191] 100.0% [194] 330(0.1%) 330(0.1%) contract? ...acket/contract/private/guts.rkt:109:0 ---------------------------------------------------------------------------