Profiling results ----------------- Total cpu time observed: 184558ms (out of 185284ms) Number of samples taken: 544 (once every 339ms) (Hiding functions with self<1.0% and local<2.0%: 5 of 201 hidden) ========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================== ??? [44] 100.0% [1] 170108(92.2%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [10] 100.0% ------------------------------------------------------------------------------------------ ??? [44] 100.0% [2] 145406(78.8%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 for-loop [11] 87.8% get-final-combination [13] 11.9% loop [58] 0.3% ------------------------------------------------------------------------------------------ ??? [140] 100.0% [3] 125194(67.8%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [12] 98.2% map-enodes [15] 1.5% debug-print [52] 0.3% ------------------------------------------------------------------------------------------ ??? [140] 100.0% [4] 5278(2.9%) 0(0.0%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [14] 100.0% ------------------------------------------------------------------------------------------ pattern-match [93] 10.5% match-e [27] 89.5% [5] 3322(1.8%) 324(0.2%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [111] 90.2% ------------------------------------------------------------------------------------------ copying-mergesort [128] 100.0% [6] 2680(1.5%) 326(0.2%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [135] 87.8% ------------------------------------------------------------------------------------------ ??? [138] 100.0% [7] 1030(0.6%) 0(0.0%) approximate9 ...e-testing/src/core/taylor.rkt:12:0 loop [16] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [147] 100.0% [8] 670(0.4%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:322:33 for-loop [17] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [147] 100.0% [9] 336(0.2%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:295:23 for-loop [18] 100.0% ------------------------------------------------------------------------------------------ profile-thunk16 [1] 99.8% [10] 170442(92.4%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [44] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [2] 100.0% [11] 127694(69.2%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [19] 100.0% ------------------------------------------------------------------------------------------ iterate-egraph!13 [3] 100.0% [12] 122892(66.6%) 1914(1.0%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [20] 82.0% for-loop [21] 16.2% ------------------------------------------------------------------------------------------ run-improve50 [2] 100.0% [13] 17308(9.4%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:266:0 split-table [22] 98.1% extract-alt [24] 1.9% ------------------------------------------------------------------------------------------ loop [4] 100.0% [14] 5278(2.9%) 0(0.0%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [23] 100.0% ------------------------------------------------------------------------------------------ iterate-egraph!13 [3] 100.0% [15] 1934(1.0%) 0(0.0%) map-enodes ...me-testing/src/core/egraph.rkt:140:0 loop [91] 83.5% for-loop [97] 16.5% ------------------------------------------------------------------------------------------ approximate9 [7] 100.0% [16] 1030(0.6%) 0(0.0%) loop ...ie/regime-testing/src/core/taylor.rkt:86:4 ??? [138] 100.0% ------------------------------------------------------------------------------------------ ??? [8] 100.0% [17] 670(0.4%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:324:46 hash-ref! [147] 74.9% simplify [160] 25.1% ------------------------------------------------------------------------------------------ ??? [9] 100.0% [18] 336(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:298:27 hash-ref! [147] 100.0% ------------------------------------------------------------------------------------------ for-loop [11] 100.0% [19] 127694(69.2%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [25] 93.5% finalize-iter! [29] 4.6% choose-best-alt! [31] 0.8% gen-series! [33] 0.8% gen-rewrites! [35] 0.3% ------------------------------------------------------------------------------------------ one-iter [12] 100.0% [20] 100774(54.6%) 610(0.3%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [26] 88.2% match-e [27] 9.2% reduce-to-single! [32] 1.0% update-leader! [47] 1.0% ------------------------------------------------------------------------------------------ for-loop [21] 50.0% one-iter [12] 50.0% [21] 19872(10.8%) 4456(2.4%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [21] 50.0% match-e [27] 38.8% ------------------------------------------------------------------------------------------ get-final-combination [13] 100.0% [22] 16982(9.2%) 0(0.0%) split-table ...e/regime-testing/src/glue.rkt:162:0 f45 [28] 100.0% ------------------------------------------------------------------------------------------ pass [14] 100.0% [23] 5278(2.9%) 0(0.0%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [70] 55.2% loop [30] 25.9% for-loop [34] 18.9% ------------------------------------------------------------------------------------------ get-final-combination [13] 100.0% [24] 326(0.2%) 0(0.0%) extract-alt ...ie/regime-testing/src/glue.rkt:55:0 argmins [36] 100.0% ------------------------------------------------------------------------------------------ run-iter! [19] 100.0% [25] 119346(64.7%) 0(0.0%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [37] 100.0% ------------------------------------------------------------------------------------------ for-loop [20] 100.0% [26] 88864(48.1%) 362(0.2%) for-loop ...e-testing/src/core/simplify.rkt:148:10 merge-egraph-nodes! [38] 30.5% list-member? [151] 20.7% loop! [94] 19.1% mk-enode! [45] 18.9% substitute-e [40] 10.4% ------------------------------------------------------------------------------------------ for-loop [20] 20.9% for-loop [46] 26.6% for-loop [21] 52.6% [27] 24708(13.4%) 6338(3.4%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [39] 52.1% ??? [111] 8.2% for-loop [46] 7.0% variable? [5] 4.4% list-cartesian-product [50] 2.6% loop [91] 2.0% ------------------------------------------------------------------------------------------ map [79] 0.6% parse-loop79 [86] 0.6% loop [91] 0.9% eval-const-expr [108] 1.8% eval-prog [186] 1.8% simplify [160] 3.3% f45 [28] 4.3% split-table [22] 86.6% [28] 18658(10.1%) 698(0.4%) f45 ...t/collects/racket/match/compiler.rkt:507:40 loop [91] 75.9% option-on-expr [95] 10.7% f45 [28] 4.3% map [79] 3.1% ...sting/src/common.rkt:48:2 [145] 1.8% ??? [138] 1.5% ------------------------------------------------------------------------------------------ run-iter! [19] 100.0% [29] 5936(3.2%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [111] 100.0% ------------------------------------------------------------------------------------------ for-loop [23] 100.0% [30] 1368(0.7%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [80] 100.0% ------------------------------------------------------------------------------------------ run-iter! [19] 100.0% [31] 1034(0.6%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:115:0 ??? [111] 100.0% ------------------------------------------------------------------------------------------ for-loop [20] 100.0% [32] 1030(0.6%) 360(0.2%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [42] 65.0% ------------------------------------------------------------------------------------------ run-iter! [19] 100.0% [33] 1030(0.6%) 0(0.0%) gen-series! ...gime-testing/src/mainloop.rkt:129:0 for-loop [41] 100.0% ------------------------------------------------------------------------------------------ for-loop [23] 100.0% [34] 996(0.5%) 996(0.5%) for-loop ...e-testing/src/core/simplify.rkt:217:13 ------------------------------------------------------------------------------------------ run-iter! [19] 100.0% [35] 348(0.2%) 0(0.0%) gen-rewrites! ...me-testing/src/mainloop.rkt:142:0 for-loop [43] 100.0% ------------------------------------------------------------------------------------------ extract-alt [24] 100.0% [36] 326(0.2%) 0(0.0%) argmins ...bie/regime-testing/src/common.rkt:153:0 composed [173] 100.0% ------------------------------------------------------------------------------------------ simplify! [25] 100.0% [37] 119346(64.7%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [44] 99.7% debug-print [52] 0.3% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [38] 4.4% for-loop [48] 13.8% for-loop [26] 81.8% [38] 27112(14.7%) 1370(0.7%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [47] 25.8% for-loop [49] 24.5% loop! [94] 22.1% for-loop [48] 18.1% merge-egraph-nodes! [38] 4.4% ------------------------------------------------------------------------------------------ match-e [27] 100.0% [39] 16324(8.8%) 5078(2.8%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [46] 61.1% loop [91] 9.0% list-cartesian-product [50] 1.1% ------------------------------------------------------------------------------------------ for-loop [26] 100.0% [40] 9224(5.0%) 0(0.0%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [45] 100.0% ------------------------------------------------------------------------------------------ gen-series! [33] 100.0% [41] 1030(0.6%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:135:7 taylor-alt [51] 100.0% ------------------------------------------------------------------------------------------ reduce-to-single! [32] 100.0% [42] 670(0.4%) 670(0.4%) for-loop ...gime-testing/src/core/egraph.rkt:326:8 ------------------------------------------------------------------------------------------ gen-rewrites! [35] 100.0% [43] 348(0.2%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:147:11 ??? [53] 100.0% ------------------------------------------------------------------------------------------ for-loop [37] 21.6% run [10] 35.7% [44] 183566(99.5%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 35.5% run-improve50 [2] 29.4% ??? [140] 27.3% oracle-error [55] 3.1% prepare-points [56] 2.3% loop [58] 1.8% eval-errors [100] 0.5% baseline-error [62] 0.1% ------------------------------------------------------------------------------------------ substitute-e [40] 35.5% for-loop [26] 64.5% [45] 25978(14.1%) 1060(0.6%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [54] 95.9% ------------------------------------------------------------------------------------------ match-e [27] 21.0% for-loop [39] 79.0% [46] 12706(6.9%) 1668(0.9%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [27] 85.4% ??? [61] 4.2% ------------------------------------------------------------------------------------------ for-loop [20] 10.5% merge-egraph-nodes! [38] 89.5% [47] 9296(5.0%) 1316(0.7%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [57] 75.3% custom-set-union! [60] 10.5% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [38] 100.0% [48] 8596(4.7%) 0(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [38] 86.6% loop! [94] 13.4% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [38] 100.0% [49] 6652(3.6%) 4654(2.5%) for-loop ...gime-testing/src/core/egraph.rkt:233:6 update-en-expr [104] 30.0% ------------------------------------------------------------------------------------------ for-loop [39] 13.3% match-e [27] 36.7% list-cartesian-product [50] 50.0% [50] 1354(0.7%) 1020(0.6%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [50] 50.0% for-loop [64] 12.3% ------------------------------------------------------------------------------------------ for-loop [41] 100.0% [51] 1030(0.6%) 0(0.0%) taylor-alt ...ie/regime-testing/src/glue.rkt:134:0 for-loop [59] 100.0% ------------------------------------------------------------------------------------------ for-loop [37] 45.7% iterate-egraph!13 [3] 54.3% [52] 678(0.4%) 368(0.2%) debug-print .../regime-testing/src/debug.rkt:107:0 for-loop [65] 45.7% ------------------------------------------------------------------------------------------ for-loop [43] 100.0% [53] 348(0.2%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:88:0 rewriter [63] 100.0% ------------------------------------------------------------------------------------------ mk-enode! [45] 100.0% [54] 24918(13.5%) 334(0.2%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [66] 98.7% ------------------------------------------------------------------------------------------ ??? [44] 100.0% [55] 11216(6.1%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:290:0 for-loop [67] 100.0% ------------------------------------------------------------------------------------------ ??? [44] 100.0% [56] 8576(4.6%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 loop [76] 51.0% loop [69] 25.6% make-exacts* [78] 19.4% for-loop [74] 3.9% ------------------------------------------------------------------------------------------ update-leader! [47] 100.0% [57] 7004(3.8%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [68] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [2] 6.1% ??? [44] 93.9% [58] 6608(3.6%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:238:2 loop [69] 43.8% make-exacts* [78] 31.6% loop [76] 19.9% ??? [82] 4.7% ------------------------------------------------------------------------------------------ taylor-alt [51] 100.0% [59] 1030(0.6%) 0(0.0%) for-loop ...rbie/regime-testing/src/glue.rkt:139:6 ??? [138] 100.0% ------------------------------------------------------------------------------------------ update-leader! [47] 100.0% [60] 976(0.5%) 618(0.3%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [72] 36.7% ------------------------------------------------------------------------------------------ for-loop [46] 100.0% [61] 694(0.4%) 332(0.2%) ??? ...bie/regime-testing/src/core/ematch.rkt:50:5 for-loop [71] 52.2% ------------------------------------------------------------------------------------------ ??? [44] 100.0% [62] 352(0.2%) 0(0.0%) baseline-error ...ime-testing/src/points.rkt:294:0 argmin [70] 100.0% ------------------------------------------------------------------------------------------ ??? [53] 100.0% [63] 348(0.2%) 0(0.0%) rewriter ...ime-testing/src/core/matcher.rkt:131:2 for-loop [73] 100.0% ------------------------------------------------------------------------------------------ list-cartesian-product [50] 100.0% [64] 334(0.2%) 334(0.2%) for-loop ...egime-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------------------ debug-print [52] 100.0% [65] 310(0.2%) 310(0.2%) for-loop ...bie/regime-testing/src/debug.rkt:113:2 ------------------------------------------------------------------------------------------ new-enode [54] 100.0% [66] 24584(13.3%) 658(0.4%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [75] 97.3% ------------------------------------------------------------------------------------------ oracle-error [55] 100.0% [67] 11216(6.1%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:291:2 loop [91] 72.7% map [79] 27.3% ------------------------------------------------------------------------------------------ for-loop [57] 100.0% [68] 7004(3.8%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [77] 100.0% ------------------------------------------------------------------------------------------ prepare-points [56] 43.2% loop [58] 56.8% [69] 5092(2.8%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 loop [76] 59.9% make-exacts* [78] 40.1% ------------------------------------------------------------------------------------------ baseline-error [62] 10.8% for-loop [23] 89.2% [70] 3266(1.8%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [80] 68.3% expression-cost [81] 20.9% ??? [83] 10.8% ------------------------------------------------------------------------------------------ ??? [61] 100.0% [71] 362(0.2%) 362(0.2%) for-loop ...egime-testing/src/core/ematch.rkt:51:7 ------------------------------------------------------------------------------------------ custom-set-union! [60] 100.0% [72] 358(0.2%) 358(0.2%) for-loop ...cts/racket/private/set-types.rkt:253:4 ------------------------------------------------------------------------------------------ rewriter [63] 100.0% [73] 348(0.2%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:134:10 matcher [84] 100.0% ------------------------------------------------------------------------------------------ prepare-points [56] 100.0% [74] 336(0.2%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [82] 100.0% ------------------------------------------------------------------------------------------ type-of-enode-expr [66] 100.0% [75] 23926(13.0%) 362(0.2%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ??? [141] 46.6% ??? [140] 24.9% ??? [111] 18.6% ...sting/src/common.rkt:48:2 [145] 8.4% ------------------------------------------------------------------------------------------ loop [58] 15.1% loop [69] 34.9% prepare-points [56] 50.0% [76] 8744(4.7%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [91] 96.0% ??? [135] 4.0% ------------------------------------------------------------------------------------------ for-loop [68] 100.0% [77] 7004(3.8%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [85] 100.0% ------------------------------------------------------------------------------------------ prepare-points [56] 28.8% loop [69] 35.2% loop [58] 36.0% [78] 5792(3.1%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 loop [91] 87.6% eval-prog [186] 12.4% ------------------------------------------------------------------------------------------ for-loop [117] 8.0% f45 [28] 17.0% for-loop [67] 75.0% [79] 4082(2.2%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [91] 66.9% parse-loop79 [86] 12.6% ??? [96] 8.1% loop [90] 8.0% f45 [28] 4.4% ------------------------------------------------------------------------------------------ loop [30] 38.0% argmin [70] 62.0% [80] 3600(2.0%) 0(0.0%) for-loop .../regime-testing/src/programs.rkt:210:2 ??? [140] 63.0% ...sting/src/common.rkt:48:2 [145] 28.4% ??? [141] 8.6% ------------------------------------------------------------------------------------------ argmin [70] 100.0% [81] 682(0.4%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [87] 100.0% ------------------------------------------------------------------------------------------ loop [58] 48.1% for-loop [74] 51.9% [82] 648(0.4%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 ??? [138] 100.0% ------------------------------------------------------------------------------------------ argmin [70] 100.0% [83] 352(0.2%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:295:27 eval-errors [100] 100.0% ------------------------------------------------------------------------------------------ for-loop [88] 50.0% for-loop [73] 50.0% [84] 348(0.2%) 0(0.0%) matcher ...gime-testing/src/core/matcher.rkt:167:2 for-loop [88] 50.0% for-loop [89] 50.0% ------------------------------------------------------------------------------------------ hash-update! [77] 100.0% [85] 7004(3.8%) 364(0.2%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [92] 94.8% ------------------------------------------------------------------------------------------ map [79] 100.0% [86] 694(0.4%) 334(0.2%) parse-loop79 ...s/racket/match/compiler.rkt:418:15 f45 [28] 51.9% loop [91] 24.1% ------------------------------------------------------------------------------------------ expression-cost [81] 100.0% [87] 682(0.4%) 0(0.0%) compile ...e/regime-testing/src/programs.rkt:186:0 hash-ref! [147] 100.0% ------------------------------------------------------------------------------------------ matcher [84] 100.0% [88] 348(0.2%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:183:21 matcher [84] 100.0% ------------------------------------------------------------------------------------------ matcher [84] 100.0% [89] 348(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/matcher.rkt:159:6 pattern-match [93] 100.0% ------------------------------------------------------------------------------------------ loop [90] 50.0% map [79] 50.0% [90] 326(0.2%) 326(0.2%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [90] 50.0% ------------------------------------------------------------------------------------------ make-exacts* [78] 0.0% loop [76] 0.4% parse-loop79 [86] 0.6% map-enodes [15] 0.7% match-e [27] 1.1% loop! [94] 1.6% for-loop [39] 1.7% map [79] 2.3% option-on-expr [95] 4.0% for-loop [67] 4.4% f45 [28] 14.3% loop [91] 68.8% [91] 59992(32.5%) 4346(2.4%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [91] 68.8% option-on-expr [95] 14.3% eval-errors [100] 3.4% ??? [96] 3.1% ??? [135] 2.8% loop! [94] 1.4% ??? [138] 0.8% foldl [98] 0.8% for-loop [97] 0.7% alt-errors [180] 0.6% f45 [28] 0.6% ulp-difference [123] 0.4% ------------------------------------------------------------------------------------------ ??? [85] 100.0% [92] 6640(3.6%) 6280(3.4%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 update-en-expr [104] 5.4% ------------------------------------------------------------------------------------------ for-loop [99] 50.0% for-loop [89] 50.0% [93] 348(0.2%) 0(0.0%) pattern-match ...testing/src/core/matcher.rkt:48:0 for-loop [99] 50.0% variable? [5] 50.0% ------------------------------------------------------------------------------------------ for-loop [48] 4.8% loop [91] 23.3% merge-egraph-nodes! [38] 26.8% for-loop [26] 45.1% [94] 27770(15.0%) 3986(2.2%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 custom-set-union [101] 43.4% loop [91] 32.6% set [102] 13.1% update-en-expr [104] 2.5% ------------------------------------------------------------------------------------------ f45 [28] 11.7% loop [91] 88.3% [95] 16982(9.2%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [91] 39.4% sort-context-on-expr [103] 37.6% eval-errors [100] 11.6% err-lsts->split-indices [106] 5.7% point->alt [107] 2.0% sindices->spoints [110] 1.8% ------------------------------------------------------------------------------------------ map [79] 7.1% loop [91] 92.9% [96] 4678(2.5%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:292:26 ??? [135] 77.5% ??? [138] 22.5% ------------------------------------------------------------------------------------------ map-enodes [15] 16.5% loop [91] 83.5% [97] 1934(1.0%) 326(0.2%) for-loop ...me-testing/src/core/simplify.rkt:195:2 setfindf [105] 65.9% eval-const-expr [108] 17.3% ------------------------------------------------------------------------------------------ loop [91] 100.0% [98] 654(0.4%) 336(0.2%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [109] 48.6% ------------------------------------------------------------------------------------------ pattern-match [93] 100.0% [99] 348(0.2%) 0(0.0%) for-loop ...gime-testing/src/core/matcher.rkt:66:9 pattern-match [93] 100.0% ------------------------------------------------------------------------------------------ ??? [83] 2.2% override-at-pnts [133] 4.2% composed [173] 6.6% ??? [44] 8.7% option-on-expr [95] 12.6% best-and-tied-at-points [131] 31.5% loop [91] 34.2% [100] 15682(8.5%) 0(0.0%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [112] 100.0% ------------------------------------------------------------------------------------------ loop! [94] 100.0% [101] 12386(6.7%) 1666(0.9%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [113] 67.4% for-loop [115] 19.2% ------------------------------------------------------------------------------------------ loop! [94] 100.0% [102] 7252(3.9%) 7252(3.9%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------------------ option-on-expr [95] 100.0% [103] 6384(3.5%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [114] 94.3% eval-prog [186] 5.7% ------------------------------------------------------------------------------------------ for-loop [92] 9.6% loop! [94] 37.4% for-loop [49] 53.1% [104] 3766(2.0%) 3766(2.0%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------------------------ for-loop [97] 100.0% [105] 1274(0.7%) 634(0.3%) setfindf ...ie/regime-testing/src/common.rkt:187:0 for-loop [118] 25.1% ??? [111] 25.1% ------------------------------------------------------------------------------------------ option-on-expr [95] 100.0% [106] 972(0.5%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [116] 66.5% for-loop [117] 33.5% ------------------------------------------------------------------------------------------ option-on-expr [95] 100.0% [107] 336(0.2%) 0(0.0%) point->alt ...e-testing/src/core/regimes.rkt:188:0 eval-prog [186] 100.0% ------------------------------------------------------------------------------------------ for-loop [97] 100.0% [108] 334(0.2%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f45 [28] 100.0% ------------------------------------------------------------------------------------------ foldl [98] 100.0% [109] 318(0.2%) 318(0.2%) merge2 .../regime-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------------------ option-on-expr [95] 100.0% [110] 312(0.2%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 eval-prog [186] 100.0% ------------------------------------------------------------------------------------------ setfindf [105] 1.7% choose-best-alt! [31] 5.5% variable? [5] 16.0% match-e [27] 21.3% get-sigs [75] 23.8% finalize-iter! [29] 31.7% [111] 18718(10.1%) 5220(2.8%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [119] 33.1% for-loop [120] 28.4% ??? [124] 5.5% atab-add-altns [126] 3.3% ??? [184] 1.7% ------------------------------------------------------------------------------------------ eval-errors [100] 100.0% [112] 15682(8.5%) 970(0.5%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [135] 72.7% ??? [138] 18.8% ulp-difference [123] 2.3% ------------------------------------------------------------------------------------------ custom-set-union [101] 100.0% [113] 8348(4.5%) 3652(2.0%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [122] 56.3% ------------------------------------------------------------------------------------------ sort-context-on-expr [103] 100.0% [114] 6022(3.3%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [121] 82.5% loop [132] 17.5% ------------------------------------------------------------------------------------------ custom-set-union [101] 100.0% [115] 2372(1.3%) 2372(1.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------------------ err-lsts->split-indices [106] 100.0% [116] 646(0.4%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [125] 100.0% ------------------------------------------------------------------------------------------ err-lsts->split-indices [106] 100.0% [117] 326(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:279:4 map [79] 100.0% ------------------------------------------------------------------------------------------ setfindf [105] 100.0% [118] 320(0.2%) 320(0.2%) for-loop ...ie/regime-testing/src/common.rkt:188:2 ------------------------------------------------------------------------------------------ ??? [111] 100.0% [119] 6204(3.4%) 1678(0.9%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [152] 67.2% ??? [130] 5.8% ------------------------------------------------------------------------------------------ ??? [111] 100.0% [120] 5312(2.9%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [127] 100.0% ------------------------------------------------------------------------------------------ ??? [114] 100.0% [121] 4968(2.7%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [128] 93.5% loop [132] 6.5% ------------------------------------------------------------------------------------------ for-loop [113] 100.0% [122] 4696(2.5%) 4696(2.5%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------------------ for-loop [112] 28.3% loop [91] 71.7% [123] 1302(0.7%) 670(0.4%) ulp-difference ...egime-testing/src/float.rkt:19:0 return/no-unsupplied [170] 48.5% ------------------------------------------------------------------------------------------ ??? [111] 100.0% [124] 1034(0.6%) 0(0.0%) ??? .../regime-testing/src/core/alt-table.rkt:54:0 ??? [138] 100.0% ------------------------------------------------------------------------------------------ add-splitpoint [116] 100.0% [125] 646(0.4%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:255:4 for-loop [129] 100.0% ------------------------------------------------------------------------------------------ ??? [111] 100.0% [126] 624(0.3%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:50:0 atab-add-altn [127] 100.0% ------------------------------------------------------------------------------------------ atab-add-altns [126] 10.5% for-loop [120] 89.5% [127] 5936(3.2%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [131] 88.9% override-at-pnts [133] 11.1% ------------------------------------------------------------------------------------------ generic-sort/key [121] 43.7% copying-mergesort [128] 56.3% [128] 4644(2.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [128] 56.3% loop [132] 29.3% jloop [6] 14.4% ------------------------------------------------------------------------------------------ for-loop [125] 100.0% [129] 646(0.4%) 312(0.2%) for-loop ...ime-testing/src/core/regimes.rkt:259:8 curried [134] 51.7% ------------------------------------------------------------------------------------------ hash-has-key? [119] 100.0% [130] 358(0.2%) 358(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------------------ atab-add-altn [127] 100.0% [131] 5278(2.9%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [100] 93.6% for-loop [136] 6.4% ------------------------------------------------------------------------------------------ generic-sort/key [121] 9.7% ??? [114] 31.5% copying-mergesort [128] 58.8% [132] 3342(1.8%) 336(0.2%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [135] 50.8% ??? [138] 39.1% ------------------------------------------------------------------------------------------ atab-add-altn [127] 100.0% [133] 658(0.4%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:145:0 eval-errors [100] 100.0% ------------------------------------------------------------------------------------------ for-loop [129] 100.0% [134] 334(0.2%) 334(0.2%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------------------ loop [76] 1.0% loop [132] 4.7% jloop [6] 6.5% ??? [96] 10.0% for-loop [112] 31.5% loop [91] 45.4% [135] 36222(19.6%) 982(0.5%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [137] 73.4% ??? [139] 17.4% ??? [138] 6.6% ------------------------------------------------------------------------------------------ best-and-tied-at-points [131] 100.0% [136] 336(0.2%) 336(0.2%) for-loop ...-testing/src/core/alt-table.rkt:124:16 ------------------------------------------------------------------------------------------ ??? [135] 100.0% [137] 26578(14.4%) 13442(7.3%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [142] 21.2% ??? [144] 14.6% ??? [146] 11.2% ...higher-order.rkt:346:33 [149] 2.5% ------------------------------------------------------------------------------------------ loop [16] 2.6% ??? [140] 2.6% for-loop [59] 2.6% ??? [82] 4.9% ??? [124] 6.4% f45 [28] 7.2% ??? [96] 7.9% loop [132] 9.8% ??? [135] 16.5% loop [91] 17.4% for-loop [112] 22.2% [138] 13288(7.2%) 3926(2.1%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [140] 54.0% best-alt [148] 6.4% approximate9 [7] 2.6% hash-ref! [147] 2.6% ??? [141] 2.5% ...sting/src/common.rkt:48:2 [145] 2.3% ------------------------------------------------------------------------------------------ ??? [135] 100.0% [139] 6286(3.4%) 734(0.4%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [143] 88.3% ------------------------------------------------------------------------------------------ for-loop [80] 0.5% ??? [140] 1.2% get-sigs [75] 1.4% ??? [138] 5.7% for-loop [150] 45.1% ??? [44] 45.7% [140] 138526(75.1%) 5612(3.0%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [150] 45.1% iterate-egraph!13 [3] 44.5% loop [4] 1.6% ??? [152] 1.6% ??? [155] 1.2% ??? [140] 1.2% return/no-unsupplied [170] 1.1% ??? [138] 0.6% loop [165] 0.2% list-member? [151] 0.2% ------------------------------------------------------------------------------------------ for-loop [80] 2.6% ??? [138] 2.9% get-sigs [75] 94.5% [141] 11786(6.4%) 980(0.5%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 for-loop [153] 42.7% ??? [154] 34.3% get/build-late-neg-projection [189] 11.8% ??? [164] 2.9% ------------------------------------------------------------------------------------------ ??? [137] 100.0% [142] 5646(3.1%) 4650(2.5%) ??? ...regime-testing/src/syntax/syntax.rkt:156:17 ??? [155] 17.6% ------------------------------------------------------------------------------------------ ??? [139] 100.0% [143] 5552(3.0%) 5552(3.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ------------------------------------------------------------------------------------------ ??? [137] 100.0% [144] 3874(2.1%) 1000(0.5%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfacos [156] 46.3% bfdiv [158] 27.9% ------------------------------------------------------------------------------------------ ??? [138] 8.5% f45 [28] 9.1% for-loop [80] 27.8% get-sigs [75] 54.6% [145] 3678(2.0%) 1362(0.7%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [157] 35.4% ??? [162] 27.6% ------------------------------------------------------------------------------------------ ??? [137] 100.0% [146] 2964(1.6%) 2964(1.6%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------ for-loop [18] 4.9% for-loop [17] 11.4% ??? [163] 13.9% ??? [161] 21.9% ??? [138] 21.9% compile [87] 25.9% [147] 1712(0.9%) 682(0.4%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [161] 21.9% simplify [160] 17.0% ??? [8] 16.3% ??? [163] 13.9% ??? [9] 4.9% ------------------------------------------------------------------------------------------ ??? [138] 100.0% [148] 1034(0.6%) 0(0.0%) best-alt ...erbie/regime-testing/src/glue.rkt:71:0 loop [159] 100.0% ------------------------------------------------------------------------------------------ ??? [137] 100.0% [149] 652(0.4%) 652(0.4%) ...higher-order.rkt:346:33 (unknown source) ------------------------------------------------------------------------------------------ ??? [140] 100.0% [150] 127490(69.1%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ??? [140] 100.0% ------------------------------------------------------------------------------------------ ??? [140] 1.7% for-loop [26] 98.3% [151] 18726(10.1%) 312(0.2%) list-member? ...llects/racket/private/set.rkt:24:0 loop [166] 98.3% ------------------------------------------------------------------------------------------ hash-has-key? [119] 41.3% ??? [140] 58.7% [152] 10096(5.5%) 2338(1.3%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [167] 59.9% ??? [179] 17.0% ------------------------------------------------------------------------------------------ ??? [141] 100.0% [153] 5028(2.7%) 636(0.3%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [168] 87.4% ------------------------------------------------------------------------------------------ ??? [141] 100.0% [154] 4048(2.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [169] 100.0% ------------------------------------------------------------------------------------------ ??? [142] 38.1% ??? [140] 61.9% [155] 2612(1.4%) 998(0.5%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [172] 61.8% ------------------------------------------------------------------------------------------ ??? [144] 100.0% [156] 1794(1.0%) 1110(0.6%) bfacos ...lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [171] 38.1% ------------------------------------------------------------------------------------------ ...sting/src/common.rkt:48:2 [145] 100.0% [157] 1302(0.7%) 0(0.0%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 return/no-unsupplied [170] 74.0% assoc-ref [174] 26.0% ------------------------------------------------------------------------------------------ ??? [144] 100.0% [158] 1080(0.6%) 0(0.0%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [171] 100.0% ------------------------------------------------------------------------------------------ best-alt [148] 100.0% [159] 1034(0.6%) 0(0.0%) loop ...herbie/regime-testing/src/common.rkt:154:2 composed [173] 100.0% ------------------------------------------------------------------------------------------ for-loop [17] 32.6% hash-ref! [147] 67.4% [160] 1030(0.6%) 0(0.0%) simplify ...egime-testing/src/core/reduce.rkt:16:0 f45 [28] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [147] 100.0% [161] 1030(0.6%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:44:15 hash-ref! [147] 100.0% ------------------------------------------------------------------------------------------ ??? [168] 33.6% ...sting/src/common.rkt:48:2 [145] 66.4% [162] 1014(0.5%) 332(0.2%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [168] 33.6% ??? [184] 33.6% ------------------------------------------------------------------------------------------ hash-ref! [147] 100.0% [163] 358(0.2%) 0(0.0%) ??? ...erbie/regime-testing/src/programs.rkt:194:5 hash-ref! [147] 100.0% ------------------------------------------------------------------------------------------ ??? [141] 100.0% [164] 336(0.2%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:69:2 get-blame-party-info [175] 100.0% ------------------------------------------------------------------------------------------ ??? [140] 100.0% [165] 312(0.2%) 0(0.0%) loop .../herbie/regime-testing/src/points.rkt:66:6 random-exp [176] 100.0% ------------------------------------------------------------------------------------------ list-member? [151] 100.0% [166] 18414(10.0%) 18414(10.0%) loop (unknown source) ------------------------------------------------------------------------------------------ ??? [152] 100.0% [167] 6046(3.3%) 3272(1.8%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [179] 34.6% successfully-got-the-right-kind-of-function [182] 5.7% ??? [183] 5.5% ------------------------------------------------------------------------------------------ ??? [162] 13.4% for-loop [153] 86.6% [168] 5074(2.7%) 340(0.2%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [177] 79.9% ??? [162] 13.4% ------------------------------------------------------------------------------------------ ??? [154] 100.0% [169] 4048(2.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [178] 100.0% ------------------------------------------------------------------------------------------ ulp-difference [123] 20.6% ??? [157] 31.4% ??? [140] 48.1% [170] 3074(1.7%) 2030(1.1%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [181] 34.0% ------------------------------------------------------------------------------------------ bfacos [156] 38.8% bfdiv [158] 61.2% [171] 1764(1.0%) 1764(1.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------------------ ??? [155] 100.0% [172] 1614(0.9%) 1614(0.9%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ------------------------------------------------------------------------------------------ argmins [36] 24.0% loop [159] 76.0% [173] 1360(0.7%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 eval-errors [100] 76.0% alt-errors [180] 24.0% ------------------------------------------------------------------------------------------ ??? [157] 100.0% [174] 338(0.2%) 338(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------------------ ??? [164] 100.0% [175] 336(0.2%) 336(0.2%) get-blame-party-info ...ate/arrow-common.rkt:136:0 ------------------------------------------------------------------------------------------ loop [165] 100.0% [176] 312(0.2%) 312(0.2%) random-exp .../regime-testing/src/common.rkt:254:0 ------------------------------------------------------------------------------------------ ??? [168] 100.0% [177] 4052(2.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [184] 100.0% ------------------------------------------------------------------------------------------ ??? [169] 100.0% [178] 4048(2.2%) 360(0.2%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [185] 91.1% ------------------------------------------------------------------------------------------ ??? [152] 45.0% for-loop [167] 55.0% [179] 3806(2.1%) 2416(1.3%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [187] 36.5% ------------------------------------------------------------------------------------------ composed [173] 24.4% loop [91] 75.6% [180] 1334(0.7%) 0(0.0%) alt-errors ...ime-testing/src/alternative.rkt:59:0 eval-prog [186] 100.0% ------------------------------------------------------------------------------------------ return/no-unsupplied [170] 100.0% [181] 1044(0.6%) 1044(0.6%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------------------ for-loop [167] 100.0% [182] 346(0.2%) 346(0.2%) successfully-got-the-right-kind-of-function ...9:4 ------------------------------------------------------------------------------------------ for-loop [167] 100.0% [183] 334(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [188] 100.0% ------------------------------------------------------------------------------------------ ??? [111] 6.4% ??? [162] 13.5% ??? [177] 80.1% [184] 5058(2.7%) 4376(2.4%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [191] 13.5% ------------------------------------------------------------------------------------------ ??? [178] 100.0% [185] 3688(2.0%) 682(0.4%) for-loop ...racket/contract/private/list.rkt:680:9 get/build-late-neg-projection [189] 46.4% add-list-context [190] 35.1% ------------------------------------------------------------------------------------------ sindices->spoints [110] 10.2% point->alt [107] 11.0% sort-context-on-expr [103] 11.8% make-exacts* [78] 23.4% alt-errors [180] 43.6% [186] 3060(1.7%) 1738(0.9%) eval-prog ...regime-testing/src/programs.rkt:150:0 f45 [28] 43.2% ------------------------------------------------------------------------------------------ ??? [179] 100.0% [187] 1390(0.8%) 1390(0.8%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------------------ ??? [183] 100.0% [188] 334(0.2%) 0(0.0%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [192] 100.0% ------------------------------------------------------------------------------------------ ??? [194] 11.7% ??? [141] 33.2% for-loop [185] 55.1% [189] 3104(1.7%) 1348(0.7%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [193] 50.8% ??? [194] 11.7% ------------------------------------------------------------------------------------------ for-loop [185] 100.0% [190] 1296(0.7%) 1296(0.7%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------------------ ??? [184] 100.0% [191] 682(0.4%) 682(0.4%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------------------ check-hash/c [188] 100.0% [192] 334(0.2%) 334(0.2%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------------------ get/build-late-neg-projection [189] 100.0% [193] 1756(1.0%) 706(0.4%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [195] 59.8% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [189] 100.0% [194] 724(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [189] 100.0% ------------------------------------------------------------------------------------------ contract-struct-name [196] 17.1% ??? [193] 82.9% [195] 1050(0.6%) 330(0.2%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [196] 68.6% ------------------------------------------------------------------------------------------ build-compound-type-name [195] 100.0% [196] 720(0.4%) 720(0.4%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [195] 25.0% ------------------------------------------------------------------------------------------