Profiling results ----------------- Total cpu time observed: 1959194ms (out of 1964812ms) Number of samples taken: 5750 (once every 341ms) (Hiding functions with self<1.0% and local<2.0%: 25 of 293 hidden) =========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================================== ??? [80] 100.0% [1] 1487044(75.9%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [21] 100.0% ------------------------------------------------------------------------------------------- ??? [80] 100.0% [2] 1463614(74.7%) 0(0.0%) run-improve50 ...ie/develop/src/mainloop.rkt:234:0 for-loop [22] 97.7% get-final-combination [30] 2.1% loop [95] 0.1% setup-alt-simplified [36] 0.1% ------------------------------------------------------------------------------------------- ??? [184] 100.0% [3] 992580(50.7%) 334(0.0%) iterate-egraph!13 ...p/src/core/simplify.rkt:102:0 one-iter [23] 97.6% map-enodes [32] 2.4% ------------------------------------------------------------------------------------------- ??? [184] 100.0% [4] 429742(21.9%) 364(0.0%) loop ...herbie/develop/src/core/simplify.rkt:215:2 pass [24] 99.9% ------------------------------------------------------------------------------------------- ??? [147] 100.0% [5] 93556(4.8%) 0(0.0%) approximate9 ...e/develop/src/core/taylor.rkt:12:0 loop [25] 92.0% f176 [183] 8.0% ------------------------------------------------------------------------------------------- rewriter [90] 100.0% [6] 92984(4.7%) 6126(0.3%) *rules* ...rbie/develop/src/syntax/rules.rkt:512:0 for-loop [26] 86.4% flag-set? [61] 2.9% ormap [46] 2.6% list-member? [158] 0.4% dict? [263] 0.4% curried [207] 0.4% ------------------------------------------------------------------------------------------- hash-ref! [163] 100.0% [7] 73798(3.8%) 382(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:295:23 for-loop [27] 99.5% ------------------------------------------------------------------------------------------- hash-ref! [163] 100.0% [8] 70894(3.6%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:285:26 for-loop [28] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [163] 100.0% [9] 54940(2.8%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:392:23 for-loop [29] 98.1% simplify [168] 1.9% ------------------------------------------------------------------------------------------- hash-ref! [163] 100.0% [10] 27098(1.4%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:483:23 for-loop [31] 100.0% ------------------------------------------------------------------------------------------- matcher [112] 100.0% [11] 8124(0.4%) 1008(0.1%) for-loop ...bie/develop/src/core/matcher.rkt:159:6 pattern-substitute [33] 54.5% pattern-match [50] 25.6% foldl [210] 7.6% ------------------------------------------------------------------------------------------- copying-mergesort [258] 100.0% [12] 4546(0.2%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [144] 92.0% ??? [147] 8.0% ------------------------------------------------------------------------------------------- f176 [183] 100.0% [13] 2136(0.1%) 0(0.0%) taylor-log ...ie/develop/src/core/taylor.rkt:476:0 simplify [168] 100.0% ------------------------------------------------------------------------------------------- f176 [183] 100.0% [14] 2118(0.1%) 358(0.0%) combine-mterms ...evelop/src/core/reduce.rkt:191:0 for-loop [34] 83.1% ------------------------------------------------------------------------------------------- f176 [183] 100.0% [15] 2018(0.1%) 0(0.0%) taylor-exp ...ie/develop/src/core/taylor.rkt:386:0 simplify [168] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [163] 100.0% [16] 1718(0.1%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:322:33 for-loop [35] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [163] 100.0% [17] 1614(0.1%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:338:33 for-loop [38] 61.3% hash-ref! [163] 38.7% ------------------------------------------------------------------------------------------- map [185] 100.0% [18] 1380(0.1%) 0(0.0%) ??? ...ies/herbie/develop/src/core/reduce.rkt:61:5 for-loop [37] 73.5% pattern-match [50] 26.5% ------------------------------------------------------------------------------------------- f176 [183] 100.0% [19] 360(0.0%) 0(0.0%) exprs-to-branch-on ...op/src/core/regimes.rkt:55:0 all-critical-subexpressions [39] 100.0% ------------------------------------------------------------------------------------------- f176 [183] 100.0% [20] 358(0.0%) 0(0.0%) taylor-invert ...develop/src/core/taylor.rkt:312:0 first-nonzero-exp [40] 100.0% ------------------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [21] 1487044(75.9%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [80] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [22] 1429408(73.0%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:249:10 run-iter! [41] 100.0% ------------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [23] 968436(49.4%) 10538(0.5%) one-iter ...ie/develop/src/core/simplify.rkt:113:0 loop [42] 81.6% for-loop [44] 16.4% apply-match [55] 0.7% filter [268] 0.0% ------------------------------------------------------------------------------------------- loop [4] 100.0% [24] 429378(21.9%) 628(0.0%) pass ...herbie/develop/src/core/simplify.rkt:205:2 for-loop [43] 99.8% ------------------------------------------------------------------------------------------- approximate9 [5] 100.0% [25] 86030(4.4%) 0(0.0%) loop ...es/herbie/develop/src/core/taylor.rkt:86:4 ??? [147] 100.0% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [83] 3.3% *rules* [6] 96.7% [26] 83070(4.2%) 26660(1.4%) for-loop ...ies/herbie/develop/src/common.rkt:99:9 ormap [46] 52.0% flag-set? [61] 14.7% update-en-expr [219] 0.8% curried [207] 0.4% ------------------------------------------------------------------------------------------- ??? [7] 100.0% [27] 73416(3.7%) 368(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:298:27 hash-ref! [163] 99.5% ------------------------------------------------------------------------------------------- ??? [8] 100.0% [28] 70894(3.6%) 596(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:285:52 ??? [60] 50.9% hash-ref! [163] 46.7% simplify [168] 1.9% ------------------------------------------------------------------------------------------- ??? [9] 100.0% [29] 53892(2.8%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:396:33 for-loop [45] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [30] 31436(1.6%) 0(0.0%) get-final-combination ...op/src/mainloop.rkt:264:0 split-table [48] 97.0% extract-alt [52] 3.0% ------------------------------------------------------------------------------------------- ??? [10] 100.0% [31] 27098(1.4%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:487:35 parse-loop12 [150] 100.0% ------------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [32] 23484(1.2%) 0(0.0%) map-enodes ...ie/develop/src/core/egraph.rkt:139:0 loop [191] 95.4% for-loop [49] 4.6% ------------------------------------------------------------------------------------------- for-loop [11] 46.0% pattern-substitute [33] 54.0% [33] 4424(0.2%) 2070(0.1%) pattern-substitute ...op/src/core/matcher.rkt:73:0 pattern-substitute [33] 54.0% variable? [47] 12.7% ??? [121] 8.8% ------------------------------------------------------------------------------------------- combine-mterms [14] 100.0% [34] 1760(0.1%) 686(0.0%) for-loop ...rbie/develop/src/core/reduce.rkt:195:5 hash-ref! [163] 61.0% ------------------------------------------------------------------------------------------- ??? [16] 100.0% [35] 1718(0.1%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:324:46 hash-ref! [163] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [36] 1366(0.1%) 0(0.0%) setup-alt-simplified .../develop/src/glue.rkt:49:0 simplify-alt [51] 100.0% ------------------------------------------------------------------------------------------- ??? [18] 100.0% [37] 1014(0.1%) 658(0.0%) for-loop ...erbie/develop/src/core/reduce.rkt:62:7 pattern-match [50] 35.1% ------------------------------------------------------------------------------------------- ??? [17] 100.0% [38] 990(0.1%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:341:46 hash-ref! [163] 100.0% ------------------------------------------------------------------------------------------- exprs-to-branch-on [19] 100.0% [39] 360(0.0%) 0(0.0%) all-critical-subexpressions ...re/regimes.rkt:71:0 for-loop [53] 100.0% ------------------------------------------------------------------------------------------- taylor-invert [20] 100.0% [40] 358(0.0%) 0(0.0%) first-nonzero-exp ...lop/src/core/taylor.rkt:260:0 hash-ref! [163] 100.0% ------------------------------------------------------------------------------------------- for-loop [22] 100.0% [41] 1429408(73.0%) 0(0.0%) run-iter! ...herbie/develop/src/mainloop.rkt:215:0 simplify! [54] 69.7% gen-rewrites! [57] 20.0% gen-series! [58] 6.7% finalize-iter! [62] 3.4% localize-error [66] 0.1% ------------------------------------------------------------------------------------------- f176 [183] 0.4% one-iter [23] 99.6% [42] 793722(40.5%) 1000(0.1%) loop ...cket/collects/racket/private/map.rkt:52:19 apply-match [55] 99.5% f176 [183] 0.4% ------------------------------------------------------------------------------------------- pass [24] 100.0% [43] 428388(21.9%) 2104(0.1%) for-loop ...e/develop/src/core/simplify.rkt:208:29 argmin [56] 77.9% loop [59] 15.3% for-loop [63] 5.5% make-sequence [225] 0.6% filter [268] 0.1% ------------------------------------------------------------------------------------------- for-loop [44] 49.2% one-iter [23] 50.8% [44] 158684(8.1%) 31164(1.6%) for-loop ...e/develop/src/core/simplify.rkt:123:12 for-loop [44] 49.2% match-e [74] 39.9% ??? [106] 0.3% ------------------------------------------------------------------------------------------- for-loop [29] 100.0% [45] 53892(2.8%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:398:39 hash-ref! [163] 99.4% ??? [60] 0.6% ------------------------------------------------------------------------------------------- *rules* [6] 5.4% for-loop [26] 94.6% [46] 45602(2.3%) 7418(0.4%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [61] 76.2% curried [207] 5.9% list-member? [158] 1.6% ------------------------------------------------------------------------------------------- expression->type [181] 2.4% pattern-match [50] 3.4% pattern-substitute [33] 4.4% matcher [112] 4.5% substitute-e [82] 11.8% match-e [74] 72.3% [47] 30578(1.6%) 696(0.0%) variable? ...e/develop/src/syntax/syntax.rkt:660:0 ??? [121] 97.7% ------------------------------------------------------------------------------------------- get-final-combination [30] 100.0% [48] 30480(1.6%) 0(0.0%) split-table ...s/herbie/develop/src/glue.rkt:162:0 f176 [183] 100.0% ------------------------------------------------------------------------------------------- map-enodes [32] 4.7% loop [191] 95.3% [49] 22788(1.2%) 3842(0.2%) for-loop ...ie/develop/src/core/simplify.rkt:173:2 setfindf [64] 36.8% eval-const-expr [65] 29.8% compose [209] 10.6% ??? [147] 3.0% curry* [99] 1.5% curried [207] 1.3% ------------------------------------------------------------------------------------------- for-loop [37] 6.4% ??? [18] 13.1% for-loop [67] 31.1% for-loop [11] 49.5% [50] 2798(0.1%) 1414(0.1%) pattern-match ...develop/src/core/matcher.rkt:48:0 for-loop [67] 31.1% variable? [47] 18.8% ??? [121] 6.0% ------------------------------------------------------------------------------------------- setup-alt-simplified [36] 100.0% [51] 1366(0.1%) 0(0.0%) simplify-alt ...s/herbie/develop/src/glue.rkt:76:0 ??? [184] 100.0% ------------------------------------------------------------------------------------------- get-final-combination [30] 100.0% [52] 956(0.0%) 0(0.0%) extract-alt ...es/herbie/develop/src/glue.rkt:55:0 loop [161] 65.3% argmins [68] 34.7% ------------------------------------------------------------------------------------------- all-critical-subexpressions [39] 100.0% [53] 360(0.0%) 0(0.0%) for-loop ...rbie/develop/src/core/regimes.rkt:75:2 ??? [69] 100.0% ------------------------------------------------------------------------------------------- run-iter! [41] 100.0% [54] 996000(50.8%) 0(0.0%) simplify! ...herbie/develop/src/mainloop.rkt:155:0 for-loop [70] 100.0% ------------------------------------------------------------------------------------------- one-iter [23] 0.9% loop [42] 99.1% [55] 796530(40.7%) 1940(0.1%) apply-match ...develop/src/core/simplify.rkt:130:2 for-loop [71] 89.0% match-e [74] 9.7% reduce-to-single! [77] 0.6% update-leader! [92] 0.5% ------------------------------------------------------------------------------------------- for-loop [43] 100.0% [56] 333892(17.0%) 998(0.1%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [72] 86.7% expression-cost [76] 13.0% ------------------------------------------------------------------------------------------- run-iter! [41] 100.0% [57] 286474(14.6%) 0(0.0%) gen-rewrites! ...ie/develop/src/mainloop.rkt:142:0 for-loop [73] 100.0% ------------------------------------------------------------------------------------------- run-iter! [41] 100.0% [58] 95204(4.9%) 0(0.0%) gen-series! ...rbie/develop/src/mainloop.rkt:129:0 for-loop [75] 100.0% ------------------------------------------------------------------------------------------- for-loop [43] 100.0% [59] 65624(3.3%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [72] 85.7% expression-cost [76] 14.3% ------------------------------------------------------------------------------------------- for-loop [45] 0.3% for-loop [28] 99.7% [60] 58632(3.0%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:288:19 hash-ref! [163] 100.0% ------------------------------------------------------------------------------------------- *rules* [6] 5.5% for-loop [26] 24.5% ormap [46] 70.0% [61] 49684(2.5%) 17308(0.9%) flag-set? ...es/herbie/develop/src/config.rkt:34:0 return/no-unsupplied [267] 36.9% ??? [192] 28.2% ------------------------------------------------------------------------------------------- run-iter! [41] 100.0% [62] 48242(2.5%) 0(0.0%) finalize-iter! ...e/develop/src/mainloop.rkt:169:0 ??? [121] 100.0% ------------------------------------------------------------------------------------------- for-loop [43] 100.0% [63] 23696(1.2%) 23696(1.2%) for-loop ...e/develop/src/core/simplify.rkt:195:13 ------------------------------------------------------------------------------------------- for-loop [49] 100.0% [64] 8388(0.4%) 3386(0.2%) setfindf ...es/herbie/develop/src/common.rkt:184:0 for-loop [78] 51.8% custom-in-set [253] 7.8% ------------------------------------------------------------------------------------------- for-loop [49] 100.0% [65] 6796(0.3%) 2754(0.1%) eval-const-expr .../develop/src/programs.rkt:166:0 f176 [183] 45.3% ??? [79] 9.7% ??? [205] 4.4% ------------------------------------------------------------------------------------------- run-iter! [41] 100.0% [66] 2102(0.1%) 0(0.0%) localize-error ...velop/src/core/localize.rkt:47:0 hash-ref! [163] 82.9% ??? [238] 17.1% ------------------------------------------------------------------------------------------- pattern-match [50] 100.0% [67] 1740(0.1%) 0(0.0%) for-loop ...rbie/develop/src/core/matcher.rkt:66:9 pattern-match [50] 100.0% ------------------------------------------------------------------------------------------- best-alt [156] 49.8% extract-alt [52] 50.2% [68] 662(0.0%) 0(0.0%) argmins ...ies/herbie/develop/src/common.rkt:150:0 composed [187] 100.0% ------------------------------------------------------------------------------------------- for-loop [53] 100.0% [69] 360(0.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:346:33 f176 [183] 100.0% ------------------------------------------------------------------------------------------- simplify! [54] 100.0% [70] 996000(50.8%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:159:6 ??? [80] 99.9% debug-print [198] 0.1% ------------------------------------------------------------------------------------------- apply-match [55] 100.0% [71] 708546(36.2%) 2670(0.1%) for-loop ...e/develop/src/core/simplify.rkt:145:10 substitute-e [82] 30.0% mk-enode! [89] 29.5% merge-egraph-nodes! [83] 27.4% loop! [202] 9.8% list-member? [158] 2.9% ------------------------------------------------------------------------------------------- loop [59] 16.3% argmin [56] 83.7% [72] 345902(17.7%) 7026(0.4%) for-loop .../herbie/develop/src/programs.rkt:199:2 ??? [184] 72.7% ...velop/src/common.rkt:47:2 [123] 23.0% ??? [122] 2.3% ------------------------------------------------------------------------------------------- gen-rewrites! [57] 100.0% [73] 286474(14.6%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:147:11 ??? [81] 100.0% ------------------------------------------------------------------------------------------- apply-match [55] 21.8% for-loop [91] 31.7% for-loop [44] 46.6% [74] 204028(10.4%) 60724(3.1%) match-e ...herbie/develop/src/core/ematch.rkt:46:0 for-loop [84] 48.3% for-loop [91] 10.8% ??? [121] 6.9% variable? [47] 4.2% loop [191] 2.2% list-cartesian-product [97] 2.0% curry* [99] 0.5% custom-in-set [253] 0.3% ------------------------------------------------------------------------------------------- gen-series! [58] 100.0% [75] 95204(4.9%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:135:7 taylor-alt [85] 100.0% ------------------------------------------------------------------------------------------- loop [59] 17.8% argmin [56] 82.2% [76] 52616(2.7%) 700(0.0%) expression-cost .../develop/src/programs.rkt:198:0 compile [86] 98.7% ------------------------------------------------------------------------------------------- apply-match [55] 100.0% [77] 4708(0.2%) 2024(0.1%) reduce-to-single! ...lop/src/core/egraph.rkt:324:0 for-loop [87] 49.4% make-sequence [225] 7.6% ------------------------------------------------------------------------------------------- setfindf [64] 100.0% [78] 4344(0.2%) 4344(0.2%) for-loop ...es/herbie/develop/src/common.rkt:185:2 ------------------------------------------------------------------------------------------- eval-const-expr [65] 100.0% [79] 660(0.0%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [88] 100.0% ------------------------------------------------------------------------------------------- for-loop [70] 17.4% run [21] 30.4% [80] 1902754(97.1%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [184] 38.9% profile-thunk16 [1] 30.4% run-improve50 [2] 29.9% loop [95] 0.8% ------------------------------------------------------------------------------------------- for-loop [73] 100.0% [81] 286474(14.6%) 0(0.0%) ??? ...ies/herbie/develop/src/alternative.rkt:88:0 rewriter [90] 100.0% ------------------------------------------------------------------------------------------- substitute-e [82] 4.2% for-loop [71] 95.8% [82] 212630(10.9%) 7218(0.4%) substitute-e ...e/develop/src/core/ematch.rkt:71:0 mk-enode! [89] 91.1% substitute-e [82] 4.2% ??? [121] 1.4% variable? [47] 0.6% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [83] 4.1% for-loop [94] 7.5% for-loop [71] 88.4% [83] 194110(9.9%) 3332(0.2%) merge-egraph-nodes! ...p/src/core/egraph.rkt:152:0 update-leader! [92] 53.3% for-loop [96] 11.9% loop! [202] 10.9% for-loop [94] 10.9% enode-merge! [98] 5.6% merge-egraph-nodes! [83] 4.1% for-loop [26] 1.2% make-sequence [225] 0.4% ------------------------------------------------------------------------------------------- match-e [74] 100.0% [84] 134044(6.8%) 41186(2.1%) for-loop ...rbie/develop/src/core/ematch.rkt:59:11 for-loop [91] 61.7% list-cartesian-product [97] 8.1% loop [191] 3.0% curried [207] 0.9% curry* [99] 0.5% foldl [210] 0.5% ------------------------------------------------------------------------------------------- for-loop [75] 100.0% [85] 95204(4.9%) 0(0.0%) taylor-alt ...es/herbie/develop/src/glue.rkt:134:0 for-loop [93] 100.0% ------------------------------------------------------------------------------------------- expression-cost [76] 100.0% [86] 51916(2.6%) 2690(0.1%) compile ...s/herbie/develop/src/programs.rkt:175:0 hash-ref! [163] 94.8% ------------------------------------------------------------------------------------------- reduce-to-single! [77] 100.0% [87] 2326(0.1%) 2326(0.1%) for-loop ...rbie/develop/src/core/egraph.rkt:325:8 ------------------------------------------------------------------------------------------- ??? [79] 100.0% [88] 660(0.0%) 334(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 maybe-cons-kwd [100] 49.4% ------------------------------------------------------------------------------------------- mk-egraph [194] 0.1% expr->enode [206] 2.1% substitute-e [82] 47.0% for-loop [71] 50.8% [89] 411802(21.0%) 33878(1.7%) mk-enode! ...bie/develop/src/core/egraph.rkt:101:0 new-enode [101] 90.2% hash-has-key? [125] 1.5% ------------------------------------------------------------------------------------------- ??? [81] 9.9% matcher [112] 90.1% [90] 286474(14.6%) 23492(1.2%) rewriter ...bie/develop/src/core/matcher.rkt:131:2 for-loop [102] 90.9% expression->type [181] 3.6% *rules* [6] 2.9% f176 [183] 1.8% type-of [197] 0.1% ------------------------------------------------------------------------------------------- match-e [74] 29.5% for-loop [84] 70.5% [91] 124706(6.4%) 8446(0.4%) for-loop ...rbie/develop/src/core/ematch.rkt:65:37 match-e [74] 92.2% ??? [106] 2.6% ------------------------------------------------------------------------------------------- apply-match [55] 3.3% merge-egraph-nodes! [83] 96.7% [92] 115638(5.9%) 14120(0.7%) update-leader! ...evelop/src/core/egraph.rkt:217:0 for-loop [103] 82.2% update-en-expr [219] 2.1% custom-set-union! [109] 2.1% make-sequence [225] 0.8% ------------------------------------------------------------------------------------------- taylor-alt [85] 100.0% [93] 95204(4.9%) 0(0.0%) for-loop ...lies/herbie/develop/src/glue.rkt:139:6 ??? [147] 100.0% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [83] 100.0% [94] 36614(1.9%) 310(0.0%) for-loop ...bie/develop/src/core/egraph.rkt:200:10 merge-egraph-nodes! [83] 82.3% loop! [202] 16.8% ------------------------------------------------------------------------------------------- run-improve50 [2] 4.4% ??? [80] 95.6% [95] 31718(1.6%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:193:2 make-exacts* [114] 52.0% loop [104] 46.8% loop [115] 1.1% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [83] 100.0% [96] 23586(1.2%) 16408(0.8%) for-loop ...rbie/develop/src/core/egraph.rkt:232:6 update-en-expr [219] 30.4% ------------------------------------------------------------------------------------------- match-e [74] 18.3% list-cartesian-product [97] 26.7% for-loop [84] 55.1% [97] 19204(1.0%) 16504(0.8%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [97] 26.7% for-loop [107] 11.3% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [83] 100.0% [98] 11462(0.6%) 2634(0.1%) enode-merge! ...e/develop/src/core/enode.rkt:129:0 adopt-enode! [105] 56.0% custom-set-intersect! [108] 21.0% ------------------------------------------------------------------------------------------- for-loop [49] 16.7% for-loop [84] 34.1% match-e [74] 49.2% [99] 2112(0.1%) 712(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [110] 66.3% ------------------------------------------------------------------------------------------- unpack245 [88] 100.0% [100] 326(0.0%) 326(0.0%) maybe-cons-kwd ...ate/arrow-higher-order.rkt:498:0 ------------------------------------------------------------------------------------------- mk-enode! [89] 100.0% [101] 371250(18.9%) 3104(0.2%) new-enode ...erbie/develop/src/core/enode.rkt:97:0 type-of-enode-expr [111] 98.1% set [220] 0.6% ------------------------------------------------------------------------------------------- rewriter [90] 100.0% [102] 286146(14.6%) 3764(0.2%) for-loop ...ie/develop/src/core/matcher.rkt:134:10 matcher [112] 99.9% ------------------------------------------------------------------------------------------- update-leader! [92] 100.0% [103] 95056(4.9%) 3406(0.2%) for-loop ...rbie/develop/src/core/egraph.rkt:222:6 for-loop [113] 95.4% update-en-expr [219] 1.1% ------------------------------------------------------------------------------------------- loop [95] 100.0% [104] 14856(0.8%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:151:2 make-exacts* [114] 46.6% loop [115] 42.0% eval-prog [143] 11.4% ------------------------------------------------------------------------------------------- enode-merge! [98] 100.0% [105] 6420(0.3%) 3374(0.2%) adopt-enode! ...e/develop/src/core/enode.rkt:105:0 custom-set-union [218] 47.4% ------------------------------------------------------------------------------------------- for-loop [44] 20.2% for-loop [91] 79.8% [106] 4742(0.2%) 3060(0.2%) ??? ...ies/herbie/develop/src/core/ematch.rkt:50:5 for-loop [116] 28.8% custom-in-set [253] 6.7% ------------------------------------------------------------------------------------------- list-cartesian-product [97] 100.0% [107] 2700(0.1%) 2700(0.1%) for-loop ...erbie/develop/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------------------- enode-merge! [98] 100.0% [108] 2408(0.1%) 2408(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------------- update-leader! [92] 100.0% [109] 2400(0.1%) 1704(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [117] 29.0% ------------------------------------------------------------------------------------------- curry* [99] 100.0% [110] 1400(0.1%) 1400(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ------------------------------------------------------------------------------------------- new-enode [101] 100.0% [111] 364106(18.6%) 9064(0.5%) type-of-enode-expr ...elop/src/core/enode.rkt:68:0 get-sigs [118] 97.4% parse-loop12 [150] 0.1% ------------------------------------------------------------------------------------------- matcher [112] 19.9% for-loop [119] 30.5% for-loop [102] 49.6% [112] 286146(14.6%) 3448(0.2%) matcher ...rbie/develop/src/core/matcher.rkt:167:2 rewriter [90] 49.3% for-loop [119] 30.5% matcher [112] 19.9% for-loop [11] 0.2% variable? [47] 0.0% foldr [162] 0.0% foldl [210] 0.0% ------------------------------------------------------------------------------------------- for-loop [103] 100.0% [113] 90646(4.6%) 2086(0.1%) for-loop ...rbie/develop/src/core/egraph.rkt:223:8 hash-update! [120] 97.7% ------------------------------------------------------------------------------------------- loop [104] 29.5% loop [95] 70.5% [114] 23424(1.2%) 0(0.0%) make-exacts* ...erbie/develop/src/points.rkt:138:0 map [185] 48.6% loop [191] 48.5% eval-prog [143] 2.9% ------------------------------------------------------------------------------------------- loop [95] 5.4% loop [104] 94.6% [115] 6596(0.3%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:141:4 map [185] 100.0% ------------------------------------------------------------------------------------------- ??? [106] 100.0% [116] 1364(0.1%) 1364(0.1%) for-loop ...erbie/develop/src/core/ematch.rkt:51:7 ------------------------------------------------------------------------------------------- custom-set-union! [109] 100.0% [117] 696(0.0%) 696(0.0%) for-loop ...cts/racket/private/set-types.rkt:253:4 ------------------------------------------------------------------------------------------- type-of-enode-expr [111] 100.0% [118] 354680(18.1%) 7482(0.4%) get-sigs .../herbie/develop/src/type-check.rkt:5:0 ??? [122] 37.8% ??? [184] 33.8% ??? [121] 14.3% ...velop/src/common.rkt:47:2 [123] 11.9% ------------------------------------------------------------------------------------------- matcher [112] 100.0% [119] 285442(14.6%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:183:21 matcher [112] 100.0% ------------------------------------------------------------------------------------------- for-loop [113] 100.0% [120] 88560(4.5%) 1728(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [124] 98.0% ------------------------------------------------------------------------------------------- pattern-match [50] 0.2% pattern-substitute [33] 0.5% expression->type [181] 0.5% ??? [257] 2.2% substitute-e [82] 3.7% variable? [47] 13.4% match-e [74] 13.6% finalize-iter! [62] 20.7% f176 [183] 21.3% get-sigs [118] 22.8% [121] 222562(11.4%) 60438(3.1%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [125] 51.2% for-loop [130] 19.8% atab-add-altns [131] 0.9% ??? [257] 0.6% ------------------------------------------------------------------------------------------- ??? [147] 0.7% for-loop [72] 3.7% f176 [183] 31.1% get-sigs [118] 64.4% [122] 208140(10.6%) 12576(0.6%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [126] 54.2% for-loop [217] 31.0% get/build-late-neg-projection [142] 6.4% ??? [224] 1.3% ??? [216] 0.2% ??? [242] 0.2% ------------------------------------------------------------------------------------------- ??? [147] 2.0% f176 [183] 16.0% get-sigs [118] 28.4% for-loop [72] 53.5% [123] 148926(7.6%) 38244(2.0%) ...velop/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [128] 40.8% ??? [129] 33.0% ------------------------------------------------------------------------------------------- hash-update! [120] 100.0% [124] 86832(4.4%) 1034(0.1%) ??? ...s/herbie/develop/src/core/egraph.rkt:225:24 for-loop [127] 98.4% make-sequence [225] 0.4% ------------------------------------------------------------------------------------------- mk-enode! [89] 5.2% ??? [121] 94.8% [125] 121888(6.2%) 25514(1.3%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [190] 75.7% ??? [196] 3.4% ------------------------------------------------------------------------------------------- ??? [122] 100.0% [126] 112830(5.8%) 6712(0.3%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [132] 94.1% ------------------------------------------------------------------------------------------- ??? [124] 100.0% [127] 85438(4.4%) 72794(3.7%) for-loop ...bie/develop/src/core/egraph.rkt:226:26 update-en-expr [219] 14.8% ------------------------------------------------------------------------------------------- for-loop [251] 4.6% ??? [235] 11.5% ...velop/src/common.rkt:47:2 [123] 83.8% [128] 60786(3.1%) 10512(0.5%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [235] 72.7% ??? [257] 10.9% ??? [224] 4.4% ------------------------------------------------------------------------------------------- ...velop/src/common.rkt:47:2 [123] 100.0% [129] 49178(2.5%) 17260(0.9%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [192] 28.9% return/no-unsupplied [267] 20.6% assoc-ref [134] 15.4% ------------------------------------------------------------------------------------------- ??? [121] 100.0% [130] 46174(2.4%) 0(0.0%) for-loop ...ie/develop/src/core/alt-table.rkt:51:2 atab-add-altn [133] 100.0% ------------------------------------------------------------------------------------------- ??? [121] 100.0% [131] 2068(0.1%) 0(0.0%) atab-add-altns ...elop/src/core/alt-table.rkt:50:0 atab-add-altn [133] 100.0% ------------------------------------------------------------------------------------------- ??? [126] 100.0% [132] 106118(5.4%) 4138(0.2%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [135] 96.1% ------------------------------------------------------------------------------------------- atab-add-altns [131] 4.3% for-loop [130] 95.7% [133] 48242(2.5%) 0(0.0%) atab-add-altn ...elop/src/core/alt-table.rkt:208:0 best-and-tied-at-points [136] 88.6% override-at-pnts [137] 11.4% ------------------------------------------------------------------------------------------- ??? [129] 100.0% [134] 7574(0.4%) 7574(0.4%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------------------- ??? [132] 100.0% [135] 101980(5.2%) 5488(0.3%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [138] 94.6% ------------------------------------------------------------------------------------------- atab-add-altn [133] 100.0% [136] 42722(2.2%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [139] 97.6% ------------------------------------------------------------------------------------------- atab-add-altn [133] 100.0% [137] 5520(0.3%) 0(0.0%) override-at-pnts ...p/src/core/alt-table.rkt:145:0 errors [139] 100.0% ------------------------------------------------------------------------------------------- ??? [135] 100.0% [138] 96492(4.9%) 19664(1.0%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [140] 50.8% get/build-late-neg-projection [142] 28.8% ------------------------------------------------------------------------------------------- composed [187] 4.2% loop [191] 7.1% override-at-pnts [137] 8.6% option-on-expr [203] 15.1% best-and-tied-at-points [136] 65.0% [139] 64108(3.3%) 0(0.0%) errors ...lies/herbie/develop/src/points.rkt:218:0 for-loop [141] 71.3% eval-prog [143] 28.7% ------------------------------------------------------------------------------------------- for-loop [138] 100.0% [140] 49046(2.5%) 49046(2.5%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------------------- errors [139] 100.0% [141] 45702(2.3%) 1030(0.1%) for-loop ...es/herbie/develop/src/points.rkt:221:4 ??? [144] 95.6% ??? [147] 1.5% ------------------------------------------------------------------------------------------- ??? [146] 10.6% ??? [122] 21.0% for-loop [138] 67.7% [142] 41042(2.1%) 8150(0.4%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [145] 67.7% ??? [146] 14.7% ------------------------------------------------------------------------------------------- point->alt [244] 1.6% sindices->spoints [230] 2.8% make-exacts* [114] 3.0% sort-context-on-expr [222] 4.5% loop [104] 7.4% errors [139] 80.7% [143] 22820(1.2%) 1960(0.1%) eval-prog ...herbie/develop/src/programs.rkt:148:0 f176 [183] 77.7% hash-ref! [163] 13.7% ------------------------------------------------------------------------------------------- ??? [256] 0.4% jloop [12] 4.8% loop [262] 9.7% loop [191] 34.4% for-loop [141] 50.7% [144] 86234(4.4%) 682(0.0%) ??? ...tlies/herbie/develop/src/programs.rkt:154:4 ??? [148] 93.5% ??? [155] 4.6% ??? [147] 1.2% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [142] 100.0% [145] 30834(1.6%) 6906(0.4%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [149] 77.6% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [142] 100.0% [146] 10512(0.5%) 1688(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [142] 83.9% ------------------------------------------------------------------------------------------- loop [262] 0.3% jloop [12] 0.3% for-loop [141] 0.6% for-loop [49] 0.6% ??? [144] 0.9% map [185] 0.9% f176 [183] 14.3% loop [25] 24.4% ??? [184] 28.2% for-loop [93] 28.2% [147] 117750(6.0%) 358(0.0%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [184] 36.9% approximate9 [5] 27.5% hash-ref! [163] 24.4% ??? [257] 5.0% ...velop/src/common.rkt:47:2 [123] 2.6% best-alt [156] 1.3% ??? [122] 1.0% simplify [168] 0.7% ??? [155] 0.3% ------------------------------------------------------------------------------------------- ??? [144] 100.0% [148] 80598(4.1%) 44630(2.3%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [152] 16.5% ??? [205] 10.4% ??? [153] 7.5% bf* [154] 7.0% parse-loop12 [150] 0.9% ??? [259] 0.9% ------------------------------------------------------------------------------------------- contract-struct-name [151] 20.0% ??? [145] 80.0% [149] 23928(1.2%) 16458(0.8%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [151] 46.4% ------------------------------------------------------------------------------------------- simplify [168] 0.4% type-of-enode-expr [111] 0.5% ??? [148] 1.0% loop [191] 1.1% hash-ref! [163] 2.5% f176 [183] 4.2% parse-loop12 [150] 8.3% append-map [204] 20.4% for-loop [31] 24.8% map [185] 36.7% [150] 68454(3.5%) 11680(0.6%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 for-loop [157] 24.3% loop [191] 19.2% make-multiplication-node [164] 12.7% for-loop [159] 10.5% f176 [183] 8.7% parse-loop12 [150] 8.3% map [185] 5.9% foldr [162] 0.2% ------------------------------------------------------------------------------------------- build-compound-type-name [149] 100.0% [151] 14744(0.8%) 7470(0.4%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [149] 57.1% ------------------------------------------------------------------------------------------- ??? [148] 100.0% [152] 13280(0.7%) 8014(0.4%) ??? ...herbie/develop/src/syntax/syntax.rkt:153:17 ??? [192] 18.7% return/no-unsupplied [267] 18.2% list-member? [158] 2.7% ------------------------------------------------------------------------------------------- ??? [148] 100.0% [153] 6070(0.3%) 6070(0.3%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------- ??? [148] 100.0% [154] 5658(0.3%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [205] 100.0% ------------------------------------------------------------------------------------------- ??? [147] 7.8% ??? [144] 92.2% [155] 4264(0.2%) 358(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [160] 91.6% ------------------------------------------------------------------------------------------- ??? [147] 100.0% [156] 1720(0.1%) 0(0.0%) best-alt ...tlies/herbie/develop/src/glue.rkt:71:0 loop [161] 80.8% argmins [68] 19.2% ------------------------------------------------------------------------------------------- parse-loop12 [150] 100.0% [157] 26766(1.4%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:490:59 hash-ref! [163] 100.0% ------------------------------------------------------------------------------------------- ??? [152] 1.6% *rules* [6] 1.6% ormap [46] 3.3% for-loop [71] 93.5% [158] 21976(1.1%) 2820(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [165] 76.1% member [166] 11.0% ------------------------------------------------------------------------------------------- parse-loop12 [150] 100.0% [159] 14238(0.7%) 0(0.0%) for-loop ...rbie/develop/src/core/reduce.rkt:99:13 make-multiplication-node [164] 92.6% f176 [183] 7.4% ------------------------------------------------------------------------------------------- ??? [155] 100.0% [160] 3906(0.2%) 3194(0.2%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [239] 18.2% ------------------------------------------------------------------------------------------- extract-alt [52] 31.0% best-alt [156] 69.0% [161] 2014(0.1%) 0(0.0%) loop ...htlies/herbie/develop/src/common.rkt:151:2 composed [187] 100.0% ------------------------------------------------------------------------------------------- parse-loop12 [150] 48.1% matcher [112] 51.9% [162] 694(0.0%) 0(0.0%) foldr ...et/collects/racket/private/list.rkt:242:4 cp-2 [167] 100.0% ------------------------------------------------------------------------------------------- ??? [17] 0.1% simplify* [195] 0.1% for-loop [38] 0.1% for-loop [35] 0.1% first-nonzero-exp [40] 0.3% for-loop [34] 0.4% localize-error [66] 0.5% ??? [208] 0.8% eval-prog [143] 0.8% loop [191] 1.4% for-loop [157] 1.9% for-loop [28] 5.1% ??? [60] 6.0% for-loop [45] 6.3% ??? [169] 10.5% ??? [147] 11.8% compile [86] 13.4% for-loop [27] 17.9% ??? [170] 21.0% [163] 143174(7.3%) 48696(2.5%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [170] 23.4% ??? [7] 18.1% simplify [168] 12.6% ??? [8] 11.7% ??? [169] 10.5% ??? [9] 6.5% ??? [10] 1.9% parse-loop12 [150] 1.0% bigfloat-hash [172] 0.5% f176 [183] 0.2% ??? [17] 0.2% ??? [16] 0.1% ------------------------------------------------------------------------------------------- simplify [168] 3.0% parse-loop12 [150] 23.2% for-loop [159] 28.2% map [185] 45.6% [164] 46798(2.4%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [171] 100.0% ------------------------------------------------------------------------------------------- list-member? [158] 100.0% [165] 16728(0.9%) 16728(0.9%) loop (unknown source) ------------------------------------------------------------------------------------------- list-member? [158] 100.0% [166] 2428(0.1%) 2428(0.1%) member (unknown source) ------------------------------------------------------------------------------------------- foldr [162] 100.0% [167] 694(0.0%) 0(0.0%) cp-2 ...hare/racket/collects/racket/list.rkt:804:2 for-loop [173] 100.0% ------------------------------------------------------------------------------------------- ??? [9] 1.1% for-loop [28] 1.4% ??? [147] 1.8% taylor-exp [15] 2.2% taylor-log [13] 2.3% hash-ref! [163] 91.2% [168] 92840(4.7%) 0(0.0%) simplify ...erbie/develop/src/core/reduce.rkt:16:0 f176 [183] 91.6% simplify-node [193] 4.0% make-multiplication-node [164] 1.5% debug-print [198] 1.1% parse-loop12 [150] 0.7% simplify* [195] 0.3% ------------------------------------------------------------------------------------------- hash-ref! [163] 100.0% [169] 83986(4.3%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:44:15 hash-ref! [163] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [163] 100.0% [170] 47638(2.4%) 3706(0.2%) ??? ...tlies/herbie/develop/src/programs.rkt:183:5 hash-ref! [163] 91.9% loop [191] 5.0% ------------------------------------------------------------------------------------------- make-multiplication-node [164] 100.0% [171] 46798(2.4%) 1356(0.1%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [174] 93.6% group-by68 [175] 2.8% compose [209] 0.7% ------------------------------------------------------------------------------------------- hash-ref! [163] 100.0% [172] 2046(0.1%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 sig+exp->bigfloat [176] 50.8% bfcanonicalize [177] 49.2% ------------------------------------------------------------------------------------------- cp-2 [167] 100.0% [173] 694(0.0%) 694(0.0%) for-loop .../racket/collects/racket/list.rkt:805:4 ------------------------------------------------------------------------------------------- make-multiplication-subnode [171] 100.0% [174] 43782(2.2%) 348(0.0%) for-loop ...rbie/develop/src/core/reduce.rkt:242:3 mterm->expr [180] 91.5% make-multiplication-subsubsubnode [178] 7.0% compose [209] 0.8% ------------------------------------------------------------------------------------------- make-multiplication-subnode [171] 100.0% [175] 1328(0.1%) 1028(0.1%) group-by68 ...acket/collects/racket/list.rkt:749:0 hash-update [179] 22.6% ------------------------------------------------------------------------------------------- bigfloat-hash [172] 100.0% [176] 1040(0.1%) 1040(0.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ------------------------------------------------------------------------------------------- bigfloat-hash [172] 100.0% [177] 1006(0.1%) 1006(0.1%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ------------------------------------------------------------------------------------------- for-loop [174] 100.0% [178] 3050(0.2%) 332(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [180] 89.1% ------------------------------------------------------------------------------------------- group-by68 [175] 100.0% [179] 300(0.0%) 300(0.0%) hash-update ...cket/private/more-scheme.rkt:356:13 ------------------------------------------------------------------------------------------- make-multiplication-subsubsubnode [178] 6.4% for-loop [174] 93.6% [180] 42770(2.2%) 0(0.0%) mterm->expr ...e/develop/src/core/reduce.rkt:270:0 expression->type [181] 89.7% f176 [183] 9.4% type-of [197] 0.8% ------------------------------------------------------------------------------------------- loop [186] 2.1% f176 [183] 3.3% mterm->expr [180] 11.6% rewriter [90] 35.5% for-loop [182] 47.6% [181] 149030(7.6%) 964(0.0%) expression->type ...evelop/src/type-check.rkt:45:0 for-loop [182] 98.9% variable? [47] 0.5% ??? [121] 0.2% ------------------------------------------------------------------------------------------- expression->type [181] 100.0% [182] 147980(7.6%) 360(0.0%) for-loop ...herbie/develop/src/type-check.rkt:52:5 f176 [183] 51.5% expression->type [181] 48.1% return/no-unsupplied [267] 0.2% ??? [192] 0.1% ------------------------------------------------------------------------------------------- ??? [69] 0.0% for-loop [159] 0.1% composed [187] 0.1% ??? [208] 0.2% loop [42] 0.2% approximate9 [5] 0.3% loop [186] 0.3% mterm->expr [180] 0.4% hash-ref! [163] 0.4% append-map [204] 0.6% parse-loop12 [150] 0.7% eval-prog [143] 0.9% eval-const-expr [65] 1.1% simplify-node [193] 1.3% loop [191] 1.4% simplify [168] 7.2% split-table [48] 9.0% f176 [183] 9.4% map [185] 11.4% rewriter [90] 19.2% for-loop [182] 35.9% [183] 288374(14.7%) 14656(0.7%) f176 .../collects/racket/match/compiler.rkt:507:40 map [185] 19.6% ??? [122] 17.3% ??? [184] 13.8% ??? [121] 12.5% f176 [183] 9.4% loop [191] 7.7% ...velop/src/common.rkt:47:2 [123] 6.0% expression->type [181] 2.4% append-map [204] 1.8% option-on-expr [203] 1.3% ??? [147] 1.0% loop [186] 0.9% return/no-unsupplied [267] 0.6% ??? [192] 0.6% parse-loop12 [150] 0.4% loop [42] 0.2% composed [187] 0.2% combine-mterms [14] 0.2% gather-multiplicative-terms [199] 0.1% taylor-exp [15] 0.1% taylor-log [13] 0.1% compose [209] 0.0% taylor [188] 0.0% exprs-to-branch-on [19] 0.0% taylor-invert [20] 0.0% ------------------------------------------------------------------------------------------- simplify-alt [51] 0.0% ??? [147] 2.5% get-sigs [118] 2.5% f176 [183] 2.6% for-loop [72] 5.3% ??? [184] 6.8% for-loop [189] 38.7% ??? [80] 40.6% [184] 1575994(80.4%) 97906(5.0%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [189] 38.7% iterate-egraph!13 [3] 30.2% loop [4] 11.0% ??? [190] 7.6% ??? [184] 6.8% ??? [147] 1.9% ??? [192] 0.3% mk-egraph [194] 0.3% return/no-unsupplied [267] 0.2% ??? [235] 0.1% dict? [263] 0.0% ??? [196] 0.0% ------------------------------------------------------------------------------------------- gather-multiplicative-terms [199] 0.2% ??? [208] 0.9% parse-loop12 [150] 2.4% loop [115] 7.2% make-exacts* [114] 12.3% f176 [183] 76.9% [185] 92190(4.7%) 2018(0.1%) map ...acket/collects/racket/private/map.rkt:20:13 f176 [183] 45.1% loop [191] 20.4% parse-loop12 [150] 15.7% simplify-node [193] 6.9% make-multiplication-node [164] 5.9% ??? [208] 2.6% simplify* [195] 1.5% ??? [147] 0.9% ??? [18] 0.3% gather-multiplicative-terms [199] 0.0% ------------------------------------------------------------------------------------------- f176 [183] 100.0% [186] 14952(0.8%) 0(0.0%) loop ...es/herbie/develop/src/core/reduce.rkt:18:2 expression->type [181] 66.2% f176 [183] 31.6% type-of [197] 2.2% ------------------------------------------------------------------------------------------- argmins [68] 10.9% loop [161] 33.1% f176 [183] 56.0% [187] 6082(0.3%) 334(0.0%) composed ...ollects/racket/private/list.rkt:321:16 f176 [183] 44.5% errors [139] 44.0% loop [200] 6.0% ------------------------------------------------------------------------------------------- f176 [183] 100.0% [188] 360(0.0%) 0(0.0%) taylor ...herbie/develop/src/core/taylor.rkt:163:0 debug-print [198] 100.0% ------------------------------------------------------------------------------------------- ??? [184] 100.0% [189] 1333878(68.1%) 298(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:63:12 ??? [184] 100.0% ------------------------------------------------------------------------------------------- hash-has-key? [125] 23.5% ??? [184] 76.5% [190] 393174(20.1%) 161628(8.2%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [201] 43.1% ??? [216] 14.3% ??? [235] 1.2% arrow-higher-order:lnp [226] 0.2% successfully-got-the-right-kind-of-function [215] 0.1% ------------------------------------------------------------------------------------------- make-exacts* [114] 0.0% map [185] 0.9% ??? [170] 1.3% option-on-expr [203] 1.3% map-enodes [32] 1.6% for-loop [84] 2.0% match-e [74] 2.8% parse-loop12 [150] 9.1% loop! [202] 9.4% f176 [183] 11.3% loop [191] 60.2% [191] 183330(9.4%) 11840(0.6%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [191] 60.2% option-on-expr [203] 11.3% loop! [202] 8.7% f176 [183] 8.5% for-loop [49] 1.6% errors [139] 1.3% hash-ref! [163] 1.3% parse-loop12 [150] 1.3% curried [207] 1.2% foldl [210] 0.8% ??? [144] 0.1% ??? [208] 0.1% ??? [205] 0.0% set-precompute! [213] 0.0% ------------------------------------------------------------------------------------------- for-loop [182] 0.8% f176 [183] 4.1% ??? [152] 5.8% ??? [184] 23.2% flag-set? [61] 32.9% ??? [129] 33.2% [192] 42712(2.2%) 10682(0.5%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [221] 61.1% ??? [257] 13.9% ------------------------------------------------------------------------------------------- simplify [168] 13.9% map [185] 86.1% [193] 26464(1.4%) 0(0.0%) simplify-node .../develop/src/core/reduce.rkt:50:0 f176 [183] 67.9% append-map [204] 30.9% combine-aterms [214] 1.3% ------------------------------------------------------------------------------------------- ??? [184] 100.0% [194] 9210(0.5%) 0(0.0%) mk-egraph ...bie/develop/src/core/egraph.rkt:123:0 expr->enode [206] 96.4% mk-enode! [89] 3.6% ------------------------------------------------------------------------------------------- simplify [168] 5.2% map [185] 94.8% [195] 5700(0.3%) 4000(0.2%) simplify* ...rbie/develop/src/core/reduce.rkt:31:0 hash-ref! [163] 17.9% ??? [212] 6.2% return/no-unsupplied [267] 5.7% ------------------------------------------------------------------------------------------- ??? [184] 8.1% hash-has-key? [125] 91.9% [196] 4492(0.2%) 4492(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------------------- loop [186] 15.6% mterm->expr [180] 17.0% rewriter [90] 67.4% [197] 2128(0.1%) 2128(0.1%) type-of .../herbie/develop/src/type-check.rkt:38:0 ------------------------------------------------------------------------------------------- taylor [188] 17.8% for-loop [70] 31.6% simplify [168] 50.6% [198] 2026(0.1%) 360(0.0%) debug-print .../herbie/develop/src/debug.rkt:107:0 for-loop [211] 82.2% ------------------------------------------------------------------------------------------- map [185] 9.9% f176 [183] 90.1% [199] 1690(0.1%) 330(0.0%) gather-multiplicative-terms ...re/reduce.rkt:116:0 compose [209] 50.6% map [185] 29.9% ------------------------------------------------------------------------------------------- composed [187] 100.0% [200] 364(0.0%) 364(0.0%) loop ...are/racket/collects/racket/list.rkt:414:34 ------------------------------------------------------------------------------------------- ??? [190] 100.0% [201] 169486(8.7%) 84110(4.3%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [216] 31.4% for-loop [217] 16.4% ??? [224] 1.6% ??? [257] 0.6% arrow-higher-order:lnp [226] 0.4% ------------------------------------------------------------------------------------------- for-loop [94] 3.8% merge-egraph-nodes! [83] 21.3% loop [191] 30.7% for-loop [71] 44.2% [202] 109492(5.6%) 22476(1.1%) loop! ...s/herbie/develop/src/core/enode.rkt:192:2 custom-set-union [218] 38.4% loop [191] 34.3% set [220] 11.6% update-en-expr [219] 4.2% ------------------------------------------------------------------------------------------- f176 [183] 12.4% loop [191] 87.6% [203] 30120(1.5%) 0(0.0%) option-on-expr ...velop/src/core/regimes.rkt:103:0 sort-context-on-expr [222] 47.3% errors [139] 32.1% loop [191] 15.2% pick-errors [229] 2.3% sindices->spoints [230] 2.1% err-lsts->split-indices [232] 1.1% ------------------------------------------------------------------------------------------- append-map [204] 18.1% simplify-node [193] 27.2% f176 [183] 54.7% [204] 26892(1.4%) 1654(0.1%) append-map ...acket/collects/racket/list.rkt:565:2 parse-loop12 [150] 67.3% append-map [204] 18.1% f176 [183] 10.7% ------------------------------------------------------------------------------------------- eval-const-expr [65] 2.1% loop [191] 2.5% bf* [154] 38.5% ??? [148] 57.0% [205] 14692(0.7%) 1844(0.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfadd [223] 82.4% bfexp [228] 5.0% ------------------------------------------------------------------------------------------- mk-egraph [194] 28.9% expr->enode [206] 71.1% [206] 8878(0.5%) 328(0.0%) expr->enode ...e/develop/src/core/egraph.rkt:124:2 expr->enode [206] 71.1% mk-enode! [89] 25.2% ------------------------------------------------------------------------------------------- for-loop [49] 4.0% *rules* [6] 4.4% for-loop [26] 4.8% for-loop [84] 18.4% loop [191] 32.2% ormap [46] 36.2% [207] 7460(0.4%) 7460(0.4%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------------------- loop [191] 25.1% map [185] 74.9% [208] 6568(0.3%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 f176 [183] 73.5% hash-ref! [163] 19.8% map [185] 6.7% ------------------------------------------------------------------------------------------- make-multiplication-subnode [171] 6.9% for-loop [174] 6.9% f176 [183] 14.3% gather-multiplicative-terms [199] 21.3% for-loop [49] 50.5% [209] 4790(0.2%) 4790(0.2%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------------------------- matcher [112] 10.1% for-loop [11] 16.9% for-loop [84] 28.0% loop [191] 45.0% [210] 3652(0.2%) 2308(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [227] 28.2% merge-2-bindings [234] 8.6% ------------------------------------------------------------------------------------------- debug-print [198] 100.0% [211] 1666(0.1%) 1666(0.1%) for-loop ...ies/herbie/develop/src/debug.rkt:113:2 ------------------------------------------------------------------------------------------- simplify* [195] 100.0% [212] 352(0.0%) 0(0.0%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [221] 100.0% ------------------------------------------------------------------------------------------- loop [191] 100.0% [213] 336(0.0%) 0(0.0%) set-precompute! ...lop/src/core/simplify.rkt:172:0 make-sequence [225] 100.0% ------------------------------------------------------------------------------------------- simplify-node [193] 100.0% [214] 334(0.0%) 0(0.0%) combine-aterms ...evelop/src/core/reduce.rkt:183:0 for-loop [231] 100.0% ------------------------------------------------------------------------------------------- ??? [190] 100.0% [215] 324(0.0%) 0(0.0%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [233] 100.0% ------------------------------------------------------------------------------------------- ??? [122] 0.3% for-loop [201] 48.5% ??? [190] 51.2% [216] 109692(5.6%) 55370(2.8%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [236] 49.5% ------------------------------------------------------------------------------------------- for-loop [201] 30.1% ??? [122] 69.9% [217] 92420(4.7%) 18652(1.0%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [235] 76.8% ??? [259] 3.0% ------------------------------------------------------------------------------------------- adopt-enode! [105] 6.1% loop! [202] 93.9% [218] 50130(2.6%) 14120(0.7%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [237] 62.0% for-loop [241] 9.8% ------------------------------------------------------------------------------------------- for-loop [26] 2.1% for-loop [103] 3.0% update-leader! [92] 7.2% for-loop [96] 21.6% loop! [202] 28.1% for-loop [127] 38.0% [219] 33284(1.7%) 33284(1.7%) update-en-expr ...evelop/src/core/egraph.rkt:211:0 ------------------------------------------------------------------------------------------- new-enode [101] 8.4% loop! [202] 91.6% [220] 28114(1.4%) 28114(1.4%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------------------- ??? [212] 1.3% ??? [192] 98.7% [221] 26432(1.3%) 25396(1.3%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [242] 3.9% ------------------------------------------------------------------------------------------- option-on-expr [203] 100.0% [222] 14238(0.7%) 0(0.0%) sort-context-on-expr ...velop/src/points.rkt:115:0 ??? [238] 92.8% eval-prog [143] 7.2% ------------------------------------------------------------------------------------------- ??? [205] 100.0% [223] 12112(0.6%) 7198(0.4%) bfadd ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [239] 40.6% ------------------------------------------------------------------------------------------- ??? [128] 32.5% for-loop [201] 33.4% ??? [122] 34.0% [224] 8166(0.4%) 3094(0.2%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [240] 62.1% ------------------------------------------------------------------------------------------- set-precompute! [213] 5.8% reduce-to-single! [77] 6.2% ??? [124] 6.2% update-leader! [92] 16.8% merge-egraph-nodes! [83] 18.0% for-loop [43] 46.9% [225] 5762(0.3%) 5400(0.3%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [243] 6.3% ------------------------------------------------------------------------------------------- for-loop [201] 48.9% ??? [190] 51.1% [226] 1358(0.1%) 1024(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [245] 24.6% ------------------------------------------------------------------------------------------- foldl [210] 100.0% [227] 1030(0.1%) 1030(0.1%) merge2 .../herbie/develop/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------------------- ??? [205] 100.0% [228] 736(0.0%) 416(0.0%) bfexp ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [239] 43.5% ------------------------------------------------------------------------------------------- option-on-expr [203] 100.0% [229] 680(0.0%) 0(0.0%) pick-errors .../develop/src/core/regimes.rkt:184:0 point->alt [244] 52.4% for-loop [248] 47.6% ------------------------------------------------------------------------------------------- option-on-expr [203] 100.0% [230] 644(0.0%) 0(0.0%) sindices->spoints ...op/src/core/regimes.rkt:116:0 eval-prog [143] 100.0% ------------------------------------------------------------------------------------------- combine-aterms [214] 100.0% [231] 334(0.0%) 334(0.0%) for-loop ...rbie/develop/src/core/reduce.rkt:185:4 ------------------------------------------------------------------------------------------- option-on-expr [203] 100.0% [232] 332(0.0%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:222:0 add-splitpoint [246] 100.0% ------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [215]100.0% [233] 324(0.0%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [247] 100.0% ------------------------------------------------------------------------------------------- foldl [210] 100.0% [234] 314(0.0%) 314(0.0%) merge-2-bindings ...elop/src/core/matcher.rkt:28:0 ------------------------------------------------------------------------------------------- ??? [190] 3.6% ??? [184] 4.0% ??? [128] 39.6% for-loop [217] 52.0% [235] 136620(7.0%) 35618(1.8%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [249] 49.5% for-loop [251] 11.7% ??? [128] 10.3% ??? [259] 2.4% ------------------------------------------------------------------------------------------- ??? [216] 100.0% [236] 54322(2.8%) 54322(2.8%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------------------- custom-set-union [218] 100.0% [237] 31080(1.6%) 9200(0.5%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [250] 70.4% ------------------------------------------------------------------------------------------- localize-error [66] 2.7% sort-context-on-expr [222] 97.3% [238] 13566(0.7%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [252] 84.5% loop [262] 15.5% ------------------------------------------------------------------------------------------- bfexp [228] 5.4% real->bigfloat [160] 12.0% bfadd [223] 82.6% [239] 5946(0.3%) 5946(0.3%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------------------- ??? [224] 100.0% [240] 5072(0.3%) 2674(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [254] 47.3% ------------------------------------------------------------------------------------------- custom-set-union [218] 100.0% [241] 4930(0.3%) 4930(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------------------- ??? [122] 25.8% ??? [221] 74.2% [242] 1396(0.1%) 1396(0.1%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------------------- make-sequence [225] 100.0% [243] 362(0.0%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [253] 100.0% ------------------------------------------------------------------------------------------- pick-errors [229] 100.0% [244] 356(0.0%) 0(0.0%) point->alt ...e/develop/src/core/regimes.rkt:171:0 eval-prog [143] 100.0% ------------------------------------------------------------------------------------------- arrow-higher-order:lnp [226] 100.0% [245] 334(0.0%) 334(0.0%) ??? ...et/contract/private/arity-checking.rkt:19:2 ------------------------------------------------------------------------------------------- err-lsts->split-indices [232] 100.0% [246] 332(0.0%) 0(0.0%) add-splitpoint ...velop/src/core/regimes.rkt:235:2 for-loop [255] 100.0% ------------------------------------------------------------------------------------------- arity-checking-wrapper [233] 100.0% [247] 324(0.0%) 324(0.0%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ------------------------------------------------------------------------------------------- pick-errors [229] 100.0% [248] 324(0.0%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:186:2 ??? [256] 100.0% ------------------------------------------------------------------------------------------- ??? [235] 100.0% [249] 67644(3.5%) 7018(0.4%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [257] 84.7% ??? [259] 4.9% ------------------------------------------------------------------------------------------- for-loop [237] 100.0% [250] 21880(1.1%) 21880(1.1%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------------------- ??? [235] 100.0% [251] 16034(0.8%) 10390(0.5%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [128] 35.2% ------------------------------------------------------------------------------------------- ??? [238] 100.0% [252] 11464(0.6%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [258] 94.0% loop [262] 6.0% ------------------------------------------------------------------------------------------- ??? [106] 13.2% ??? [243] 15.0% setfindf [64] 27.3% match-e [74] 44.5% [253] 2410(0.1%) 2410(0.1%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------------------- check-hash/c [240] 100.0% [254] 2398(0.1%) 2398(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------------------- add-splitpoint [246] 100.0% [255] 332(0.0%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:237:4 for-loop [260] 100.0% ------------------------------------------------------------------------------------------- for-loop [248] 100.0% [256] 324(0.0%) 0(0.0%) ??? ...s/herbie/develop/src/core/regimes.rkt:177:2 ??? [144] 100.0% ------------------------------------------------------------------------------------------- for-loop [201] 1.1% ??? [121] 1.6% ??? [147] 6.8% ??? [192] 6.9% ??? [128] 15.4% ??? [249] 66.9% [257] 85648(4.4%) 66016(3.4%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [261] 11.5% ??? [121] 8.0% dict? [263] 3.5% ------------------------------------------------------------------------------------------- generic-sort/key [252] 47.0% copying-mergesort [258] 53.0% [258] 10778(0.6%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [258] 53.0% loop [262] 36.5% jloop [12] 10.5% ------------------------------------------------------------------------------------------- ??? [148] 7.0% for-loop [217] 27.3% ??? [235] 32.8% ??? [249] 32.9% [259] 10110(0.5%) 5736(0.3%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [264] 43.3% ------------------------------------------------------------------------------------------- for-loop [255] 100.0% [260] 332(0.0%) 332(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:241:8 ------------------------------------------------------------------------------------------- ??? [257] 100.0% [261] 9818(0.5%) 9818(0.5%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------------------- generic-sort/key [252] 7.6% ??? [238] 23.3% copying-mergesort [258] 69.1% [262] 9020(0.5%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [144] 92.4% errors-score [266] 4.0% ??? [147] 3.6% ------------------------------------------------------------------------------------------- *rules* [6] 6.1% ??? [184] 41.5% ??? [257] 52.4% [263] 5664(0.3%) 5664(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------------------- ??? [259] 100.0% [264] 4374(0.2%) 2400(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [265] 45.1% ------------------------------------------------------------------------------------------- ??? [264] 100.0% [265] 1974(0.1%) 1974(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 ------------------------------------------------------------------------------------------- loop [262] 100.0% [266] 360(0.0%) 0(0.0%) errors-score ...erbie/develop/src/points.rkt:228:0 return/no-unsupplied [267] 100.0% ------------------------------------------------------------------------------------------- simplify* [195] 0.8% for-loop [182] 0.9% errors-score [266] 0.9% f176 [183] 4.4% ??? [152] 6.0% ??? [184] 16.4% ??? [129] 25.1% flag-set? [61] 45.4% [267] 40380(2.1%) 27012(1.4%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [268] 33.1% ------------------------------------------------------------------------------------------- one-iter [23] 2.2% for-loop [43] 2.6% return/no-unsupplied [267] 95.2% [268] 14044(0.7%) 14044(0.7%) filter ...t/collects/racket/private/list.rkt:256:2 -------------------------------------------------------------------------------------------