Profiling results ----------------- Total cpu time observed: 783420ms (out of 786604ms) Number of samples taken: 2296 (once every 341ms) (Hiding functions with self<1.0% and local<2.0%: 25 of 296 hidden) =============================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =============================================================================== ??? [83] 100.0% [1] 683062(87.2%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [20] 100.0% ------------------------------------------------------------------------------- ??? [83] 100.0% [2] 552698(70.5%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 for-loop [21] 95.9% get-final-combination [30] 3.6% loop [108] 0.3% setup-alt-simplified [39] 0.1% prepare-points [110] 0.1% ------------------------------------------------------------------------------- ??? [229] 100.0% [3] 418810(53.5%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [22] 98.8% map-enodes [31] 1.2% ------------------------------------------------------------------------------- ??? [227] 100.0% [4] 109890(14.0%) 0(0.0%) approximate9 ...e-testing/src/core/taylor.rkt:12:0 loop [23] 99.4% f137 [169] 0.6% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [5] 102024(13.0%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:44:15 ??? [44] 96.0% hash-ref! [230] 3.3% simplify [43] 0.7% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [6] 96310(12.3%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:285:26 for-loop [24] 100.0% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [7] 86134(11.0%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:295:23 for-loop [25] 100.0% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [8] 75452(9.6%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:322:33 for-loop [26] 100.0% ------------------------------------------------------------------------------- ??? [229] 100.0% [9] 57346(7.3%) 0(0.0%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [28] 100.0% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [10] 45774(5.8%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:67:15 ??? [227] 94.0% hash-ref! [230] 6.0% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [11] 43976(5.6%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:392:23 for-loop [29] 100.0% ------------------------------------------------------------------------------- loop [190] 100.0% [12] 28980(3.7%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:293:24 eval-errors [27] 100.0% ------------------------------------------------------------------------------- map-enodes [31] 6.4% loop [190] 93.6% [13] 5026(0.6%) 658(0.1%) for-loop ...me-testing/src/core/simplify.rkt:195:2 setfindf [33] 40.5% eval-const-expr [35] 32.6% curried [226] 6.9% compose [201] 6.9% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [14] 4114(0.5%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:338:33 hash-ref! [230] 74.4% for-loop [36] 25.6% ------------------------------------------------------------------------------- f137 [169] 100.0% [15] 3026(0.4%) 360(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 first-nonzero-exp [37] 44.1% simplify [43] 44.0% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [16] 3002(0.4%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:483:23 for-loop [32] 100.0% ------------------------------------------------------------------------------- loop [190] 14.8% parse-loop12 [186] 27.6% map [172] 57.6% [17] 2320(0.3%) 0(0.0%) ??? ...bie/regime-testing/src/core/reduce.rkt:61:5 for-loop [34] 84.4% pattern-match [49] 15.6% ------------------------------------------------------------------------------- f137 [169] 100.0% [18] 1720(0.2%) 640(0.1%) combine-mterms ...esting/src/core/reduce.rkt:191:0 for-loop [38] 62.8% ------------------------------------------------------------------------------- copying-mergesort [223] 100.0% [19] 1660(0.2%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [57] 81.6% ??? [227] 18.4% ------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [20] 683062(87.2%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [83] 100.0% ------------------------------------------------------------------------------- run-improve50 [2] 100.0% [21] 530202(67.7%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [40] 100.0% ------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [22] 413784(52.8%) 4720(0.6%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [41] 66.6% for-loop [42] 31.8% ------------------------------------------------------------------------------- approximate9 [4] 100.0% [23] 109198(13.9%) 0(0.0%) loop ...ie/regime-testing/src/core/taylor.rkt:86:4 ??? [227] 58.1% hash-ref! [230] 41.9% ------------------------------------------------------------------------------- ??? [6] 100.0% [24] 96310(12.3%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:285:52 ??? [44] 65.0% hash-ref! [230] 32.5% simplify [43] 2.4% ------------------------------------------------------------------------------- ??? [7] 100.0% [25] 86134(11.0%) 640(0.1%) for-loop ...ime-testing/src/core/taylor.rkt:298:27 hash-ref! [230] 99.4% simplify [43] 0.3% ------------------------------------------------------------------------------- ??? [8] 100.0% [26] 75452(9.6%) 300(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:324:46 hash-ref! [230] 99.0% simplify [43] 0.4% ??? [50] 0.2% ------------------------------------------------------------------------------- override-at-pnts [163] 1.0% ??? [83] 1.4% composed [248] 1.9% option-on-expr [199] 1.9% best-and-tied-at-points [161] 20.9% loop [190] 30.6% ??? [12] 42.2% [27] 68680(8.8%) 0(0.0%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [45] 100.0% ------------------------------------------------------------------------------- loop [9] 100.0% [28] 57346(7.3%) 0(0.0%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [46] 99.4% ------------------------------------------------------------------------------- ??? [11] 100.0% [29] 43976(5.6%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:396:33 for-loop [47] 100.0% ------------------------------------------------------------------------------- run-improve50 [2] 100.0% [30] 19868(2.5%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:266:0 split-table [48] 98.4% extract-alt [52] 1.6% ------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [31] 5026(0.6%) 0(0.0%) map-enodes ...me-testing/src/core/egraph.rkt:140:0 loop [190] 93.6% for-loop [13] 6.4% ------------------------------------------------------------------------------- ??? [16] 100.0% [32] 3002(0.4%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:487:35 parse-loop12 [186] 100.0% ------------------------------------------------------------------------------- for-loop [13] 100.0% [33] 2034(0.3%) 1354(0.2%) setfindf ...ie/regime-testing/src/common.rkt:187:0 ??? [140] 17.7% for-loop [53] 15.7% ------------------------------------------------------------------------------- ??? [17] 100.0% [34] 1958(0.2%) 658(0.1%) for-loop ...egime-testing/src/core/reduce.rkt:62:7 pattern-match [49] 66.4% ------------------------------------------------------------------------------- for-loop [13] 100.0% [35] 1638(0.2%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f137 [169] 81.2% ??? [54] 18.8% ------------------------------------------------------------------------------- ??? [14] 100.0% [36] 1394(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:341:46 hash-ref! [230] 100.0% ------------------------------------------------------------------------------- taylor-invert [15] 100.0% [37] 1334(0.2%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [230] 100.0% ------------------------------------------------------------------------------- combine-mterms [18] 100.0% [38] 1080(0.1%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:195:5 hash-ref! [230] 100.0% ------------------------------------------------------------------------------- run-improve50 [2] 100.0% [39] 648(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [51] 100.0% ------------------------------------------------------------------------------- for-loop [21] 100.0% [40] 530202(67.7%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [55] 74.3% gen-series! [59] 20.7% finalize-iter! [61] 3.7% gen-rewrites! [65] 1.0% localize-error [70] 0.1% ------------------------------------------------------------------------------- one-iter [22] 100.0% [41] 275736(35.2%) 716(0.1%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [56] 89.1% match-e [58] 8.3% update-leader! [87] 2.0% reduce-to-single! [69] 0.4% ------------------------------------------------------------------------------- for-loop [42] 49.0% one-iter [22] 51.0% [42] 131614(16.8%) 29140(3.7%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [42] 49.0% match-e [58] 38.8% ??? [115] 0.1% ------------------------------------------------------------------------------- for-loop [195] 0.3% for-loop [26] 0.3% taylor-sqrt [180] 0.3% parse-loop12 [186] 0.6% for-loop [25] 0.6% ??? [5] 0.7% taylor-invert [15] 1.3% for-loop [24] 5.1% hash-ref! [230] 90.2% [43] 105886(13.5%) 332(0.0%) simplify ...egime-testing/src/core/reduce.rkt:16:0 f137 [169] 60.7% parse-loop12 [186] 31.6% debug7 [67] 2.9% debug-print [183] 2.3% simplify-node [176] 1.0% simplify* [191] 0.9% make-multiplication-node [63] 0.3% ------------------------------------------------------------------------------- ??? [5] 38.9% for-loop [24] 61.1% [44] 99970(12.8%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:288:19 hash-ref! [230] 100.0% ------------------------------------------------------------------------------- eval-errors [27] 100.0% [45] 68680(8.8%) 4430(0.6%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [57] 83.9% ??? [227] 6.7% ulp-difference [209] 2.4% ------------------------------------------------------------------------------- pass [28] 100.0% [46] 57014(7.3%) 0(0.0%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [60] 77.6% loop [64] 14.9% for-loop [66] 7.5% ------------------------------------------------------------------------------- for-loop [29] 100.0% [47] 43976(5.6%) 332(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:398:39 hash-ref! [230] 98.5% ??? [227] 0.7% ------------------------------------------------------------------------------- get-final-combination [30] 100.0% [48] 19542(2.5%) 0(0.0%) split-table ...e/regime-testing/src/glue.rkt:162:0 f137 [169] 100.0% ------------------------------------------------------------------------------- ??? [17] 21.8% for-loop [68] 29.6% for-loop [34] 48.6% [49] 1662(0.2%) 362(0.0%) pattern-match ...testing/src/core/matcher.rkt:48:0 for-loop [68] 48.6% ??? [140] 20.1% variable? [62] 9.5% ------------------------------------------------------------------------------- loop [190] 31.6% map [172] 33.9% for-loop [26] 34.5% [50] 986(0.1%) 340(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 taylor-sqrt [180] 33.9% map [172] 31.6% ------------------------------------------------------------------------------- setup-alt-simplified [39] 100.0% [51] 648(0.1%) 0(0.0%) simplify-alt ...e/regime-testing/src/glue.rkt:76:0 ??? [229] 100.0% ------------------------------------------------------------------------------- get-final-combination [30] 100.0% [52] 326(0.0%) 0(0.0%) extract-alt ...ie/regime-testing/src/glue.rkt:55:0 loop [241] 100.0% ------------------------------------------------------------------------------- setfindf [33] 100.0% [53] 320(0.0%) 320(0.0%) for-loop ...ie/regime-testing/src/common.rkt:188:2 ------------------------------------------------------------------------------- eval-const-expr [35] 100.0% [54] 308(0.0%) 308(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1635:39 ------------------------------------------------------------------------------- run-iter! [40] 100.0% [55] 393746(50.3%) 0(0.0%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [71] 100.0% ------------------------------------------------------------------------------- for-loop [41] 100.0% [56] 245630(31.4%) 686(0.1%) for-loop ...e-testing/src/core/simplify.rkt:148:10 mk-enode! [84] 34.8% merge-egraph-nodes! [75] 24.2% loop! [197] 18.6% substitute-e [77] 18.1% list-member? [79] 3.9% ------------------------------------------------------------------------------- option-on-expr [199] 0.2% jloop [19] 0.9% loop [225] 3.6% ??? [198] 15.6% for-loop [45] 39.1% loop [190] 40.1% [57] 147536(18.8%) 5186(0.7%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [72] 78.1% ??? [227] 12.1% ??? [231] 6.3% ------------------------------------------------------------------------------- for-loop [41] 12.3% for-loop [86] 22.8% for-loop [42] 64.9% [58] 125090(16.0%) 47480(6.1%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [74] 44.6% for-loop [86] 9.5% ??? [140] 5.1% list-cartesian-product [88] 3.5% variable? [62] 3.2% loop [190] 0.8% curry* [103] 0.3% ------------------------------------------------------------------------------- run-iter! [40] 100.0% [59] 109890(14.0%) 0(0.0%) gen-series! ...gime-testing/src/mainloop.rkt:129:0 for-loop [73] 100.0% ------------------------------------------------------------------------------- for-loop [46] 100.0% [60] 44244(5.6%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [76] 94.0% expression-cost [81] 6.0% ------------------------------------------------------------------------------- run-iter! [40] 100.0% [61] 19420(2.5%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [140] 100.0% ------------------------------------------------------------------------------- pattern-match [49] 2.7% free-variables [188] 3.1% pattern-substitute [253] 3.1% substitute-e [77] 9.1% match-e [58] 82.0% [62] 11504(1.5%) 0(0.0%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [140] 100.0% ------------------------------------------------------------------------------- simplify [43] 3.3% for-loop [196] 3.3% for-loop [192] 21.3% parse-loop12 [186] 27.8% map [172] 44.2% [63] 10768(1.4%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [78] 100.0% ------------------------------------------------------------------------------- for-loop [46] 100.0% [64] 8482(1.1%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [76] 96.2% expression-cost [81] 3.8% ------------------------------------------------------------------------------- run-iter! [40] 100.0% [65] 5520(0.7%) 0(0.0%) gen-rewrites! ...me-testing/src/mainloop.rkt:142:0 for-loop [80] 100.0% ------------------------------------------------------------------------------- for-loop [46] 100.0% [66] 4288(0.5%) 4288(0.5%) for-loop ...e-testing/src/core/simplify.rkt:217:13 ------------------------------------------------------------------------------- taylor [179] 10.1% simplify [43] 89.9% [67] 3376(0.4%) 1008(0.1%) debug7 ...erbie/regime-testing/src/debug.rkt:102:0 ??? [140] 40.6% ??? [236] 19.7% assoc-ref [160] 9.8% ------------------------------------------------------------------------------- pattern-match [49] 100.0% [68] 1300(0.2%) 316(0.0%) for-loop ...gime-testing/src/core/matcher.rkt:66:9 pattern-match [49] 75.7% ------------------------------------------------------------------------------- for-loop [41] 100.0% [69] 1008(0.1%) 336(0.0%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [82] 66.7% ------------------------------------------------------------------------------- run-iter! [40] 100.0% [70] 636(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 ??? [216] 50.9% hash-ref! [230] 49.1% ------------------------------------------------------------------------------- simplify! [55] 100.0% [71] 393746(50.3%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [83] 100.0% ------------------------------------------------------------------------------- ??? [57] 100.0% [72] 115184(14.7%) 77702(9.9%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [111] 9.8% ??? [90] 8.9% ??? [92] 6.1% bf* [96] 4.3% ...higher-order.rkt:346:33 [99] 1.9% for-loop [102] 0.6% ??? [263] 0.6% parse-loop12 [186] 0.4% ------------------------------------------------------------------------------- gen-series! [59] 100.0% [73] 109890(14.0%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:135:7 taylor-alt [85] 100.0% ------------------------------------------------------------------------------- match-e [58] 100.0% [74] 71140(9.1%) 26778(3.4%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [86] 51.8% list-cartesian-product [88] 9.8% loop [190] 2.4% curried [226] 0.7% curry* [103] 0.5% filter [250] 0.3% ------------------------------------------------------------------------------- for-loop [95] 3.4% merge-egraph-nodes! [75] 5.3% for-loop [56] 91.4% [75] 59464(7.6%) 2748(0.4%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [87] 41.3% for-loop [89] 18.5% loop! [197] 17.1% enode-merge! [97] 7.0% merge-egraph-nodes! [75] 5.3% for-loop [95] 5.1% for-loop [137] 0.6% ------------------------------------------------------------------------------- loop [64] 16.4% argmin [60] 83.6% [76] 49740(6.3%) 2648(0.3%) for-loop .../regime-testing/src/programs.rkt:210:2 ??? [229] 68.0% ...sting/src/common.rkt:48:2 [142] 23.8% ??? [141] 2.8% ------------------------------------------------------------------------------- substitute-e [77] 3.9% for-loop [56] 96.1% [77] 44556(5.7%) 1652(0.2%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [84] 91.6% substitute-e [77] 3.9% ??? [140] 1.0% variable? [62] 0.9% ------------------------------------------------------------------------------- make-multiplication-node [63] 100.0% [78] 10768(1.4%) 1320(0.2%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [93] 62.5% group-by68 [101] 18.6% compose [201] 6.6% ------------------------------------------------------------------------------- for-loop [56] 100.0% [79] 9678(1.2%) 348(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [91] 75.6% member [100] 20.8% ------------------------------------------------------------------------------- gen-rewrites! [65] 100.0% [80] 5520(0.7%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:147:11 ??? [94] 100.0% ------------------------------------------------------------------------------- loop [64] 10.8% argmin [60] 89.2% [81] 2986(0.4%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [98] 100.0% ------------------------------------------------------------------------------- reduce-to-single! [69] 100.0% [82] 672(0.1%) 672(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:326:8 ------------------------------------------------------------------------------- for-loop [71] 16.9% run [20] 35.6% [83] 775382(99.0%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 35.6% ??? [229] 27.8% run-improve50 [2] 27.3% baseline-error [106] 3.2% oracle-error [107] 3.0% loop [108] 1.8% prepare-points [110] 1.3% eval-errors [27] 0.1% ------------------------------------------------------------------------------- mk-egraph [239] 0.3% mk-enode-rec! [249] 2.8% substitute-e [77] 31.3% for-loop [56] 65.7% [84] 130378(16.6%) 10886(1.4%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [104] 90.0% hash-has-key? [149] 1.3% ------------------------------------------------------------------------------- for-loop [73] 100.0% [85] 109890(14.0%) 0(0.0%) taylor-alt ...ie/regime-testing/src/glue.rkt:134:0 for-loop [105] 100.0% ------------------------------------------------------------------------------- match-e [58] 33.4% for-loop [74] 66.6% [86] 59180(7.6%) 5716(0.7%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [58] 88.2% ??? [115] 3.2% ------------------------------------------------------------------------------- for-loop [41] 17.0% merge-egraph-nodes! [75] 83.0% [87] 31754(4.1%) 4402(0.6%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [109] 85.0% hash-ref! [230] 1.1% ------------------------------------------------------------------------------- list-cartesian-product [88] 26.4% match-e [58] 28.3% for-loop [74] 45.3% [88] 14982(1.9%) 12594(1.6%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [88] 26.4% for-loop [116] 12.5% ------------------------------------------------------------------------------- merge-egraph-nodes! [75] 100.0% [89] 10984(1.4%) 9382(1.2%) for-loop ...gime-testing/src/core/egraph.rkt:233:6 update-en-expr [207] 14.6% ------------------------------------------------------------------------------- ??? [72] 100.0% [90] 10216(1.3%) 6576(0.8%) ??? ...regime-testing/src/syntax/syntax.rkt:156:17 ??? [236] 19.5% return/no-unsupplied [235] 16.2% ------------------------------------------------------------------------------- list-member? [79] 100.0% [91] 7316(0.9%) 7316(0.9%) loop (unknown source) ------------------------------------------------------------------------------- ??? [72] 100.0% [92] 7034(0.9%) 7034(0.9%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------- make-multiplication-subnode [78] 100.0% [93] 6734(0.9%) 324(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:242:3 make-multiplication-subsubsubnode [113] 55.4% mterm->expr [125] 29.3% partition [118] 10.5% ------------------------------------------------------------------------------- for-loop [80] 100.0% [94] 5520(0.7%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:88:0 rewriter [112] 93.5% loop [190] 6.5% ------------------------------------------------------------------------------- merge-egraph-nodes! [75] 100.0% [95] 5160(0.7%) 0(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [75] 76.6% loop! [197] 23.4% ------------------------------------------------------------------------------- ??? [72] 100.0% [96] 4984(0.6%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [111] 100.0% ------------------------------------------------------------------------------- merge-egraph-nodes! [75] 100.0% [97] 4314(0.6%) 324(0.0%) enode-merge! ...e-testing/src/core/enode.rkt:129:0 adopt-enode! [114] 84.5% custom-set-intersect! [119] 8.0% ------------------------------------------------------------------------------- expression-cost [81] 100.0% [98] 2986(0.4%) 0(0.0%) compile ...e/regime-testing/src/programs.rkt:186:0 hash-ref! [230] 100.0% ------------------------------------------------------------------------------- ??? [72] 100.0% [99] 2166(0.3%) 1046(0.1%) ...higher-order.rkt:346:33 (unknown source) ??? [244] 51.7% ------------------------------------------------------------------------------- list-member? [79] 100.0% [100] 2014(0.3%) 2014(0.3%) member (unknown source) ------------------------------------------------------------------------------- make-multiplication-subnode [78] 100.0% [101] 2008(0.3%) 2008(0.3%) group-by68 ...acket/collects/racket/list.rkt:749:0 ------------------------------------------------------------------------------- ??? [72] 100.0% [102] 734(0.1%) 0(0.0%) for-loop ...me-testing/src/syntax/syntax.rkt:531:2 bf< [117] 100.0% ------------------------------------------------------------------------------- match-e [58] 48.7% for-loop [74] 51.3% [103] 718(0.1%) 0(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [269] 100.0% ------------------------------------------------------------------------------- mk-enode! [84] 100.0% [104] 117394(15.0%) 1292(0.2%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [120] 98.1% set [206] 0.8% ------------------------------------------------------------------------------- taylor-alt [85] 100.0% [105] 109890(14.0%) 0(0.0%) for-loop ...rbie/regime-testing/src/glue.rkt:139:6 ??? [227] 100.0% ------------------------------------------------------------------------------- ??? [83] 100.0% [106] 45754(5.8%) 0(0.0%) baseline-error ...ime-testing/src/points.rkt:291:0 loop [190] 100.0% ------------------------------------------------------------------------------- ??? [83] 100.0% [107] 43838(5.6%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:286:0 for-loop [121] 100.0% ------------------------------------------------------------------------------- run-improve50 [2] 4.8% ??? [83] 95.2% [108] 28746(3.7%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:238:2 make-exacts* [133] 36.7% loop [123] 35.9% loop [135] 25.1% for-loop [129] 2.3% ------------------------------------------------------------------------------- update-leader! [87] 100.0% [109] 26990(3.4%) 1386(0.2%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [122] 94.9% ------------------------------------------------------------------------------- run-improve50 [2] 2.9% ??? [83] 97.1% [110] 20896(2.7%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 loop [123] 41.8% make-exacts* [133] 30.5% loop [135] 26.1% for-loop [129] 1.5% ------------------------------------------------------------------------------- bf* [96] 30.7% ??? [72] 69.3% [111] 16226(2.1%) 1130(0.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [124] 66.1% bfneg [127] 27.0% ------------------------------------------------------------------------------- ??? [94] 38.0% matcher [136] 62.0% [112] 5160(0.7%) 338(0.0%) rewriter ...ime-testing/src/core/matcher.rkt:131:2 for-loop [126] 71.1% expression->type [178] 9.6% *rules* [128] 8.6% f137 [169] 8.5% ------------------------------------------------------------------------------- make-multiplication-subsubsubnode [113] 27.0% for-loop [93] 73.0% [113] 3730(0.5%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [125] 73.0% make-multiplication-subsubsubnode [113] 27.0% ------------------------------------------------------------------------------- enode-merge! [97] 100.0% [114] 3644(0.5%) 1300(0.2%) adopt-enode! ...e-testing/src/core/enode.rkt:105:0 custom-set-union [205] 64.3% ------------------------------------------------------------------------------- for-loop [42] 12.7% for-loop [86] 87.3% [115] 2802(0.4%) 2442(0.3%) ??? ...bie/regime-testing/src/core/ematch.rkt:50:5 for-loop [130] 12.8% ------------------------------------------------------------------------------- list-cartesian-product [88] 100.0% [116] 2388(0.3%) 2388(0.3%) for-loop ...egime-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------- for-loop [102] 100.0% [117] 734(0.1%) 0(0.0%) bf< ...th/private/bigfloat/bigfloat-mpfr.rkt:127:4 ??? [242] 100.0% ------------------------------------------------------------------------------- for-loop [93] 100.0% [118] 708(0.1%) 708(0.1%) partition ...racket/collects/racket/list.rkt:547:0 ------------------------------------------------------------------------------- enode-merge! [97] 100.0% [119] 346(0.0%) 0(0.0%) custom-set-intersect! ...ivate/set-types.rkt:269:0 for-loop [131] 100.0% ------------------------------------------------------------------------------- new-enode [104] 100.0% [120] 115128(14.7%) 1402(0.2%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [132] 98.8% ------------------------------------------------------------------------------- oracle-error [107] 100.0% [121] 43838(5.6%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:288:2 loop [190] 63.2% map [172] 36.1% ------------------------------------------------------------------------------- for-loop [109] 100.0% [122] 25604(3.3%) 326(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [134] 98.7% ------------------------------------------------------------------------------- prepare-points [110] 45.8% loop [108] 54.2% [123] 19064(2.4%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 make-exacts* [133] 53.5% loop [135] 46.5% ------------------------------------------------------------------------------- ??? [111] 100.0% [124] 10722(1.4%) 7632(1.0%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [247] 28.8% ------------------------------------------------------------------------------- for-loop [93] 34.6% make-multiplication-subsubsubnode [113] 65.4% [125] 5702(0.7%) 1342(0.2%) mterm->expr ...e-testing/src/core/reduce.rkt:270:0 free-variables [188] 29.7% f137 [169] 11.8% return/no-unsupplied [235] 11.4% loop [139] 6.4% type-of [181] 6.1% ??? [236] 5.9% expression->type [178] 5.2% ------------------------------------------------------------------------------- rewriter [112] 100.0% [126] 4844(0.6%) 348(0.0%) for-loop ...me-testing/src/core/matcher.rkt:134:10 matcher [136] 98.8% ------------------------------------------------------------------------------- ??? [111] 100.0% [127] 4374(0.6%) 3210(0.4%) bfneg ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [247] 26.6% ------------------------------------------------------------------------------- rewriter [112] 100.0% [128] 2020(0.3%) 0(0.0%) *rules* ...gime-testing/src/syntax/rules.rkt:565:0 for-loop [137] 100.0% ------------------------------------------------------------------------------- prepare-points [110] 33.1% loop [108] 66.9% [129] 974(0.1%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [138] 100.0% ------------------------------------------------------------------------------- ??? [115] 100.0% [130] 360(0.0%) 360(0.0%) for-loop ...egime-testing/src/core/ematch.rkt:51:7 ------------------------------------------------------------------------------- custom-set-intersect! [119] 100.0% [131] 346(0.0%) 346(0.0%) for-loop ...cts/racket/private/set-types.rkt:272:4 ------------------------------------------------------------------------------- type-of-enode-expr [120] 100.0% [132] 113726(14.5%) 1408(0.2%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ??? [141] 35.7% ??? [229] 31.8% ??? [140] 17.7% ...sting/src/common.rkt:48:2 [142] 13.6% ------------------------------------------------------------------------------- prepare-points [110] 23.5% loop [123] 37.6% loop [108] 38.9% [133] 27152(3.5%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 loop [190] 83.5% eval-prog [166] 16.5% ------------------------------------------------------------------------------- for-loop [122] 100.0% [134] 25278(3.2%) 358(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [143] 98.6% ------------------------------------------------------------------------------- prepare-points [110] 25.4% loop [108] 33.5% loop [123] 41.2% [135] 21516(2.7%) 392(0.1%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [190] 98.2% ------------------------------------------------------------------------------- matcher [136] 17.4% for-loop [144] 34.1% for-loop [126] 48.4% [136] 4844(0.6%) 360(0.0%) matcher ...gime-testing/src/core/matcher.rkt:167:2 rewriter [112] 44.1% for-loop [144] 34.1% matcher [136] 17.4% for-loop [147] 3.7% ------------------------------------------------------------------------------- merge-egraph-nodes! [75] 14.6% *rules* [128] 85.4% [137] 2364(0.3%) 668(0.1%) for-loop ...ie/regime-testing/src/common.rkt:100:9 loop [145] 42.5% flag-set? [156] 15.2% ormap [148] 14.0% ------------------------------------------------------------------------------- for-loop [129] 100.0% [138] 974(0.1%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 for-loop [146] 66.9% ??? [227] 33.1% ------------------------------------------------------------------------------- mterm->expr [125] 100.0% [139] 366(0.0%) 366(0.0%) loop ...are/racket/collects/racket/list.rkt:414:34 ------------------------------------------------------------------------------- expression->type [178] 0.4% setfindf [33] 0.5% pattern-substitute [253] 0.5% pattern-match [49] 0.9% substitute-e [77] 1.4% debug7 [67] 1.9% free-variables [188] 2.2% f137 [169] 2.8% ??? [261] 3.5% variable? [62] 15.5% match-e [58] 16.8% finalize-iter! [61] 25.1% get-sigs [132] 27.1% [140] 74028(9.4%) 25580(3.3%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [149] 38.5% for-loop [152] 24.2% atab-add-altns [157] 0.9% ??? [261] 0.5% ------------------------------------------------------------------------------- f137 [169] 1.5% for-loop [76] 3.3% get-sigs [132] 95.2% [141] 42654(5.4%) 2778(0.4%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [153] 43.7% for-loop [151] 39.0% get/build-late-neg-projection [167] 10.0% ??? [257] 0.8% ------------------------------------------------------------------------------- f137 [169] 1.2% ??? [227] 1.2% for-loop [76] 42.4% get-sigs [132] 55.3% [142] 27922(3.6%) 7128(0.9%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [154] 38.8% ??? [155] 34.6% ------------------------------------------------------------------------------- hash-update! [134] 100.0% [143] 24920(3.2%) 0(0.0%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [150] 100.0% ------------------------------------------------------------------------------- matcher [136] 100.0% [144] 4484(0.6%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:183:21 matcher [136] 100.0% ------------------------------------------------------------------------------- for-loop [137] 100.0% [145] 1004(0.1%) 346(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [156] 65.5% ------------------------------------------------------------------------------- ??? [138] 100.0% [146] 652(0.1%) 310(0.0%) for-loop ...ie/regime-testing/src/points.rkt:231:9 ??? [227] 52.5% ------------------------------------------------------------------------------- matcher [136] 100.0% [147] 360(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/matcher.rkt:159:6 pattern-substitute [253] 100.0% ------------------------------------------------------------------------------- for-loop [137] 100.0% [148] 332(0.0%) 0(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [156] 100.0% ------------------------------------------------------------------------------- mk-enode! [84] 5.6% ??? [140] 94.4% [149] 31114(4.0%) 8522(1.1%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [234] 71.5% ------------------------------------------------------------------------------- ??? [143] 100.0% [150] 24920(3.2%) 21512(2.7%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 update-en-expr [207] 13.7% ------------------------------------------------------------------------------- for-loop [245] 24.3% ??? [141] 75.7% [151] 22004(2.8%) 4048(0.5%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [244] 77.0% ??? [263] 4.6% ------------------------------------------------------------------------------- ??? [140] 100.0% [152] 18752(2.4%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [158] 100.0% ------------------------------------------------------------------------------- ??? [141] 100.0% [153] 18622(2.4%) 970(0.1%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [159] 94.8% ------------------------------------------------------------------------------- for-loop [256] 4.6% ??? [244] 24.8% ...sting/src/common.rkt:48:2 [142] 70.6% [154] 10820(1.4%) 2626(0.3%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [244] 64.4% ??? [261] 18.7% ??? [257] 3.3% ------------------------------------------------------------------------------- ...sting/src/common.rkt:48:2 [142] 100.0% [155] 9658(1.2%) 4102(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 return/no-unsupplied [235] 23.8% ??? [236] 19.8% assoc-ref [160] 14.0% ------------------------------------------------------------------------------- ormap [148] 24.6% for-loop [137] 26.7% loop [145] 48.7% [156] 1350(0.2%) 684(0.1%) flag-set? ...ie/regime-testing/src/config.rkt:34:0 return/no-unsupplied [235] 49.3% ------------------------------------------------------------------------------- ??? [140] 100.0% [157] 668(0.1%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:50:0 atab-add-altn [158] 100.0% ------------------------------------------------------------------------------- atab-add-altns [157] 3.4% for-loop [152] 96.6% [158] 19420(2.5%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [161] 94.9% override-at-pnts [163] 3.4% loop [190] 1.7% ------------------------------------------------------------------------------- ??? [153] 100.0% [159] 17652(2.3%) 360(0.0%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [162] 98.0% ------------------------------------------------------------------------------- debug7 [67] 19.7% ??? [155] 80.3% [160] 1682(0.2%) 1682(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------- atab-add-altn [158] 100.0% [161] 18426(2.4%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [27] 78.1% alt-errors [165] 20.1% ------------------------------------------------------------------------------- ??? [159] 100.0% [162] 17292(2.2%) 674(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [164] 96.1% ------------------------------------------------------------------------------- atab-add-altn [158] 100.0% [163] 668(0.1%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:145:0 eval-errors [27] 100.0% ------------------------------------------------------------------------------- ??? [162] 100.0% [164] 16618(2.1%) 4106(0.5%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [168] 45.0% get/build-late-neg-projection [167] 30.3% ------------------------------------------------------------------------------- composed [248] 6.1% option-on-expr [199] 6.3% loop [190] 18.6% best-and-tied-at-points [161] 69.1% [165] 5368(0.7%) 0(0.0%) alt-errors ...ime-testing/src/alternative.rkt:59:0 eval-prog [166] 100.0% ------------------------------------------------------------------------------- point->alt [219] 3.0% sindices->spoints [211] 3.2% sort-context-on-expr [208] 6.1% make-exacts* [133] 40.0% alt-errors [165] 47.8% [166] 11232(1.4%) 982(0.1%) eval-prog ...regime-testing/src/programs.rkt:150:0 f137 [169] 64.0% hash-ref! [230] 27.3% ------------------------------------------------------------------------------- ??? [171] 16.0% ??? [141] 28.2% for-loop [164] 54.1% [167] 9312(1.2%) 1700(0.2%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [170] 62.8% ??? [171] 22.7% ------------------------------------------------------------------------------- for-loop [164] 100.0% [168] 7474(1.0%) 7474(1.0%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------- loop [174] 0.0% approximate9 [4] 0.2% for-loop [192] 0.3% mterm->expr [125] 0.3% composed [248] 0.5% simplify-node [176] 0.7% hash-ref! [230] 0.9% for-loop [184] 1.0% rewriter [112] 1.0% eval-const-expr [35] 1.3% eval-prog [166] 2.1% append-map [182] 3.4% loop [190] 3.5% parse-loop12 [186] 6.3% f137 [169] 10.6% split-table [48] 17.3% simplify [43] 22.8% map [172] 27.5% [169] 101646(13.0%) 13354(1.7%) f137 .../collects/racket/match/compiler.rkt:507:40 map [172] 52.5% loop [190] 14.8% f137 [169] 10.6% append-map [182] 3.8% option-on-expr [199] 2.6% ??? [227] 1.7% ??? [140] 1.5% gather-multiplicative-terms [194] 1.2% parse-loop12 [186] 1.0% ??? [175] 0.7% ??? [229] 0.6% loop [174] 0.5% composed [248] 0.5% ??? [141] 0.5% combine-mterms [18] 0.4% taylor-invert [15] 0.4% compose [201] 0.3% taylor [179] 0.1% ...sting/src/common.rkt:48:2 [142] 0.1% ------------------------------------------------------------------------------- get/build-late-neg-projection [167] 100.0% [170] 6986(0.9%) 1666(0.2%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [173] 76.2% ------------------------------------------------------------------------------- get/build-late-neg-projection [167] 100.0% [171] 3604(0.5%) 626(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [167] 82.6% ------------------------------------------------------------------------------- ??? [50] 0.4% loop [190] 0.4% gather-multiplicative-terms [194] 0.8% parse-loop12 [186] 6.7% for-loop [121] 18.6% f137 [169] 73.1% [172] 85202(10.9%) 1016(0.1%) map ...acket/collects/racket/private/map.rkt:20:13 f137 [169] 41.2% parse-loop12 [186] 26.1% loop [190] 17.8% simplify-node [176] 4.3% simplify* [191] 3.2% ??? [198] 3.1% make-multiplication-node [63] 1.7% gather-multiplicative-terms [194] 0.8% taylor-sqrt [180] 0.4% ??? [227] 0.4% ??? [17] 0.3% taylor [179] 0.2% ??? [50] 0.1% ------------------------------------------------------------------------------- contract-struct-name [177] 9.2% ??? [170] 90.8% [173] 5320(0.7%) 3316(0.4%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [177] 46.9% ------------------------------------------------------------------------------- f137 [169] 100.0% [174] 2710(0.3%) 706(0.1%) loop ...ie/regime-testing/src/core/reduce.rkt:18:2 expression->type [178] 50.5% type-of [181] 11.8% f137 [169] 11.7% ------------------------------------------------------------------------------- f137 [169] 100.0% [175] 698(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:336:46 ??? [261] 100.0% ------------------------------------------------------------------------------- simplify [43] 9.7% map [172] 90.3% [176] 10522(1.3%) 358(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 f137 [169] 45.7% append-map [182] 38.1% combine-aterms [185] 12.8% ------------------------------------------------------------------------------- build-compound-type-name [173] 100.0% [177] 2982(0.4%) 2004(0.3%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [173] 32.8% ------------------------------------------------------------------------------- rewriter [112] 12.2% mterm->expr [125] 12.7% loop [174] 17.0% for-loop [184] 58.1% [178] 2342(0.3%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [184] 87.3% ??? [140] 12.7% ------------------------------------------------------------------------------- map [172] 18.2% f137 [169] 81.8% [179] 1714(0.2%) 360(0.0%) taylor ...regime-testing/src/core/taylor.rkt:163:0 debug-print [183] 59.0% debug7 [67] 20.0% ------------------------------------------------------------------------------- ??? [50] 48.3% map [172] 51.7% [180] 692(0.1%) 0(0.0%) taylor-sqrt ...e-testing/src/core/taylor.rkt:346:0 hash-ref! [230] 51.7% simplify [43] 48.3% ------------------------------------------------------------------------------- loop [174] 48.0% mterm->expr [125] 52.0% [181] 666(0.1%) 666(0.1%) type-of .../regime-testing/src/type-check.rkt:38:0 ------------------------------------------------------------------------------- simplify-node [176] 24.5% f137 [169] 75.5% [182] 11150(1.4%) 1714(0.2%) append-map ...acket/collects/racket/list.rkt:565:2 f137 [169] 56.4% parse-loop12 [186] 32.8% loop [190] 3.0% free-variables [188] 1.1% ------------------------------------------------------------------------------- taylor [179] 29.6% simplify [43] 70.4% [183] 3414(0.4%) 306(0.0%) debug-print .../regime-testing/src/debug.rkt:107:0 for-loop [187] 91.0% ------------------------------------------------------------------------------- expression->type [178] 100.0% [184] 2044(0.3%) 0(0.0%) for-loop ...regime-testing/src/type-check.rkt:52:5 expression->type [178] 66.5% f137 [169] 33.5% ------------------------------------------------------------------------------- simplify-node [176] 100.0% [185] 1348(0.2%) 702(0.1%) combine-aterms ...esting/src/core/reduce.rkt:183:0 for-loop [189] 47.9% ------------------------------------------------------------------------------- hash-ref! [230] 0.4% ??? [72] 0.6% f137 [169] 1.9% for-loop [32] 3.8% loop [190] 5.0% append-map [182] 6.8% simplify [43] 19.9% parse-loop12 [186] 26.4% map [172] 35.2% [186] 74632(9.5%) 41708(5.3%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 parse-loop12 [186] 26.4% loop [190] 12.6% f137 [169] 8.4% map [172] 5.9% for-loop [192] 3.6% make-multiplication-node [63] 3.4% for-loop [195] 2.9% parse-app [193] 2.7% simplify* [191] 2.0% simplify [43] 0.9% make-keyword-procedure [262] 0.5% for-loop [196] 0.5% ??? [17] 0.2% gather-multiplicative-terms [194] 0.1% ------------------------------------------------------------------------------- debug-print [183] 100.0% [187] 3108(0.4%) 3108(0.4%) for-loop ...bie/regime-testing/src/debug.rkt:113:2 ------------------------------------------------------------------------------- append-map [182] 27.6% mterm->expr [125] 72.4% [188] 2342(0.3%) 324(0.0%) free-variables ...e-testing/src/programs.rkt:102:0 ??? [140] 71.0% variable? [62] 15.2% ------------------------------------------------------------------------------- combine-aterms [185] 100.0% [189] 646(0.1%) 314(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:185:4 hash-ref! [230] 51.4% ------------------------------------------------------------------------------- atab-add-altn [158] 0.0% ??? [94] 0.1% append-map [182] 0.2% map-enodes [31] 0.3% make-exacts* [133] 0.3% loop [135] 0.5% match-e [58] 0.6% for-loop [74] 0.7% ??? [238] 1.1% option-on-expr [199] 1.2% for-loop [121] 2.6% map [172] 3.6% loop! [197] 4.3% f137 [169] 5.0% baseline-error [106] 5.0% parse-loop12 [186] 7.0% loop [190] 67.6% [190] 218194(27.9%) 4074(0.5%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [190] 67.6% parse-loop12 [186] 5.1% option-on-expr [199] 5.0% loop! [197] 4.2% ??? [198] 3.2% ??? [12] 3.1% f137 [169] 2.9% eval-errors [27] 2.9% ??? [57] 2.6% hash-ref! [230] 1.1% foldl [202] 0.3% for-loop [13] 0.3% alt-errors [165] 0.2% simplify* [191] 0.2% ??? [227] 0.1% loop [204] 0.0% ??? [17] 0.0% map [172] 0.0% ??? [50] 0.0% ------------------------------------------------------------------------------- loop [190] 2.4% simplify [43] 7.1% parse-loop12 [186] 20.4% map [172] 70.1% [191] 13522(1.7%) 4386(0.6%) simplify* ...gime-testing/src/core/reduce.rkt:31:0 hash-ref! [230] 39.8% ??? [200] 17.9% return/no-unsupplied [235] 9.9% ------------------------------------------------------------------------------- parse-loop12 [186] 100.0% [192] 4380(0.6%) 334(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:99:13 make-multiplication-node [63] 52.4% f137 [169] 40.0% ------------------------------------------------------------------------------- parse-loop12 [186] 100.0% [193] 4144(0.5%) 3804(0.5%) parse-app .../collects/racket/private/kw.rkt:951:2 loop [203] 8.2% ------------------------------------------------------------------------------- gather-multiplicative-terms [194] 4.3% parse-loop12 [186] 8.0% map [172] 26.8% f137 [169] 60.9% [194] 4118(0.5%) 3422(0.4%) gather-multiplicative-terms ...re/reduce.rkt:116:0 map [172] 26.8% curried [226] 8.2% compose [201] 4.4% gather-multiplicative-terms [194] 4.3% ------------------------------------------------------------------------------- parse-loop12 [186] 100.0% [195] 2346(0.3%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:490:59 hash-ref! [230] 87.0% simplify [43] 13.0% ------------------------------------------------------------------------------- parse-loop12 [186] 100.0% [196] 360(0.0%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:89:11 make-multiplication-node [63] 100.0% ------------------------------------------------------------------------------- for-loop [95] 2.0% merge-egraph-nodes! [75] 13.7% loop [190] 29.5% for-loop [56] 54.8% [197] 60048(7.7%) 15272(1.9%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 custom-set-union [205] 34.7% loop [190] 31.5% set [206] 11.8% update-en-expr [207] 5.9% ------------------------------------------------------------------------------- map [172] 10.4% loop [190] 89.6% [198] 25326(3.2%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:289:26 ??? [57] 91.0% ??? [227] 5.1% ulp-difference [209] 3.9% ------------------------------------------------------------------------------- f137 [169] 13.3% loop [190] 86.7% [199] 19542(2.5%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [208] 40.8% loop [190] 37.1% err-lsts->split-indices [210] 8.2% eval-errors [27] 6.8% sindices->spoints [211] 1.8% ??? [57] 1.8% alt-errors [165] 1.7% pick-errors [214] 1.7% ------------------------------------------------------------------------------- simplify* [191] 100.0% [200] 2414(0.3%) 682(0.1%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [246] 71.7% ------------------------------------------------------------------------------- for-loop [13] 16.7% gather-multiplicative-terms [194] 17.2% f137 [169] 32.3% make-multiplication-subnode [78] 33.8% [201] 2088(0.3%) 2088(0.3%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------------- loop [190] 100.0% [202] 1412(0.2%) 694(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 ??? [212] 25.5% merge2 [213] 25.4% ------------------------------------------------------------------------------- parse-app [193] 100.0% [203] 340(0.0%) 340(0.0%) loop .../collects/racket/private/stxcase.rkt:112:7 ------------------------------------------------------------------------------- loop [190] 25.0% loop [204] 75.0% [204] 326(0.0%) 326(0.0%) loop ...ket/collects/racket/private/list.rkt:82:16 loop [204] 75.0% ------------------------------------------------------------------------------- adopt-enode! [114] 9.7% loop! [197] 90.3% [205] 24088(3.1%) 7212(0.9%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [215] 59.1% for-loop [217] 11.0% ------------------------------------------------------------------------------- new-enode [104] 6.4% loop! [197] 93.6% [206] 15250(1.9%) 15250(1.9%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------- for-loop [89] 12.9% for-loop [150] 27.5% loop! [197] 59.5% [207] 12374(1.6%) 12374(1.6%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------------- option-on-expr [199] 100.0% [208] 7980(1.0%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [216] 91.5% eval-prog [166] 8.5% ------------------------------------------------------------------------------- ??? [198] 37.6% for-loop [45] 62.4% [209] 2608(0.3%) 1316(0.2%) ulp-difference ...egime-testing/src/float.rkt:19:0 ??? [236] 36.7% return/no-unsupplied [235] 12.8% ------------------------------------------------------------------------------- option-on-expr [199] 100.0% [210] 1600(0.2%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [218] 100.0% ------------------------------------------------------------------------------- option-on-expr [199] 100.0% [211] 360(0.0%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 eval-prog [166] 100.0% ------------------------------------------------------------------------------- foldl [202] 100.0% [212] 360(0.0%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:66:9 ??? [227] 100.0% ------------------------------------------------------------------------------- foldl [202] 100.0% [213] 358(0.0%) 358(0.0%) merge2 .../regime-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------- option-on-expr [199] 100.0% [214] 334(0.0%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 point->alt [219] 100.0% ------------------------------------------------------------------------------- custom-set-union [205] 100.0% [215] 14232(1.8%) 3436(0.4%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [220] 75.9% ------------------------------------------------------------------------------- localize-error [70] 4.3% sort-context-on-expr [208] 95.7% [216] 7622(1.0%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [221] 79.1% loop [225] 20.9% ------------------------------------------------------------------------------- custom-set-union [205] 100.0% [217] 2644(0.3%) 2644(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------- err-lsts->split-indices [210] 100.0% [218] 1600(0.2%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [222] 100.0% ------------------------------------------------------------------------------- pick-errors [214] 100.0% [219] 334(0.0%) 0(0.0%) point->alt ...e-testing/src/core/regimes.rkt:188:0 eval-prog [166] 100.0% ------------------------------------------------------------------------------- for-loop [215] 100.0% [220] 10796(1.4%) 10796(1.4%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------- ??? [216] 100.0% [221] 6032(0.8%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [223] 100.0% ------------------------------------------------------------------------------- add-splitpoint [218] 100.0% [222] 1600(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:255:4 for-loop [224] 100.0% ------------------------------------------------------------------------------- copying-mergesort [223] 47.1% generic-sort/key [221] 52.9% [223] 6032(0.8%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [223] 47.1% loop [225] 46.0% jloop [19] 6.9% ------------------------------------------------------------------------------- for-loop [222] 100.0% [224] 1600(0.2%) 1284(0.2%) for-loop ...ime-testing/src/core/regimes.rkt:259:8 curried [226] 19.8% ------------------------------------------------------------------------------- ??? [216] 26.7% copying-mergesort [223] 73.3% [225] 5962(0.8%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [57] 89.1% ??? [227] 5.5% errors-score [228] 5.4% ------------------------------------------------------------------------------- for-loop [224] 19.1% gather-multiplicative-terms [194] 20.3% for-loop [13] 21.0% for-loop [74] 39.7% [226] 1658(0.2%) 1658(0.2%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------- for-loop [47] 0.1% jloop [19] 0.2% map [172] 0.2% ??? [138] 0.2% loop [225] 0.2% for-loop [146] 0.2% for-loop [233] 0.2% ??? [212] 0.2% ??? [198] 0.9% loop [190] 1.9% for-loop [45] 3.2% f137 [169] 4.1% ??? [10] 10.5% ??? [57] 12.2% loop [23] 14.5% ??? [229] 25.2% for-loop [105] 25.2% [227] 145604(18.6%) 6360(0.8%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [229] 42.6% approximate9 [4] 25.2% hash-ref! [230] 25.0% ??? [261] 1.9% best-alt [232] 0.7% ??? [231] 0.2% ...sting/src/common.rkt:48:2 [142] 0.2% ------------------------------------------------------------------------------- loop [225] 100.0% [228] 324(0.0%) 324(0.0%) errors-score ...egime-testing/src/points.rkt:298:0 ------------------------------------------------------------------------------- simplify-alt [51] 0.1% f137 [169] 0.1% for-loop [76] 1.8% get-sigs [132] 2.0% ??? [229] 8.3% ??? [227] 17.4% for-loop [233] 33.3% ??? [83] 36.9% [229] 616648(78.7%) 28884(3.7%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [233] 33.4% iterate-egraph!13 [3] 33.0% ??? [227] 13.3% ??? [229] 8.3% loop [9] 3.7% ??? [234] 3.0% ??? [236] 1.0% return/no-unsupplied [235] 0.9% mk-egraph [239] 0.3% dict? [268] 0.1% ??? [244] 0.0% ??? [242] 0.0% ------------------------------------------------------------------------------- for-loop [189] 0.1% for-loop [38] 0.1% for-loop [195] 0.1% taylor-sqrt [180] 0.2% for-loop [36] 0.2% first-nonzero-exp [37] 0.2% localize-error [70] 0.3% update-leader! [87] 0.3% ??? [14] 0.5% ??? [5] 0.5% simplify* [191] 0.8% compile [98] 0.9% ??? [10] 1.0% eval-prog [166] 1.2% loop [190] 1.5% ??? [238] 1.7% for-loop [47] 3.1% for-loop [26] 6.2% loop [23] 7.5% for-loop [24] 7.7% ??? [227] 13.1% for-loop [25] 17.2% ??? [44] 35.2% [230] 116612(14.9%) 10138(1.3%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [6] 33.8% ??? [7] 17.4% ??? [5] 10.8% simplify [43] 9.9% ??? [10] 8.5% ??? [8] 6.4% ??? [11] 3.2% ??? [238] 3.1% f137 [169] 2.2% bigfloat-hash [240] 1.2% ??? [14] 0.7% parse-loop12 [186] 0.3% ??? [16] 0.2% ------------------------------------------------------------------------------- ??? [227] 3.6% ??? [57] 96.4% [231] 9620(1.2%) 1082(0.1%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [237] 88.8% ------------------------------------------------------------------------------- ??? [227] 100.0% [232] 1318(0.2%) 0(0.0%) best-alt ...erbie/regime-testing/src/glue.rkt:71:0 loop [241] 75.6% argmins [243] 24.4% ------------------------------------------------------------------------------- ??? [229] 100.0% [233] 431758(55.1%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ??? [229] 99.8% ??? [227] 0.1% ------------------------------------------------------------------------------- hash-has-key? [149] 29.7% ??? [229] 70.3% [234] 74896(9.6%) 31806(4.1%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [245] 37.4% ??? [254] 16.2% ??? [244] 2.3% arrow-higher-order:lnp [258] 1.7% ------------------------------------------------------------------------------- ulp-difference [209] 2.5% mterm->expr [125] 4.9% flag-set? [156] 5.0% simplify* [191] 10.2% ??? [90] 12.5% ??? [155] 17.4% ??? [229] 47.5% [235] 13208(1.7%) 10518(1.3%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [250] 20.4% ------------------------------------------------------------------------------- mterm->expr [125] 2.7% debug7 [67] 5.4% ulp-difference [209] 7.7% ??? [155] 15.4% ??? [90] 16.0% ??? [229] 52.8% [236] 12428(1.6%) 3318(0.4%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [246] 62.9% ??? [261] 10.4% ------------------------------------------------------------------------------- ??? [231] 100.0% [237] 8538(1.1%) 7164(0.9%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [247] 16.1% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [238] 5716(0.7%) 0(0.0%) ??? ...erbie/regime-testing/src/programs.rkt:194:5 hash-ref! [230] 52.2% loop [190] 47.8% ------------------------------------------------------------------------------- ??? [229] 100.0% [239] 3964(0.5%) 0(0.0%) mk-egraph ...ime-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [249] 90.9% mk-enode! [84] 9.1% ------------------------------------------------------------------------------- hash-ref! [230] 100.0% [240] 3062(0.4%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [251] 64.8% sig+exp->bigfloat [252] 35.2% ------------------------------------------------------------------------------- extract-alt [52] 24.7% best-alt [232] 75.3% [241] 1322(0.2%) 0(0.0%) loop ...herbie/regime-testing/src/common.rkt:154:2 composed [248] 100.0% ------------------------------------------------------------------------------- ??? [229] 32.9% bf< [117] 67.1% [242] 1094(0.1%) 734(0.1%) ??? ...tract/private/arrow-higher-order.rkt:346:33 pattern-substitute [253] 32.9% ------------------------------------------------------------------------------- best-alt [232] 100.0% [243] 322(0.0%) 0(0.0%) argmins ...bie/regime-testing/src/common.rkt:153:0 composed [248] 100.0% ------------------------------------------------------------------------------- ??? [229] 1.1% ...higher-order.rkt:346:33 [99] 3.7% ??? [234] 5.6% ??? [154] 33.6% for-loop [151] 56.1% [244] 30234(3.9%) 4670(0.6%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [255] 55.0% ??? [154] 17.7% for-loop [256] 6.9% ??? [263] 3.4% ??? [261] 1.5% ------------------------------------------------------------------------------- ??? [234] 100.0% [245] 27982(3.6%) 13180(1.7%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [254] 25.2% for-loop [151] 19.1% ??? [257] 4.8% ??? [261] 2.5% arrow-higher-order:lnp [258] 1.3% ------------------------------------------------------------------------------- ??? [200] 18.1% ??? [236] 81.9% [246] 9546(1.2%) 9214(1.2%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [260] 3.5% ------------------------------------------------------------------------------- bfneg [127] 20.7% real->bigfloat [237] 24.4% bfdiv [124] 54.9% [247] 5628(0.7%) 5628(0.7%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------- argmins [243] 6.4% loop [241] 26.4% f137 [169] 67.1% [248] 5000(0.6%) 324(0.0%) composed ...ollects/racket/private/list.rkt:321:16 f137 [169] 60.6% eval-errors [27] 26.3% alt-errors [165] 6.6% ------------------------------------------------------------------------------- mk-egraph [239] 28.6% mk-enode-rec! [249] 71.4% [249] 3604(0.5%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [249] 71.4% mk-enode! [84] 28.6% ------------------------------------------------------------------------------- for-loop [74] 11.7% return/no-unsupplied [235] 88.3% [250] 3048(0.4%) 3048(0.4%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------- bigfloat-hash [240] 100.0% [251] 1984(0.3%) 1984(0.3%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ------------------------------------------------------------------------------- bigfloat-hash [240] 100.0% [252] 1078(0.1%) 726(0.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 integer->mpz [259] 32.7% ------------------------------------------------------------------------------- ??? [242] 16.7% for-loop [147] 16.7% pattern-substitute [253] 66.7% [253] 720(0.1%) 0(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [253] 66.7% ??? [140] 16.7% variable? [62] 16.7% ------------------------------------------------------------------------------- for-loop [245] 36.8% ??? [234] 63.2% [254] 19182(2.4%) 7716(1.0%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [262] 59.8% ------------------------------------------------------------------------------- ??? [244] 100.0% [255] 16622(2.1%) 1666(0.2%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [261] 88.1% ??? [263] 1.9% ------------------------------------------------------------------------------- ??? [244] 100.0% [256] 2072(0.3%) 1080(0.1%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [154] 47.9% ------------------------------------------------------------------------------- ??? [141] 16.4% ??? [154] 17.8% for-loop [245] 65.9% [257] 2028(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [264] 100.0% ------------------------------------------------------------------------------- for-loop [245] 21.7% ??? [234] 78.3% [258] 1662(0.2%) 682(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [265] 59.0% ------------------------------------------------------------------------------- sig+exp->bigfloat [252] 100.0% [259] 352(0.0%) 352(0.0%) integer->mpz ...math/private/bigfloat/gmp.rkt:87:0 ------------------------------------------------------------------------------- ??? [246] 100.0% [260] 332(0.0%) 332(0.0%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------- ??? [140] 1.4% ??? [244] 1.9% for-loop [245] 2.8% ??? [175] 2.8% ??? [236] 5.2% ??? [227] 10.9% ??? [154] 16.2% ??? [255] 58.8% [261] 24906(3.2%) 17766(2.3%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [140] 13.7% contract? [266] 12.3% dict? [268] 2.6% ------------------------------------------------------------------------------- parse-loop12 [186] 3.0% ??? [254] 97.0% [262] 11826(1.5%) 11826(1.5%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------- ??? [255] 10.3% ??? [72] 22.2% for-loop [151] 33.2% ??? [244] 34.3% [263] 3034(0.4%) 1332(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [267] 56.1% ------------------------------------------------------------------------------- ??? [257] 100.0% [264] 2028(0.3%) 1032(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [270] 49.1% ------------------------------------------------------------------------------- arrow-higher-order:lnp [258] 100.0% [265] 980(0.1%) 646(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 procedure-arity [269] 34.1% ------------------------------------------------------------------------------- ??? [261] 100.0% [266] 3070(0.4%) 3070(0.4%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------- ??? [263] 100.0% [267] 1702(0.2%) 1390(0.2%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [271] 18.3% ------------------------------------------------------------------------------- ??? [261] 40.1% ??? [229] 59.9% [268] 1620(0.2%) 1620(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------- ??? [265] 31.7% curry* [103] 68.3% [269] 1052(0.1%) 1052(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ------------------------------------------------------------------------------- check-hash/c [264] 100.0% [270] 996(0.1%) 996(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------- ??? [267] 100.0% [271] 312(0.0%) 312(0.0%) ??? ...ects/racket/contract/private/list.rkt:141:5 -------------------------------------------------------------------------------