Profiling results ----------------- Total cpu time observed: 1477994ms (out of 1483240ms) Number of samples taken: 4442 (once every 333ms) (Hiding functions with self<1.0% and local<2.0%: 19 of 291 hidden) ============================================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================================ ??? [73] 100.0% [1] 1311218(88.7%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [17] 100.0% -------------------------------------------------------------------------------------------- ??? [73] 100.0% [2] 673782(45.6%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 get-final-combination [19] 68.1% for-loop [20] 31.0% prepare-points [92] 0.4% setup-alt-simplified [28] 0.3% -------------------------------------------------------------------------------------------- f6 [174] 3.0% loop [211] 97.0% [3] 454480(30.7%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [211] 56.8% sort-context-on-expr [21] 26.9% eval-errors [18] 8.8% pick-errors [23] 2.1% err-lsts->split-indices [24] 2.1% alt-errors [7] 2.0% sindices->spoints [27] 0.6% point->alt [42] 0.4% eval-prog [138] 0.2% ??? [50] 0.1% -------------------------------------------------------------------------------------------- map [123] 1.6% loop [211] 98.4% [4] 203114(13.7%) 658(0.0%) ??? ...herbie/regime-testing/src/points.rkt:289:26 ??? [50] 96.9% ??? [64] 2.4% ulp-difference [55] 0.3% -------------------------------------------------------------------------------------------- loop [211] 100.0% [5] 169922(11.5%) 322(0.0%) ??? ...herbie/regime-testing/src/points.rkt:293:24 eval-errors [18] 99.6% loop [231] 0.2% -------------------------------------------------------------------------------------------- ??? [89] 100.0% [6] 55562(3.8%) 0(0.0%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [22] 100.0% -------------------------------------------------------------------------------------------- override-at-pnts [112] 1.2% composed [189] 1.2% best-and-tied-at-points [109] 7.0% option-on-expr [3] 16.9% loop [211] 72.9% [7] 52950(3.6%) 0(0.0%) alt-errors ...ime-testing/src/alternative.rkt:59:0 eval-prog [138] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [177] 100.0% [8] 4210(0.3%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:285:26 for-loop [26] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [177] 100.0% [9] 1986(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:295:23 for-loop [29] 100.0% -------------------------------------------------------------------------------------------- for-loop [46] 18.5% append-map [197] 81.5% [10] 1678(0.1%) 0(0.0%) free-variables ...e-testing/src/programs.rkt:102:0 ??? [67] 59.7% variable? [25] 21.8% f6 [174] 18.5% -------------------------------------------------------------------------------------------- hash-ref! [177] 100.0% [11] 968(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:392:23 for-loop [30] 100.0% -------------------------------------------------------------------------------------------- f6 [174] 100.0% [12] 728(0.0%) 0(0.0%) exprs-to-branch-on ...ng/src/core/regimes.rkt:42:0 for-loop [31] 50.3% all-critical-subexpressions [48] 49.7% -------------------------------------------------------------------------------------------- [13] 674(0.0%) 360(0.0%) parse-app .../collects/racket/private/kw.rkt:951:2 loop [35] 46.6% -------------------------------------------------------------------------------------------- matcher [128] 100.0% [14] 330(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/matcher.rkt:159:6 pattern-substitute [32] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [177] 100.0% [15] 326(0.0%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:483:23 for-loop [33] 100.0% -------------------------------------------------------------------------------------------- f6 [174] 100.0% [16] 318(0.0%) 0(0.0%) combine-mterms ...esting/src/core/reduce.rkt:191:0 for-loop [34] 100.0% -------------------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [17] 1311858(88.8%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [73] 100.0% -------------------------------------------------------------------------------------------- ??? [73] 0.6% override-at-pnts [112] 0.9% composed [189] 1.7% best-and-tied-at-points [109] 4.5% option-on-expr [3] 7.4% ??? [5] 31.4% loop [211] 53.4% [18] 539572(36.5%) 320(0.0%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [36] 99.9% -------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [19] 459100(31.1%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:266:0 split-table [37] 99.2% extract-alt [43] 0.8% -------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [20] 209196(14.2%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [38] 100.0% -------------------------------------------------------------------------------------------- option-on-expr [3] 100.0% [21] 122278(8.3%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [66] 98.9% eval-prog [138] 1.1% -------------------------------------------------------------------------------------------- loop [6] 100.0% [22] 55562(3.8%) 0(0.0%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [39] 100.0% -------------------------------------------------------------------------------------------- option-on-expr [3] 100.0% [23] 9624(0.7%) 368(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [41] 65.2% point->alt [42] 30.9% -------------------------------------------------------------------------------------------- option-on-expr [3] 100.0% [24] 9570(0.6%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [40] 93.0% for-loop [49] 7.0% -------------------------------------------------------------------------------------------- matcher [128] 8.2% free-variables [10] 8.3% substitute-e [150] 14.8% match-e [144] 68.7% [25] 4392(0.3%) 360(0.0%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [67] 91.8% -------------------------------------------------------------------------------------------- ??? [8] 100.0% [26] 4210(0.3%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:285:52 hash-ref! [177] 54.1% ??? [44] 38.7% simplify [154] 7.2% -------------------------------------------------------------------------------------------- option-on-expr [3] 100.0% [27] 2608(0.2%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 for-loop [46] 50.1% eval-prog [138] 49.9% -------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [28] 2120(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [45] 100.0% -------------------------------------------------------------------------------------------- ??? [9] 100.0% [29] 1986(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:298:27 hash-ref! [177] 100.0% -------------------------------------------------------------------------------------------- ??? [11] 100.0% [30] 968(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:396:33 for-loop [47] 100.0% -------------------------------------------------------------------------------------------- exprs-to-branch-on [12] 100.0% [31] 366(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:44:27 all-critical-subexpressions [48] 100.0% -------------------------------------------------------------------------------------------- for-loop [14] 25.0% pattern-substitute [32] 75.0% [32] 330(0.0%) 0(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [32] 75.0% ??? [67] 25.0% -------------------------------------------------------------------------------------------- ??? [15] 100.0% [33] 326(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:487:35 parse-loop145 [205] 100.0% -------------------------------------------------------------------------------------------- combine-mterms [16] 100.0% [34] 318(0.0%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:195:5 hash-ref! [177] 100.0% -------------------------------------------------------------------------------------------- loop [35] 50.0% parse-app [13] 50.0% [35] 314(0.0%) 314(0.0%) loop .../collects/racket/private/stxcase.rkt:112:7 loop [35] 50.0% -------------------------------------------------------------------------------------------- eval-errors [18] 100.0% [36] 539252(36.5%) 12274(0.8%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [50] 93.6% ??? [64] 2.0% ulp-difference [55] 1.7% ??? [225] 0.1% -------------------------------------------------------------------------------------------- get-final-combination [19] 100.0% [37] 455208(30.8%) 0(0.0%) split-table ...e/regime-testing/src/glue.rkt:162:0 f6 [174] 100.0% -------------------------------------------------------------------------------------------- for-loop [20] 100.0% [38] 209196(14.2%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [51] 71.2% finalize-iter! [53] 16.8% gen-rewrites! [56] 5.3% gen-series! [58] 2.6% choose-best-alt! [59] 2.3% localize-error [60] 1.7% -------------------------------------------------------------------------------------------- pass [22] 100.0% [39] 55562(3.8%) 364(0.0%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [52] 67.8% loop [54] 29.2% for-loop [61] 2.3% -------------------------------------------------------------------------------------------- err-lsts->split-indices [24] 100.0% [40] 8902(0.6%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [57] 100.0% -------------------------------------------------------------------------------------------- pick-errors [23] 100.0% [41] 6278(0.4%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:203:2 ??? [219] 100.0% -------------------------------------------------------------------------------------------- option-on-expr [3] 38.9% pick-errors [23] 61.1% [42] 4874(0.3%) 0(0.0%) point->alt ...e-testing/src/core/regimes.rkt:188:0 eval-prog [138] 100.0% -------------------------------------------------------------------------------------------- get-final-combination [19] 100.0% [43] 3892(0.3%) 0(0.0%) extract-alt ...ie/regime-testing/src/glue.rkt:55:0 loop [95] 91.5% argmins [100] 8.5% -------------------------------------------------------------------------------------------- for-loop [26] 100.0% [44] 2564(0.2%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:288:19 hash-ref! [177] 100.0% -------------------------------------------------------------------------------------------- setup-alt-simplified [28] 100.0% [45] 2120(0.1%) 0(0.0%) simplify-alt ...e/regime-testing/src/glue.rkt:76:0 ??? [89] 100.0% -------------------------------------------------------------------------------------------- sindices->spoints [27] 100.0% [46] 1306(0.1%) 330(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:137:2 ??? [132] 25.9% f6 [174] 25.1% free-variables [10] 23.7% -------------------------------------------------------------------------------------------- for-loop [30] 100.0% [47] 968(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:398:39 hash-ref! [177] 100.0% -------------------------------------------------------------------------------------------- exprs-to-branch-on [12] 49.7% for-loop [31] 50.3% [48] 728(0.0%) 0(0.0%) all-critical-subexpressions ...re/regimes.rkt:58:0 for-loop [62] 100.0% -------------------------------------------------------------------------------------------- err-lsts->split-indices [24] 100.0% [49] 668(0.0%) 668(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:279:4 -------------------------------------------------------------------------------------------- option-on-expr [3] 0.0% ??? [219] 1.5% jloop [108] 3.5% loop [106] 7.7% ??? [4] 19.0% loop [211] 19.3% for-loop [36] 48.8% [50] 1034046(70.0%) 9446(0.6%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [63] 89.2% ??? [64] 5.8% loop [211] 3.6% ??? [224] 0.3% ??? [225] 0.1% -------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [51] 148910(10.1%) 0(0.0%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [65] 100.0% -------------------------------------------------------------------------------------------- for-loop [39] 100.0% [52] 37684(2.5%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [68] 91.2% expression-cost [72] 8.8% -------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [53] 35132(2.4%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [67] 100.0% -------------------------------------------------------------------------------------------- for-loop [39] 100.0% [54] 16220(1.1%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [68] 92.3% expression-cost [72] 7.7% -------------------------------------------------------------------------------------------- ??? [4] 5.7% loop [211] 16.7% for-loop [36] 77.6% [55] 11468(0.8%) 6512(0.4%) ulp-difference ...egime-testing/src/float.rkt:19:0 return/no-unsupplied [107] 22.9% ??? [104] 20.3% -------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [56] 11188(0.8%) 0(0.0%) gen-rewrites! ...me-testing/src/mainloop.rkt:142:0 for-loop [69] 100.0% -------------------------------------------------------------------------------------------- add-splitpoint [40] 100.0% [57] 8902(0.6%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:255:4 for-loop [70] 96.6% curried [228] 3.4% -------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [58] 5542(0.4%) 0(0.0%) gen-series! ...gime-testing/src/mainloop.rkt:129:0 for-loop [71] 100.0% -------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [59] 4868(0.3%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:115:0 ??? [67] 100.0% -------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [60] 3556(0.2%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [177] 81.9% ??? [66] 18.1% -------------------------------------------------------------------------------------------- for-loop [39] 100.0% [61] 1294(0.1%) 1294(0.1%) for-loop ...e-testing/src/core/simplify.rkt:217:13 -------------------------------------------------------------------------------------------- all-critical-subexpressions [48] 100.0% [62] 728(0.0%) 0(0.0%) for-loop ...gime-testing/src/core/regimes.rkt:62:2 f6 [174] 100.0% -------------------------------------------------------------------------------------------- ??? [50] 100.0% [63] 922430(62.4%) 546588(37.0%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [74] 27.5% ??? [76] 6.2% ??? [218] 5.3% ??? [259] 0.8% bf* [80] 0.7% parse-loop145 [205] 0.1% -------------------------------------------------------------------------------------------- ??? [219] 0.2% map [123] 0.2% loop [217] 0.2% loop [99] 0.3% ??? [131] 0.3% for-loop [142] 0.4% ??? [194] 0.7% jloop [108] 0.9% loop [106] 1.0% ??? [89] 1.1% for-loop [98] 1.1% ??? [84] 2.6% ??? [4] 2.8% for-loop [36] 5.9% loop [211] 19.5% f6 [174] 28.1% ??? [50] 34.2% [64] 176174(11.9%) 16628(1.1%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [89] 70.0% ??? [258] 8.7% ...sting/src/common.rkt:48:2 [78] 4.2% best-alt [81] 3.3% ??? [212] 2.4% approximate9 [83] 1.1% hash-ref! [177] 0.9% -------------------------------------------------------------------------------------------- simplify! [51] 100.0% [65] 148910(10.1%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [73] 99.1% debug7 [87] 0.9% -------------------------------------------------------------------------------------------- localize-error [60] 0.5% sort-context-on-expr [21] 99.5% [66] 121564(8.2%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [75] 86.9% loop [106] 13.1% -------------------------------------------------------------------------------------------- pattern-substitute [32] 0.4% free-variables [10] 1.3% substitute-e [150] 1.3% f6 [174] 2.1% variable? [25] 5.2% choose-best-alt! [59] 6.3% get-sigs [202] 8.6% match-e [144] 9.7% ??? [258] 19.5% finalize-iter! [53] 45.1% [67] 77530(5.2%) 8292(0.6%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [77] 42.1% hash-has-key? [176] 37.5% ??? [84] 6.3% atab-add-altns [86] 3.0% -------------------------------------------------------------------------------------------- loop [54] 30.3% argmin [52] 69.7% [68] 49334(3.3%) 1962(0.1%) for-loop .../regime-testing/src/programs.rkt:210:2 ??? [89] 66.1% ...sting/src/common.rkt:48:2 [78] 25.9% ??? [212] 4.1% -------------------------------------------------------------------------------------------- gen-rewrites! [56] 100.0% [69] 11188(0.8%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:147:11 ??? [79] 100.0% -------------------------------------------------------------------------------------------- for-loop [57] 100.0% [70] 8596(0.6%) 7950(0.5%) for-loop ...ime-testing/src/core/regimes.rkt:259:8 curried [228] 7.5% -------------------------------------------------------------------------------------------- gen-series! [58] 100.0% [71] 5542(0.4%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:135:7 taylor-alt [82] 100.0% -------------------------------------------------------------------------------------------- loop [54] 27.3% argmin [52] 72.7% [72] 4570(0.3%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [85] 100.0% -------------------------------------------------------------------------------------------- for-loop [65] 3.5% run [17] 45.2% [73] 1396316(94.5%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 45.2% run-improve50 [2] 23.0% oracle-error [88] 12.3% baseline-error [90] 9.5% ??? [89] 7.1% prepare-points [92] 2.6% loop [211] 0.2% eval-errors [18] 0.1% loop [101] 0.0% -------------------------------------------------------------------------------------------- ??? [63] 100.0% [74] 253962(17.2%) 140826(9.5%) ??? ...regime-testing/src/syntax/syntax.rkt:156:17 ??? [104] 24.0% return/no-unsupplied [107] 18.7% list-member? [153] 1.8% -------------------------------------------------------------------------------------------- ??? [66] 100.0% [75] 105604(7.1%) 326(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [91] 85.3% loop [106] 14.1% jloop [108] 0.3% -------------------------------------------------------------------------------------------- ??? [63] 100.0% [76] 57548(3.9%) 57548(3.9%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 -------------------------------------------------------------------------------------------- ??? [67] 100.0% [77] 32810(2.2%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [93] 100.0% -------------------------------------------------------------------------------------------- f6 [174] 3.7% get-sigs [202] 16.4% ??? [64] 29.2% for-loop [68] 50.7% [78] 25178(1.7%) 9670(0.7%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [96] 32.8% ??? [97] 28.8% -------------------------------------------------------------------------------------------- for-loop [69] 100.0% [79] 11188(0.8%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:88:0 rewriter [94] 100.0% -------------------------------------------------------------------------------------------- ??? [63] 100.0% [80] 6626(0.4%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [218] 100.0% -------------------------------------------------------------------------------------------- ??? [64] 100.0% [81] 6174(0.4%) 0(0.0%) best-alt ...erbie/regime-testing/src/glue.rkt:71:0 loop [95] 78.6% argmins [100] 21.4% -------------------------------------------------------------------------------------------- for-loop [71] 100.0% [82] 5542(0.4%) 0(0.0%) taylor-alt ...ie/regime-testing/src/glue.rkt:134:0 for-loop [98] 100.0% -------------------------------------------------------------------------------------------- ??? [64] 100.0% [83] 5542(0.4%) 0(0.0%) approximate9 ...e-testing/src/core/taylor.rkt:12:0 loop [99] 93.9% f6 [174] 6.1% -------------------------------------------------------------------------------------------- ??? [67] 100.0% [84] 4868(0.3%) 0(0.0%) ??? .../regime-testing/src/core/alt-table.rkt:54:0 ??? [64] 100.0% -------------------------------------------------------------------------------------------- expression-cost [72] 100.0% [85] 4570(0.3%) 324(0.0%) compile ...e/regime-testing/src/programs.rkt:186:0 hash-ref! [177] 92.9% -------------------------------------------------------------------------------------------- ??? [67] 100.0% [86] 2322(0.2%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:50:0 atab-add-altn [93] 100.0% -------------------------------------------------------------------------------------------- for-loop [65] 100.0% [87] 1292(0.1%) 0(0.0%) debug7 ...erbie/regime-testing/src/debug.rkt:102:0 assoc-ref [116] 100.0% -------------------------------------------------------------------------------------------- ??? [73] 100.0% [88] 332964(22.5%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:286:0 for-loop [102] 99.9% loop [211] 0.1% -------------------------------------------------------------------------------------------- simplify-alt [45] 0.3% f6 [174] 0.5% get-sigs [202] 1.6% for-loop [68] 3.3% for-loop [105] 11.5% ??? [89] 17.7% ??? [73] 27.7% ??? [64] 37.2% [89] 329354(22.3%) 71764(4.9%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [103] 20.8% ??? [89] 17.7% for-loop [105] 11.6% ??? [104] 8.1% ??? [187] 7.2% return/no-unsupplied [107] 7.0% loop [6] 6.8% mk-egraph [115] 0.3% ??? [64] 0.3% list-member? [153] 0.3% ??? [236] 0.2% loop [119] 0.1% dict? [265] 0.1% *simplify-rules* [120] 0.1% -------------------------------------------------------------------------------------------- ??? [73] 100.0% [90] 259138(17.5%) 0(0.0%) baseline-error ...ime-testing/src/points.rkt:291:0 loop [211] 100.0% -------------------------------------------------------------------------------------------- generic-sort/key [75] 46.5% copying-mergesort [91] 53.5% [91] 90088(6.1%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [91] 53.5% loop [106] 35.8% jloop [108] 10.7% -------------------------------------------------------------------------------------------- run-improve50 [2] 4.0% ??? [73] 96.0% [92] 74890(5.1%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 loop [110] 35.9% loop [125] 33.9% make-exacts* [126] 29.4% for-loop [118] 0.9% -------------------------------------------------------------------------------------------- atab-add-altns [86] 6.6% for-loop [77] 93.4% [93] 35132(2.4%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [109] 80.7% override-at-pnts [112] 16.4% loop [117] 1.9% loop [211] 1.0% -------------------------------------------------------------------------------------------- ??? [79] 18.7% matcher [128] 81.3% [94] 11188(0.8%) 1316(0.1%) rewriter ...ime-testing/src/core/matcher.rkt:131:2 for-loop [111] 83.0% expression->type [113] 6.7% *rules* [114] 4.4% f6 [174] 4.0% -------------------------------------------------------------------------------------------- extract-alt [43] 42.3% best-alt [81] 57.7% [95] 8414(0.6%) 0(0.0%) loop ...herbie/regime-testing/src/common.rkt:154:2 composed [189] 100.0% -------------------------------------------------------------------------------------------- for-loop [252] 2.0% ??? [236] 19.9% ...sting/src/common.rkt:48:2 [78] 78.1% [96] 8266(0.6%) 1996(0.1%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [236] 65.4% ??? [258] 14.0% ??? [226] 4.4% -------------------------------------------------------------------------------------------- ...sting/src/common.rkt:48:2 [78] 100.0% [97] 7242(0.5%) 654(0.0%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [104] 45.8% return/no-unsupplied [107] 32.1% assoc-ref [116] 13.1% -------------------------------------------------------------------------------------------- taylor-alt [82] 100.0% [98] 5542(0.4%) 0(0.0%) for-loop ...rbie/regime-testing/src/glue.rkt:139:6 ??? [64] 100.0% -------------------------------------------------------------------------------------------- approximate9 [83] 100.0% [99] 5204(0.4%) 0(0.0%) loop ...ie/regime-testing/src/core/taylor.rkt:86:4 hash-ref! [177] 68.0% ??? [64] 25.8% for-loop [121] 6.1% -------------------------------------------------------------------------------------------- extract-alt [43] 20.1% best-alt [81] 79.9% [100] 1652(0.1%) 0(0.0%) argmins ...bie/regime-testing/src/common.rkt:153:0 composed [189] 100.0% -------------------------------------------------------------------------------------------- ??? [73] 100.0% [101] 452(0.0%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:238:2 ??? [131] 100.0% -------------------------------------------------------------------------------------------- oracle-error [88] 100.0% [102] 332616(22.5%) 662(0.0%) for-loop ...ie/regime-testing/src/points.rkt:288:2 loop [211] 66.1% map [123] 33.6% -------------------------------------------------------------------------------------------- ??? [89] 100.0% [103] 141628(9.6%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [122] 99.1% -------------------------------------------------------------------------------------------- ulp-difference [55] 2.5% ??? [97] 3.5% ??? [89] 29.4% ??? [74] 64.6% [104] 94508(6.4%) 20560(1.4%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [124] 71.9% ??? [258] 6.4% -------------------------------------------------------------------------------------------- ??? [89] 100.0% [105] 83216(5.6%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ??? [89] 99.6% -------------------------------------------------------------------------------------------- generic-sort/key [75] 18.0% ??? [66] 19.4% copying-mergesort [91] 62.6% [106] 82396(5.6%) 320(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [50] 97.2% ??? [64] 2.0% errors-score [134] 0.4% -------------------------------------------------------------------------------------------- ??? [97] 3.1% ulp-difference [55] 3.5% ??? [89] 31.1% ??? [74] 62.4% [107] 76054(5.1%) 56216(3.8%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [127] 26.1% -------------------------------------------------------------------------------------------- generic-sort/key [75] 0.9% copying-mergesort [91] 99.1% [108] 38842(2.6%) 362(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [50] 93.3% ??? [64] 4.1% errors-score [134] 0.9% ??? [225] 0.8% -------------------------------------------------------------------------------------------- atab-add-altn [93] 100.0% [109] 28344(1.9%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [18] 85.6% alt-errors [7] 13.1% -------------------------------------------------------------------------------------------- prepare-points [92] 100.0% [110] 26866(1.8%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 make-exacts* [126] 51.3% loop [125] 47.3% loop [136] 1.4% -------------------------------------------------------------------------------------------- rewriter [94] 100.0% [111] 11188(0.8%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:134:10 matcher [128] 100.0% -------------------------------------------------------------------------------------------- atab-add-altn [93] 100.0% [112] 5778(0.4%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:145:0 eval-errors [18] 88.6% alt-errors [7] 11.4% -------------------------------------------------------------------------------------------- f6 [174] 7.1% for-loop [129] 25.1% rewriter [94] 67.7% [113] 3942(0.3%) 342(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [129] 97.1% -------------------------------------------------------------------------------------------- rewriter [94] 100.0% [114] 2884(0.2%) 0(0.0%) *rules* ...gime-testing/src/syntax/rules.rkt:565:0 for-loop [163] 100.0% -------------------------------------------------------------------------------------------- ??? [89] 100.0% [115] 2608(0.2%) 0(0.0%) mk-egraph ...ime-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [130] 88.5% mk-enode! [159] 11.5% -------------------------------------------------------------------------------------------- ??? [97] 42.3% debug7 [87] 57.7% [116] 2240(0.2%) 2240(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 -------------------------------------------------------------------------------------------- atab-add-altn [93] 100.0% [117] 650(0.0%) 0(0.0%) loop ...egime-testing/src/core/alt-table.rkt:182:2 loop [133] 100.0% -------------------------------------------------------------------------------------------- prepare-points [92] 100.0% [118] 644(0.0%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [131] 100.0% -------------------------------------------------------------------------------------------- ??? [89] 100.0% [119] 452(0.0%) 0(0.0%) loop .../herbie/regime-testing/src/points.rkt:66:6 random-exp [135] 100.0% -------------------------------------------------------------------------------------------- ??? [89] 100.0% [120] 360(0.0%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 for-loop [163] 100.0% -------------------------------------------------------------------------------------------- loop [99] 100.0% [121] 320(0.0%) 0(0.0%) for-loop ...gime-testing/src/core/taylor.rkt:95:29 ??? [132] 100.0% -------------------------------------------------------------------------------------------- iterate-egraph!13 [103] 100.0% [122] 140326(9.5%) 2318(0.2%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [137] 65.7% for-loop [139] 32.6% -------------------------------------------------------------------------------------------- ??? [141] 0.1% loop [211] 0.8% f6 [174] 3.7% for-loop [102] 95.3% [123] 117290(7.9%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [211] 93.6% ??? [4] 2.7% ??? [141] 1.2% f6 [174] 1.1% parse-loop145 [205] 0.6% simplify-node [169] 0.3% ??? [64] 0.1% -------------------------------------------------------------------------------------------- ??? [104] 100.0% [124] 67904(4.6%) 65610(4.4%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [227] 3.4% -------------------------------------------------------------------------------------------- loop [110] 33.3% prepare-points [92] 66.7% [125] 38086(2.6%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [211] 100.0% -------------------------------------------------------------------------------------------- loop [110] 38.5% prepare-points [92] 61.5% [126] 35784(2.4%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 loop [211] 91.6% eval-prog [138] 8.4% -------------------------------------------------------------------------------------------- return/no-unsupplied [107] 100.0% [127] 19838(1.3%) 19838(1.3%) filter ...t/collects/racket/private/list.rkt:256:2 -------------------------------------------------------------------------------------------- for-loop [140] 25.0% matcher [128] 25.4% for-loop [111] 49.6% [128] 11188(0.8%) 362(0.0%) matcher ...gime-testing/src/core/matcher.rkt:167:2 rewriter [94] 48.7% matcher [128] 25.4% for-loop [140] 25.0% for-loop [14] 0.3% variable? [25] 0.2% -------------------------------------------------------------------------------------------- expression->type [113] 100.0% [129] 3942(0.3%) 0(0.0%) for-loop ...regime-testing/src/type-check.rkt:52:5 f6 [174] 73.4% expression->type [113] 26.6% -------------------------------------------------------------------------------------------- mk-egraph [115] 22.1% mk-enode-rec! [130] 77.9% [130] 2308(0.2%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [130] 77.9% mk-enode! [159] 22.1% -------------------------------------------------------------------------------------------- loop [101] 41.2% for-loop [118] 58.8% [131] 1096(0.1%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 for-loop [142] 58.8% ??? [64] 41.2% -------------------------------------------------------------------------------------------- for-loop [121] 48.6% for-loop [46] 51.4% [132] 658(0.0%) 320(0.0%) ??? ...tract/private/arrow-higher-order.rkt:346:33 ??? [259] 51.4% -------------------------------------------------------------------------------------------- loop [117] 4.7% loop [133] 95.3% [133] 650(0.0%) 650(0.0%) loop ...are/racket/collects/racket/list.rkt:431:28 loop [133] 95.3% -------------------------------------------------------------------------------------------- loop [106] 48.1% jloop [108] 51.9% [134] 644(0.0%) 0(0.0%) errors-score ...egime-testing/src/points.rkt:298:0 loop [211] 51.9% loop [231] 48.1% -------------------------------------------------------------------------------------------- loop [119] 100.0% [135] 452(0.0%) 452(0.0%) random-exp .../regime-testing/src/common.rkt:254:0 -------------------------------------------------------------------------------------------- loop [110] 0.1% loop [136] 99.9% [136] 376(0.0%) 376(0.0%) loop ...herbie/regime-testing/src/points.rkt:130:2 loop [136] 99.9% -------------------------------------------------------------------------------------------- one-iter [122] 100.0% [137] 92212(6.2%) 648(0.0%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [143] 89.9% match-e [144] 7.9% reduce-to-single! [145] 1.5% -------------------------------------------------------------------------------------------- option-on-expr [3] 1.5% sindices->spoints [27] 1.9% sort-context-on-expr [21] 2.0% make-exacts* [126] 4.3% loop [211] 6.8% point->alt [42] 7.0% alt-errors [7] 76.5% [138] 69212(4.7%) 8906(0.6%) eval-prog ...regime-testing/src/programs.rkt:150:0 f6 [174] 75.7% hash-ref! [177] 7.6% ??? [146] 1.9% ??? [149] 0.5% go [148] 0.5% -------------------------------------------------------------------------------------------- for-loop [139] 49.0% one-iter [122] 51.0% [139] 45796(3.1%) 9900(0.7%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [139] 49.0% match-e [144] 39.2% -------------------------------------------------------------------------------------------- matcher [128] 100.0% [140] 11188(0.8%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:183:21 matcher [128] 100.0% -------------------------------------------------------------------------------------------- map [123] 18.2% loop [211] 81.8% [141] 3250(0.2%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [177] 88.6% taylor-invert [147] 10.4% map [123] 1.0% -------------------------------------------------------------------------------------------- ??? [131] 100.0% [142] 644(0.0%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:231:9 ??? [64] 100.0% -------------------------------------------------------------------------------------------- for-loop [137] 100.0% [143] 82914(5.6%) 672(0.0%) for-loop ...e-testing/src/core/simplify.rkt:148:10 mk-enode! [159] 29.2% substitute-e [150] 27.2% merge-egraph-nodes! [152] 21.7% loop! [161] 18.6% list-member? [153] 2.5% -------------------------------------------------------------------------------------------- for-loop [137] 10.6% for-loop [160] 20.6% for-loop [139] 68.8% [144] 43200(2.9%) 17456(1.2%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [151] 38.5% ??? [67] 10.3% for-loop [160] 8.2% variable? [25] 3.2% list-cartesian-product [165] 2.9% curry* [156] 0.8% loop [211] 0.4% -------------------------------------------------------------------------------------------- for-loop [137] 100.0% [145] 1346(0.1%) 332(0.0%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 make-sequence [180] 75.3% -------------------------------------------------------------------------------------------- eval-prog [138] 100.0% [146] 1334(0.1%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [155] 100.0% -------------------------------------------------------------------------------------------- ??? [141] 100.0% [147] 338(0.0%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [154] 100.0% -------------------------------------------------------------------------------------------- eval-prog [138] 100.0% [148] 324(0.0%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [157] 100.0% -------------------------------------------------------------------------------------------- eval-prog [138] 100.0% [149] 324(0.0%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [158] 100.0% -------------------------------------------------------------------------------------------- substitute-e [150] 4.0% for-loop [143] 96.0% [150] 22574(1.5%) 0(0.0%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [159] 92.6% substitute-e [150] 4.0% ??? [67] 2.0% variable? [25] 1.4% -------------------------------------------------------------------------------------------- match-e [144] 100.0% [151] 21780(1.5%) 8412(0.6%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [160] 54.9% loop [211] 5.9% list-cartesian-product [165] 3.1% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [152] 2.8% for-loop [166] 4.7% for-loop [143] 92.5% [152] 17980(1.2%) 644(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [162] 58.5% for-loop [164] 10.9% loop! [161] 6.4% enode-merge! [168] 5.7% for-loop [166] 4.7% make-sequence [180] 3.7% for-loop [163] 3.7% merge-egraph-nodes! [152] 2.8% -------------------------------------------------------------------------------------------- ??? [89] 12.0% for-loop [143] 27.5% ??? [74] 60.5% [153] 7662(0.5%) 5558(0.4%) list-member? ...llects/racket/private/set.rkt:24:0 loop [167] 18.4% member [170] 9.0% -------------------------------------------------------------------------------------------- for-loop [26] 5.8% taylor-invert [147] 6.5% loop [211] 6.6% hash-ref! [177] 81.1% [154] 5222(0.4%) 0(0.0%) simplify ...egime-testing/src/core/reduce.rkt:16:0 f6 [174] 68.6% parse-loop145 [205] 12.7% simplify-node [169] 12.1% debug-print [171] 6.6% -------------------------------------------------------------------------------------------- ??? [146] 100.0% [155] 1334(0.1%) 1334(0.1%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 -------------------------------------------------------------------------------------------- match-e [144] 100.0% [156] 342(0.0%) 0(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [172] 100.0% -------------------------------------------------------------------------------------------- go [148] 25.0% loop [157] 75.0% [157] 324(0.0%) 324(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [157] 75.0% -------------------------------------------------------------------------------------------- ??? [149] 100.0% [158] 324(0.0%) 0(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 maybe-cons-kwd [173] 100.0% -------------------------------------------------------------------------------------------- mk-egraph [115] 0.6% mk-enode-rec! [130] 4.8% substitute-e [150] 43.8% for-loop [143] 50.7% [159] 47692(3.2%) 2976(0.2%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [175] 91.7% hash-has-key? [176] 1.4% -------------------------------------------------------------------------------------------- match-e [144] 30.4% for-loop [151] 69.6% [160] 18180(1.2%) 1300(0.1%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [144] 88.4% ??? [182] 5.3% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [152] 6.8% loop [211] 30.8% for-loop [143] 62.3% [161] 17070(1.2%) 3056(0.2%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 loop [211] 36.6% custom-set-union [179] 36.1% set [192] 12.7% update-en-expr [240] 5.6% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [152] 100.0% [162] 11358(0.8%) 1326(0.1%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [178] 79.5% hash-ref! [177] 5.8% make-sequence [180] 3.0% -------------------------------------------------------------------------------------------- *simplify-rules* [120] 9.2% merge-egraph-nodes! [152] 16.9% *rules* [114] 73.9% [163] 3902(0.3%) 1640(0.1%) for-loop ...ie/regime-testing/src/common.rkt:100:9 loop [181] 32.2% ormap [184] 16.5% flag-set? [198] 9.2% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [152] 100.0% [164] 1964(0.1%) 984(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:233:6 update-en-expr [240] 49.9% -------------------------------------------------------------------------------------------- for-loop [151] 17.3% match-e [144] 40.5% list-cartesian-product [165] 42.2% [165] 1940(0.1%) 1642(0.1%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [165] 42.2% for-loop [186] 7.7% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [152] 100.0% [166] 1700(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [152] 100.0% -------------------------------------------------------------------------------------------- list-member? [153] 100.0% [167] 1412(0.1%) 1412(0.1%) loop (unknown source) -------------------------------------------------------------------------------------------- merge-egraph-nodes! [152] 100.0% [168] 1032(0.1%) 0(0.0%) enode-merge! ...e-testing/src/core/enode.rkt:129:0 adopt-enode! [183] 66.3% custom-set-intersect! [185] 33.7% -------------------------------------------------------------------------------------------- map [123] 32.2% simplify [154] 67.8% [169] 932(0.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 append-map [197] 67.4% f6 [174] 32.6% -------------------------------------------------------------------------------------------- list-member? [153] 100.0% [170] 692(0.0%) 692(0.0%) member (unknown source) -------------------------------------------------------------------------------------------- simplify [154] 100.0% [171] 346(0.0%) 346(0.0%) debug-print .../regime-testing/src/debug.rkt:107:0 -------------------------------------------------------------------------------------------- curry* [156] 100.0% [172] 342(0.0%) 342(0.0%) procedure-arity ...ket/private/norm-arity.rkt:7:27 -------------------------------------------------------------------------------------------- unpack245 [158] 100.0% [173] 324(0.0%) 0(0.0%) maybe-cons-kwd ...ate/arrow-higher-order.rkt:498:0 arrow-higher-order:lnp [209] 100.0% -------------------------------------------------------------------------------------------- for-loop [46] 0.0% composed [189] 0.0% for-loop [62] 0.0% approximate9 [83] 0.0% simplify-node [169] 0.0% free-variables [10] 0.0% mterm->expr [261] 0.1% map [123] 0.2% append-map [197] 0.3% simplify [154] 0.3% hash-ref! [177] 0.4% rewriter [94] 0.5% for-loop [129] 0.8% eval-prog [138] 1.4% f6 [174] 8.5% split-table [37] 87.4% [174] 475476(32.2%) 2914(0.2%) f6 ...et/collects/racket/match/compiler.rkt:507:40 loop [211] 84.5% f6 [174] 8.5% option-on-expr [3] 2.9% ??? [64] 1.3% map [123] 0.8% ??? [212] 0.5% ??? [89] 0.4% append-map [197] 0.3% ??? [67] 0.2% ...sting/src/common.rkt:48:2 [78] 0.2% expression->type [113] 0.1% composed [189] 0.0% exprs-to-branch-on [12] 0.0% combine-mterms [16] 0.0% -------------------------------------------------------------------------------------------- mk-enode! [159] 100.0% [175] 43722(3.0%) 0(0.0%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [188] 99.2% set [192] 0.8% -------------------------------------------------------------------------------------------- mk-enode! [159] 2.2% ??? [67] 97.8% [176] 29878(2.0%) 5836(0.4%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [187] 78.3% ??? [199] 2.2% -------------------------------------------------------------------------------------------- for-loop [34] 0.3% for-loop [47] 0.5% ??? [44] 2.6% ??? [194] 2.6% for-loop [29] 2.6% localize-error [60] 3.2% loop [99] 3.6% update-leader! [162] 3.7% for-loop [26] 4.2% ??? [193] 5.0% ??? [64] 5.7% compile [85] 7.4% eval-prog [138] 9.6% ??? [141] 13.0% ??? [191] 16.2% loop [211] 19.8% [177] 17994(1.2%) 7200(0.5%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [191] 36.2% parse-loop145 [205] 14.1% ??? [8] 7.1% ??? [194] 6.2% ??? [193] 5.0% simplify [154] 4.7% bigfloat-hash [196] 4.7% ??? [9] 2.6% f6 [174] 2.0% ??? [11] 0.5% ??? [15] 0.1% -------------------------------------------------------------------------------------------- update-leader! [162] 100.0% [178] 9028(0.6%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [190] 100.0% -------------------------------------------------------------------------------------------- loop! [161] 100.0% [179] 6664(0.5%) 2982(0.2%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [195] 50.3% for-loop [201] 4.9% -------------------------------------------------------------------------------------------- update-leader! [162] 17.0% merge-egraph-nodes! [152] 32.7% reduce-to-single! [145] 50.3% [180] 2014(0.1%) 1682(0.1%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [200] 16.5% -------------------------------------------------------------------------------------------- for-loop [163] 100.0% [181] 1258(0.1%) 0(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [198] 75.5% curried [228] 24.5% -------------------------------------------------------------------------------------------- for-loop [160] 100.0% [182] 970(0.1%) 970(0.1%) ??? ...bie/regime-testing/src/core/ematch.rkt:50:5 -------------------------------------------------------------------------------------------- enode-merge! [168] 100.0% [183] 684(0.0%) 684(0.0%) adopt-enode! ...e-testing/src/core/enode.rkt:105:0 -------------------------------------------------------------------------------------------- for-loop [163] 100.0% [184] 644(0.0%) 0(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [198] 100.0% -------------------------------------------------------------------------------------------- enode-merge! [168] 100.0% [185] 348(0.0%) 348(0.0%) custom-set-intersect! ...ivate/set-types.rkt:269:0 -------------------------------------------------------------------------------------------- list-cartesian-product [165] 100.0% [186] 298(0.0%) 298(0.0%) for-loop ...egime-testing/src/core/ematch.rkt:24:8 -------------------------------------------------------------------------------------------- hash-has-key? [176] 34.7% ??? [89] 65.3% [187] 67406(4.6%) 24192(1.6%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [203] 48.7% ??? [220] 13.0% ??? [236] 1.5% successfully-got-the-right-kind-of-function [215] 0.5% arrow-higher-order:lnp [209] 0.5% -------------------------------------------------------------------------------------------- new-enode [175] 100.0% [188] 43388(2.9%) 332(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [202] 99.2% -------------------------------------------------------------------------------------------- f6 [174] 6.1% argmins [100] 15.4% loop [95] 78.5% [189] 10716(0.7%) 338(0.0%) composed ...ollects/racket/private/list.rkt:321:16 eval-errors [18] 87.8% alt-errors [7] 6.2% f6 [174] 2.9% -------------------------------------------------------------------------------------------- for-loop [178] 100.0% [190] 9028(0.6%) 324(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [204] 96.4% -------------------------------------------------------------------------------------------- hash-ref! [177] 100.0% [191] 8582(0.6%) 0(0.0%) ??? ...erbie/regime-testing/src/programs.rkt:194:5 loop [211] 54.0% hash-ref! [177] 46.0% -------------------------------------------------------------------------------------------- new-enode [175] 7.1% loop! [161] 92.9% [192] 4672(0.3%) 4672(0.3%) set ...collects/racket/private/set-types.rkt:981:0 -------------------------------------------------------------------------------------------- hash-ref! [177] 100.0% [193] 4538(0.3%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:44:15 hash-ref! [177] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [177] 100.0% [194] 3540(0.2%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:67:15 ??? [64] 65.4% hash-ref! [177] 34.6% -------------------------------------------------------------------------------------------- custom-set-union [179] 100.0% [195] 3354(0.2%) 1330(0.1%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [207] 60.3% -------------------------------------------------------------------------------------------- hash-ref! [177] 100.0% [196] 2990(0.2%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [206] 78.3% sig+exp->bigfloat [208] 21.7% -------------------------------------------------------------------------------------------- append-map [197] 6.6% simplify-node [169] 20.2% f6 [174] 73.2% [197] 2300(0.2%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 f6 [174] 58.8% parse-loop145 [205] 26.8% free-variables [10] 7.8% append-map [197] 6.6% -------------------------------------------------------------------------------------------- for-loop [163] 18.4% ormap [184] 33.0% loop [181] 48.6% [198] 1954(0.1%) 1954(0.1%) flag-set? ...ie/regime-testing/src/config.rkt:34:0 -------------------------------------------------------------------------------------------- hash-has-key? [176] 100.0% [199] 652(0.0%) 652(0.0%) ??? ...ects/racket/contract/private/hash.rkt:245:7 -------------------------------------------------------------------------------------------- make-sequence [180] 100.0% [200] 332(0.0%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [210] 100.0% -------------------------------------------------------------------------------------------- custom-set-union [179] 100.0% [201] 328(0.0%) 328(0.0%) for-loop ...cts/racket/private/set-types.rkt:152:2 -------------------------------------------------------------------------------------------- type-of-enode-expr [188] 100.0% [202] 43056(2.9%) 2430(0.2%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ??? [89] 36.5% ??? [212] 32.7% ??? [67] 15.6% ...sting/src/common.rkt:48:2 [78] 9.6% -------------------------------------------------------------------------------------------- ??? [187] 100.0% [203] 32842(2.2%) 18378(1.2%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [220] 20.1% for-loop [221] 17.0% ??? [226] 6.0% successfully-got-the-right-kind-of-function [215] 1.0% -------------------------------------------------------------------------------------------- for-loop [190] 100.0% [204] 8704(0.6%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [213] 100.0% -------------------------------------------------------------------------------------------- for-loop [33] 1.7% loop [211] 2.7% simplify [154] 4.4% parse-loop145 [205] 8.0% ??? [63] 11.9% map [123] 12.1% append-map [197] 12.5% hash-ref! [177] 46.7% [205] 6242(0.4%) 2042(0.1%) parse-loop145 .../racket/match/compiler.rkt:418:15 loop [211] 46.2% make-multiplication-node [214] 12.5% parse-loop145 [205] 8.0% loop [217] 3.1% -------------------------------------------------------------------------------------------- bigfloat-hash [196] 100.0% [206] 2342(0.2%) 2342(0.2%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 -------------------------------------------------------------------------------------------- for-loop [195] 100.0% [207] 2024(0.1%) 2024(0.1%) for-loop ...cts/racket/private/set-types.rkt:178:5 -------------------------------------------------------------------------------------------- bigfloat-hash [196] 100.0% [208] 648(0.0%) 648(0.0%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 -------------------------------------------------------------------------------------------- ??? [187] 48.9% maybe-cons-kwd [173] 51.1% [209] 634(0.0%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [216] 100.0% -------------------------------------------------------------------------------------------- ??? [200] 100.0% [210] 332(0.0%) 332(0.0%) custom-in-set ...acket/private/set-types.rkt:577:0 -------------------------------------------------------------------------------------------- errors-score [134] 0.0% oracle-error [88] 0.0% atab-add-altn [93] 0.0% match-e [144] 0.0% make-exacts* [126] 0.0% loop [125] 0.0% ??? [73] 0.1% for-loop [151] 0.1% parse-loop145 [205] 0.1% loop! [161] 0.3% ??? [191] 0.4% ??? [50] 0.6% map [123] 1.6% for-loop [102] 2.2% baseline-error [90] 2.9% option-on-expr [3] 3.0% f6 [174] 7.3% loop [211] 81.3% [211] 1138224(77.0%) 12404(0.8%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [211] 81.3% option-on-expr [3] 7.3% eval-errors [18] 3.4% ??? [4] 2.4% ??? [5] 1.9% ??? [50] 1.4% ??? [64] 0.5% alt-errors [7] 0.4% hash-ref! [177] 0.3% loop! [161] 0.3% ??? [141] 0.1% eval-prog [138] 0.1% simplify [154] 0.0% ??? [219] 0.0% curried [228] 0.0% map [123] 0.0% parse-loop145 [205] 0.0% foldl [235] 0.0% ulp-difference [55] 0.0% loop [233] 0.0% ??? [218] 0.0% for-loop [229] 0.0% ??? [225] 0.0% loop [231] 0.0% ??? [224] 0.0% -------------------------------------------------------------------------------------------- for-loop [68] 8.8% f6 [174] 11.2% ??? [64] 18.4% get-sigs [202] 61.5% [212] 22900(1.5%) 3022(0.2%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [223] 35.2% for-loop [221] 30.6% get/build-late-neg-projection [262] 9.9% ??? [230] 5.3% ??? [220] 3.0% ??? [226] 1.5% ??? [227] 1.4% -------------------------------------------------------------------------------------------- hash-update! [204] 100.0% [213] 8704(0.6%) 0(0.0%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [222] 100.0% -------------------------------------------------------------------------------------------- parse-loop145 [205] 100.0% [214] 932(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [232] 100.0% -------------------------------------------------------------------------------------------- for-loop [203] 48.2% ??? [187] 51.8% [215] 668(0.0%) 322(0.0%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [234] 51.8% -------------------------------------------------------------------------------------------- arrow-higher-order:lnp [209] 100.0% [216] 634(0.0%) 634(0.0%) ??? ...et/contract/private/arity-checking.rkt:19:2 -------------------------------------------------------------------------------------------- parse-loop145 [205] 7.3% loop [217] 92.7% [217] 630(0.0%) 298(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [217] 92.7% ??? [64] 6.6% -------------------------------------------------------------------------------------------- loop [211] 2.3% bf* [80] 11.6% ??? [63] 86.1% [218] 57244(3.9%) 42938(2.9%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [237] 19.5% bfsin [242] 5.5% -------------------------------------------------------------------------------------------- for-loop [41] 38.6% loop [211] 61.4% [219] 16284(1.1%) 0(0.0%) ??? ...e/regime-testing/src/core/regimes.rkt:194:2 ??? [50] 98.1% ??? [64] 1.9% -------------------------------------------------------------------------------------------- ??? [212] 4.2% for-loop [203] 41.3% ??? [187] 54.5% [220] 16028(1.1%) 5808(0.4%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [238] 63.8% -------------------------------------------------------------------------------------------- for-loop [203] 44.3% ??? [212] 55.7% [221] 12582(0.9%) 2612(0.2%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [236] 74.1% ??? [259] 5.2% -------------------------------------------------------------------------------------------- ??? [213] 100.0% [222] 8704(0.6%) 6670(0.5%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 update-en-expr [240] 23.4% -------------------------------------------------------------------------------------------- ??? [212] 100.0% [223] 8050(0.5%) 370(0.0%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [239] 95.4% -------------------------------------------------------------------------------------------- loop [211] 42.3% ??? [50] 57.7% [224] 5330(0.4%) 820(0.1%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [241] 84.6% -------------------------------------------------------------------------------------------- jloop [108] 11.6% for-loop [36] 13.6% loop [211] 36.0% ??? [50] 38.7% [225] 2670(0.2%) 2306(0.2%) ??? ...tract/private/arrow-higher-order.rkt:145:21 ??? [259] 13.6% -------------------------------------------------------------------------------------------- ??? [212] 12.6% ??? [96] 13.7% for-loop [203] 73.8% [226] 2652(0.2%) 1058(0.1%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [243] 60.1% -------------------------------------------------------------------------------------------- ??? [212] 12.4% ??? [124] 87.6% [227] 2618(0.2%) 2618(0.2%) ??? ...ects/racket/contract/private/prop.rkt:256:4 -------------------------------------------------------------------------------------------- for-loop [57] 19.3% loop [181] 19.5% loop [211] 20.4% for-loop [70] 40.8% [228] 1582(0.1%) 1582(0.1%) curried ...cket/collects/racket/function.rkt:71:18 -------------------------------------------------------------------------------------------- loop [211] 100.0% [229] 1302(0.1%) 664(0.0%) for-loop ...me-testing/src/core/simplify.rkt:195:2 setfindf [245] 49.0% -------------------------------------------------------------------------------------------- ??? [212] 100.0% [230] 1222(0.1%) 630(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:69:2 get-blame-party-info [246] 48.4% -------------------------------------------------------------------------------------------- loop [211] 32.1% errors-score [134] 32.8% ??? [5] 35.1% [231] 946(0.1%) 946(0.1%) loop ...hare/racket/collects/racket/list.rkt:551:2 -------------------------------------------------------------------------------------------- make-multiplication-node [214] 100.0% [232] 932(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [244] 100.0% -------------------------------------------------------------------------------------------- loop [211] 0.8% loop [233] 99.2% [233] 360(0.0%) 360(0.0%) loop ...ket/collects/racket/private/list.rkt:82:16 loop [233] 99.2% -------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [215]100.0% [234] 346(0.0%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [247] 100.0% -------------------------------------------------------------------------------------------- loop [211] 100.0% [235] 310(0.0%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [248] 100.0% -------------------------------------------------------------------------------------------- ??? [187] 5.2% ??? [89] 7.1% ??? [96] 38.3% for-loop [221] 49.4% [236] 18854(1.3%) 4854(0.3%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [249] 44.3% ??? [96] 17.5% for-loop [252] 9.0% ??? [259] 3.4% -------------------------------------------------------------------------------------------- ??? [218] 100.0% [237] 11154(0.8%) 7406(0.5%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [251] 33.6% -------------------------------------------------------------------------------------------- ??? [220] 100.0% [238] 10220(0.7%) 10220(0.7%) make-keyword-procedure ...ket/private/kw.rkt:260:4 -------------------------------------------------------------------------------------------- ??? [223] 100.0% [239] 7680(0.5%) 334(0.0%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [250] 95.7% -------------------------------------------------------------------------------------------- for-loop [164] 19.4% loop! [161] 40.2% for-loop [222] 40.4% [240] 5040(0.3%) 4718(0.3%) update-en-expr ...esting/src/core/egraph.rkt:212:0 for-loop [257] 6.4% -------------------------------------------------------------------------------------------- ??? [224] 100.0% [241] 4510(0.3%) 3826(0.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [251] 15.2% -------------------------------------------------------------------------------------------- ??? [218] 100.0% [242] 3152(0.2%) 2820(0.2%) bfsin ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [251] 10.5% -------------------------------------------------------------------------------------------- ??? [226] 100.0% [243] 1594(0.1%) 658(0.0%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [253] 58.7% -------------------------------------------------------------------------------------------- make-multiplication-subnode [232] 100.0% [244] 932(0.1%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:242:3 make-multiplication-subsubsubnode [254] 67.4% mterm->expr [261] 32.6% -------------------------------------------------------------------------------------------- for-loop [229] 100.0% [245] 638(0.0%) 312(0.0%) setfindf ...ie/regime-testing/src/common.rkt:187:0 for-loop [256] 51.1% -------------------------------------------------------------------------------------------- ??? [230] 100.0% [246] 592(0.0%) 0(0.0%) get-blame-party-info ...ate/arrow-common.rkt:136:0 show-blame-positive [255] 100.0% -------------------------------------------------------------------------------------------- arity-checking-wrapper [234] 100.0% [247] 346(0.0%) 346(0.0%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 -------------------------------------------------------------------------------------------- foldl [235] 100.0% [248] 310(0.0%) 310(0.0%) merge2 .../regime-testing/src/core/ematch.rkt:31:0 -------------------------------------------------------------------------------------------- ??? [236] 100.0% [249] 8360(0.6%) 1710(0.1%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [258] 71.5% ??? [259] 8.0% -------------------------------------------------------------------------------------------- ??? [239] 100.0% [250] 7346(0.5%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [260] 100.0% -------------------------------------------------------------------------------------------- bfsin [242] 7.0% real->bigfloat [241] 14.4% bfmul [237] 78.7% [251] 4764(0.3%) 4764(0.3%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 -------------------------------------------------------------------------------------------- ??? [236] 100.0% [252] 1700(0.1%) 1368(0.1%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [96] 19.5% -------------------------------------------------------------------------------------------- check-hash/c [243] 100.0% [253] 936(0.1%) 936(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 -------------------------------------------------------------------------------------------- for-loop [244] 100.0% [254] 628(0.0%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [261] 100.0% -------------------------------------------------------------------------------------------- get-blame-party-info [246] 100.0% [255] 592(0.0%) 592(0.0%) show-blame-positive ...act/private/blame.rkt:150:0 -------------------------------------------------------------------------------------------- setfindf [245] 100.0% [256] 326(0.0%) 326(0.0%) for-loop ...ie/regime-testing/src/common.rkt:188:2 -------------------------------------------------------------------------------------------- update-en-expr [240] 100.0% [257] 322(0.0%) 322(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:214:6 -------------------------------------------------------------------------------------------- ??? [96] 7.8% ??? [249] 20.2% ??? [104] 20.4% ??? [64] 51.6% [258] 29604(2.0%) 11032(0.7%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [67] 51.6% contract? [264] 7.8% dict? [265] 3.4% -------------------------------------------------------------------------------------------- ??? [132] 3.4% ??? [225] 3.6% ??? [236] 6.5% for-loop [221] 6.5% ??? [249] 6.7% ??? [63] 73.3% [259] 10024(0.7%) 8648(0.6%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [266] 13.7% -------------------------------------------------------------------------------------------- ??? [250] 100.0% [260] 7346(0.5%) 2096(0.1%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [263] 48.9% get/build-late-neg-projection [262] 22.6% -------------------------------------------------------------------------------------------- for-loop [244] 32.6% make-multiplication-subsubsubnode [254] 67.4% [261] 932(0.1%) 0(0.0%) mterm->expr ...e-testing/src/core/reduce.rkt:270:0 f6 [174] 100.0% -------------------------------------------------------------------------------------------- ??? [270] 8.0% unconstrained-domain->-projection [268] 16.9% ??? [212] 32.8% for-loop [260] 42.3% [262] 3920(0.3%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [267] 67.2% unconstrained-domain->-projection [268] 16.9% ??? [270] 15.9% -------------------------------------------------------------------------------------------- for-loop [260] 100.0% [263] 3590(0.2%) 3590(0.2%) add-list-context ...ontract/private/list.rkt:752:0 -------------------------------------------------------------------------------------------- ??? [258] 100.0% [264] 2318(0.2%) 2318(0.2%) contract? ...acket/contract/private/guts.rkt:109:0 -------------------------------------------------------------------------------------------- ??? [258] 43.5% ??? [89] 56.5% [265] 2280(0.2%) 2280(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 -------------------------------------------------------------------------------------------- ??? [259] 100.0% [266] 1376(0.1%) 368(0.0%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [269] 73.3% -------------------------------------------------------------------------------------------- get/build-late-neg-projection [262] 100.0% [267] 3608(0.2%) 662(0.0%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [271] 81.7% -------------------------------------------------------------------------------------------- get/build-late-neg-projection [262] 100.0% [268] 1322(0.1%) 0(0.0%) unconstrained-domain->-projection ...rrow.rkt:60:0 get/build-late-neg-projection [262] 100.0% -------------------------------------------------------------------------------------------- ??? [266] 100.0% [269] 1008(0.1%) 1008(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 -------------------------------------------------------------------------------------------- get/build-late-neg-projection [262] 100.0% [270] 938(0.1%) 312(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [262] 66.7% -------------------------------------------------------------------------------------------- ??? [267] 100.0% [271] 2946(0.2%) 2262(0.2%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [272] 23.2% -------------------------------------------------------------------------------------------- build-compound-type-name [271] 100.0% [272] 684(0.0%) 684(0.0%) contract-struct-name ...ract/private/prop.rkt:89:0 --------------------------------------------------------------------------------------------