Profiling results ----------------- Total cpu time observed: 543034ms (out of 545368ms) Number of samples taken: 1685 (once every 322ms) (Hiding functions with self<1.0% and local<2.0%: 11 of 245 hidden) ========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================== ??? [64] 100.0% [1] 477168(87.9%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [16] 100.0% ------------------------------------------------------------------------------------------ ??? [64] 100.0% [2] 328630(60.5%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 for-loop [17] 91.2% get-final-combination [21] 7.8% prepare-points [82] 1.0% ------------------------------------------------------------------------------------------ ->flonum [171] 100.0% [3] 255764(47.1%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [18] 98.7% debug-print [48] 0.1% ------------------------------------------------------------------------------------------ ->flonum [171] 100.0% [4] 49602(9.1%) 312(0.1%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [20] 99.4% ------------------------------------------------------------------------------------------ loop [123] 100.0% [5] 31448(5.8%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:293:24 eval-errors [19] 100.0% ------------------------------------------------------------------------------------------ map [117] 2.0% loop [123] 98.0% [6] 20120(3.7%) 200(0.0%) ??? ...herbie/regime-testing/src/points.rkt:289:26 ??? [36] 85.1% ulp-difference [45] 7.4% ??? [159] 6.5% ------------------------------------------------------------------------------------------ ??? [159] 100.0% [7] 10622(2.0%) 0(0.0%) approximate9 ...e-testing/src/core/taylor.rkt:12:0 loop [22] 87.9% f66 [110] 12.1% ------------------------------------------------------------------------------------------ hash-ref! [173] 100.0% [8] 7288(1.3%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:285:26 for-loop [23] 100.0% ------------------------------------------------------------------------------------------ substitute-e [54] 18.8% match-e [38] 81.2% [9] 7016(1.3%) 0(0.0%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [134] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [173] 100.0% [10] 6366(1.2%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:295:23 for-loop [24] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [173] 100.0% [11] 5334(1.0%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:338:33 hash-ref! [173] 55.5% for-loop [25] 44.5% ------------------------------------------------------------------------------------------ copying-mergesort [188] 100.0% [12] 2310(0.4%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [36] 100.0% ------------------------------------------------------------------------------------------ for-loop [170] 22.9% loop [123] 77.1% [13] 1396(0.3%) 0(0.0%) ??? ...e/regime-testing/src/core/regimes.rkt:194:2 ??? [36] 100.0% ------------------------------------------------------------------------------------------ f66 [110] 100.0% [14] 328(0.1%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [32] 100.0% ------------------------------------------------------------------------------------------ f66 [110] 100.0% [15] 312(0.1%) 0(0.0%) loop ...ie/regime-testing/src/core/reduce.rkt:18:2 expression->type [99] 100.0% ------------------------------------------------------------------------------------------ profile-thunk16 [1] 100.0% [16] 477366(87.9%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [64] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [2] 100.0% [17] 299826(55.2%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [26] 100.0% ------------------------------------------------------------------------------------------ iterate-egraph!13 [3] 100.0% [18] 252442(46.5%) 3832(0.7%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [27] 66.6% for-loop [28] 31.6% loop [198] 0.3% ------------------------------------------------------------------------------------------ ??? [64] 1.5% override-at-pnts [178] 2.2% option-on-expr [136] 3.2% composed [207] 3.4% best-and-tied-at-points [172] 21.7% loop [123] 24.9% ??? [5] 43.1% [19] 72952(13.4%) 0(0.0%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [29] 100.0% ------------------------------------------------------------------------------------------ loop [4] 100.0% [20] 49290(9.1%) 0(0.0%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [30] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [2] 100.0% [21] 25524(4.7%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:266:0 split-table [31] 95.8% extract-alt [34] 4.2% ------------------------------------------------------------------------------------------ approximate9 [7] 100.0% [22] 9332(1.7%) 0(0.0%) loop ...ie/regime-testing/src/core/taylor.rkt:86:4 hash-ref! [173] 81.9% ??? [159] 18.1% ------------------------------------------------------------------------------------------ ??? [8] 100.0% [23] 7288(1.3%) 324(0.1%) for-loop ...ime-testing/src/core/taylor.rkt:285:52 hash-ref! [173] 71.2% ??? [33] 15.7% simplify [32] 8.7% ------------------------------------------------------------------------------------------ ??? [10] 100.0% [24] 6366(1.2%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:298:27 hash-ref! [173] 100.0% ------------------------------------------------------------------------------------------ ??? [11] 100.0% [25] 2702(0.5%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:341:46 hash-ref! [173] 100.0% ------------------------------------------------------------------------------------------ for-loop [17] 100.0% [26] 299826(55.2%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [35] 85.2% finalize-iter! [40] 8.0% gen-series! [41] 3.5% gen-rewrites! [43] 2.0% localize-error [46] 0.7% choose-best-alt! [47] 0.6% ------------------------------------------------------------------------------------------ one-iter [18] 100.0% [27] 168150(31.0%) 1044(0.2%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [37] 88.5% match-e [38] 10.1% update-leader! [68] 0.4% reduce-to-single! [49] 0.4% ------------------------------------------------------------------------------------------ for-loop [28] 49.0% one-iter [18] 51.0% [28] 79784(14.7%) 20416(3.8%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [28] 49.0% match-e [38] 37.0% ??? [89] 0.2% ------------------------------------------------------------------------------------------ eval-errors [19] 100.0% [29] 72952(13.4%) 5206(1.0%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [36] 84.3% ??? [159] 6.2% ulp-difference [45] 2.4% ------------------------------------------------------------------------------------------ pass [20] 100.0% [30] 49290(9.1%) 360(0.1%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [39] 72.9% loop [42] 16.7% for-loop [44] 8.3% make-sequence [61] 1.4% ------------------------------------------------------------------------------------------ get-final-combination [21] 100.0% [31] 24444(4.5%) 0(0.0%) split-table ...e/regime-testing/src/glue.rkt:162:0 f66 [110] 100.0% ------------------------------------------------------------------------------------------ taylor-invert [14] 3.6% for-loop [23] 7.0% loop [123] 7.4% hash-ref! [173] 82.0% [32] 9006(1.7%) 0(0.0%) simplify ...egime-testing/src/core/reduce.rkt:16:0 parse-loop79 [190] 41.1% f66 [110] 40.4% debug7 [78] 14.8% debug-print [48] 3.7% ------------------------------------------------------------------------------------------ for-loop [23] 100.0% [33] 2016(0.4%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:288:19 hash-ref! [173] 100.0% ------------------------------------------------------------------------------------------ get-final-combination [21] 100.0% [34] 1080(0.2%) 0(0.0%) extract-alt ...ie/regime-testing/src/glue.rkt:55:0 loop [196] 66.7% argmins [197] 33.3% ------------------------------------------------------------------------------------------ run-iter! [26] 100.0% [35] 255438(47.0%) 0(0.0%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [50] 100.0% ------------------------------------------------------------------------------------------ loop [103] 0.4% ??? [13] 0.8% jloop [12] 1.3% loop [205] 3.2% ??? [6] 9.6% for-loop [29] 34.6% loop [123] 50.1% [36] 177500(32.7%) 3268(0.6%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [51] 90.5% ??? [159] 5.3% ??? [60] 2.1% ??? [63] 0.2% ------------------------------------------------------------------------------------------ for-loop [27] 100.0% [37] 148802(27.4%) 642(0.1%) for-loop ...e-testing/src/core/simplify.rkt:148:10 mk-enode! [65] 33.2% substitute-e [54] 22.4% loop! [135] 20.4% merge-egraph-nodes! [55] 20.1% list-member? [58] 3.4% ------------------------------------------------------------------------------------------ for-loop [27] 13.8% for-loop [66] 23.0% for-loop [28] 63.2% [38] 75988(14.0%) 28470(5.2%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [52] 43.2% for-loop [66] 9.5% ??? [134] 5.4% variable? [9] 3.2% list-cartesian-product [72] 2.7% loop [123] 2.0% custom-in-set [100] 1.3% curry* [108] 0.9% filter [206] 0.4% ------------------------------------------------------------------------------------------ for-loop [94] 0.5% for-loop [30] 99.5% [39] 36124(6.7%) 198(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [53] 89.8% expression-cost [59] 9.7% ------------------------------------------------------------------------------------------ run-iter! [26] 100.0% [40] 23854(4.4%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [134] 100.0% ------------------------------------------------------------------------------------------ run-iter! [26] 100.0% [41] 10622(2.0%) 0(0.0%) gen-series! ...gime-testing/src/mainloop.rkt:129:0 for-loop [56] 100.0% ------------------------------------------------------------------------------------------ for-loop [30] 100.0% [42] 8254(1.5%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [53] 91.9% expression-cost [59] 8.1% ------------------------------------------------------------------------------------------ run-iter! [26] 100.0% [43] 6098(1.1%) 0(0.0%) gen-rewrites! ...me-testing/src/mainloop.rkt:142:0 for-loop [57] 100.0% ------------------------------------------------------------------------------------------ for-loop [30] 100.0% [44] 4078(0.8%) 4078(0.8%) for-loop ...e-testing/src/core/simplify.rkt:217:13 ------------------------------------------------------------------------------------------ loop [123] 15.9% ??? [6] 39.0% for-loop [29] 45.1% [45] 3808(0.7%) 2524(0.5%) ulp-difference ...egime-testing/src/float.rkt:19:0 ??? [223] 21.6% return/no-unsupplied [185] 12.1% ------------------------------------------------------------------------------------------ run-iter! [26] 100.0% [46] 2072(0.4%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [173] 84.4% ??? [162] 15.6% ------------------------------------------------------------------------------------------ run-iter! [26] 100.0% [47] 1742(0.3%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:115:0 ??? [134] 100.0% ------------------------------------------------------------------------------------------ simplify [32] 48.3% iterate-egraph!13 [3] 51.7% [48] 696(0.1%) 696(0.1%) debug-print .../regime-testing/src/debug.rkt:107:0 ------------------------------------------------------------------------------------------ for-loop [27] 100.0% [49] 662(0.1%) 0(0.0%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [62] 54.4% make-sequence [61] 45.6% ------------------------------------------------------------------------------------------ simplify! [35] 100.0% [50] 255438(47.0%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [64] 99.9% debug7 [78] 0.1% ------------------------------------------------------------------------------------------ ??? [36] 100.0% [51] 160720(29.6%) 57112(10.5%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [133] 46.3% ??? [67] 13.5% ??? [71] 4.2% ??? [229] 0.5% ------------------------------------------------------------------------------------------ match-e [38] 100.0% [52] 42580(7.8%) 16406(3.0%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [66] 51.1% list-cartesian-product [72] 8.2% loop [123] 3.6% filter [206] 0.8% foldl [139] 0.8% ------------------------------------------------------------------------------------------ loop [42] 19.0% argmin [39] 81.0% [53] 40008(7.4%) 330(0.1%) for-loop .../regime-testing/src/programs.rkt:210:2 ->flonum [171] 71.7% ...sting/src/common.rkt:48:2 [111] 25.8% ??? [116] 1.7% ------------------------------------------------------------------------------------------ substitute-e [54] 5.7% for-loop [37] 94.3% [54] 33282(6.1%) 636(0.1%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [65] 89.0% substitute-e [54] 5.7% ??? [134] 2.2% variable? [9] 1.7% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [55] 3.2% for-loop [77] 3.6% for-loop [37] 93.2% [55] 29916(5.5%) 660(0.1%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [68] 43.1% for-loop [70] 22.9% loop! [135] 17.8% for-loop [77] 7.0% merge-egraph-nodes! [55] 3.2% enode-merge! [80] 2.6% for-loop [209] 1.1% ------------------------------------------------------------------------------------------ gen-series! [41] 100.0% [56] 10622(2.0%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:135:7 taylor-alt [69] 100.0% ------------------------------------------------------------------------------------------ gen-rewrites! [43] 100.0% [57] 6098(1.1%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:147:11 ??? [73] 100.0% ------------------------------------------------------------------------------------------ for-loop [37] 100.0% [58] 5088(0.9%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [76] 73.7% member [79] 26.3% ------------------------------------------------------------------------------------------ loop [42] 16.0% argmin [39] 84.0% [59] 4172(0.8%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [74] 100.0% ------------------------------------------------------------------------------------------ ??? [36] 100.0% [60] 3768(0.7%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [75] 100.0% ------------------------------------------------------------------------------------------ reduce-to-single! [49] 31.0% for-loop [30] 69.0% [61] 974(0.2%) 672(0.1%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [81] 31.0% ------------------------------------------------------------------------------------------ reduce-to-single! [49] 100.0% [62] 360(0.1%) 360(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:326:8 ------------------------------------------------------------------------------------------ ??? [36] 100.0% [63] 352(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:145:21 ??? [227] 100.0% ------------------------------------------------------------------------------------------ for-loop [50] 15.9% run [16] 36.6% [64] 536528(98.8%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 36.6% ->flonum [171] 25.5% run-improve50 [2] 22.9% prepare-points [82] 7.4% baseline-error [84] 4.5% oracle-error [85] 3.1% eval-errors [19] 0.1% loop [123] 0.0% ------------------------------------------------------------------------------------------ mk-egraph [194] 0.4% mk-enode-rec! [210] 2.4% substitute-e [54] 36.4% for-loop [37] 60.8% [65] 81412(15.0%) 3858(0.7%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [83] 92.0% hash-has-key? [143] 3.3% ------------------------------------------------------------------------------------------ match-e [38] 34.6% for-loop [52] 65.4% [66] 34796(6.4%) 2596(0.5%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [38] 91.0% ??? [89] 1.5% ------------------------------------------------------------------------------------------ ??? [51] 100.0% [67] 21648(4.0%) 13954(2.6%) ??? ...regime-testing/src/syntax/syntax.rkt:156:17 ??? [223] 19.6% return/no-unsupplied [185] 15.9% ------------------------------------------------------------------------------------------ for-loop [27] 4.9% merge-egraph-nodes! [55] 95.1% [68] 14274(2.6%) 1696(0.3%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [86] 83.1% hash-ref! [173] 5.0% ------------------------------------------------------------------------------------------ for-loop [56] 100.0% [69] 10622(2.0%) 0(0.0%) taylor-alt ...ie/regime-testing/src/glue.rkt:134:0 for-loop [87] 100.0% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [55] 100.0% [70] 6854(1.3%) 5762(1.1%) for-loop ...gime-testing/src/core/egraph.rkt:233:6 update-en-expr [149] 15.9% ------------------------------------------------------------------------------------------ ??? [51] 100.0% [71] 6756(1.2%) 6756(1.2%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------ list-cartesian-product [72] 21.3% match-e [38] 26.2% for-loop [52] 52.5% [72] 6404(1.2%) 5406(1.0%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [72] 21.3% for-loop [90] 13.0% ------------------------------------------------------------------------------------------ for-loop [57] 100.0% [73] 6098(1.1%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:88:0 rewriter [88] 100.0% ------------------------------------------------------------------------------------------ expression-cost [59] 100.0% [74] 4172(0.8%) 358(0.1%) compile ...e/regime-testing/src/programs.rkt:186:0 hash-ref! [173] 91.4% ------------------------------------------------------------------------------------------ ??? [60] 100.0% [75] 3768(0.7%) 2432(0.4%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [165] 35.5% ------------------------------------------------------------------------------------------ list-member? [58] 100.0% [76] 3750(0.7%) 3750(0.7%) loop (unknown source) ------------------------------------------------------------------------------------------ merge-egraph-nodes! [55] 100.0% [77] 3282(0.6%) 0(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [55] 69.7% loop! [135] 30.3% ------------------------------------------------------------------------------------------ for-loop [50] 20.0% simplify [32] 80.0% [78] 1666(0.3%) 1332(0.2%) debug7 ...erbie/regime-testing/src/debug.rkt:102:0 ??? [134] 20.0% ------------------------------------------------------------------------------------------ list-member? [58] 100.0% [79] 1338(0.2%) 1338(0.2%) member (unknown source) ------------------------------------------------------------------------------------------ merge-egraph-nodes! [55] 100.0% [80] 956(0.2%) 0(0.0%) enode-merge! ...e-testing/src/core/enode.rkt:129:0 adopt-enode! [91] 68.4% custom-set-intersect! [92] 31.6% ------------------------------------------------------------------------------------------ make-sequence [61] 100.0% [81] 302(0.1%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [100] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [2] 4.0% ??? [64] 96.0% [82] 82610(15.2%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 loop [95] 35.1% loop [103] 33.3% make-exacts* [104] 31.2% for-loop [101] 0.4% ------------------------------------------------------------------------------------------ mk-enode! [65] 100.0% [83] 74862(13.8%) 0(0.0%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [93] 99.5% set [147] 0.5% ------------------------------------------------------------------------------------------ ??? [64] 100.0% [84] 45424(8.4%) 0(0.0%) baseline-error ...ime-testing/src/points.rkt:291:0 loop [123] 100.0% ------------------------------------------------------------------------------------------ ??? [64] 100.0% [85] 30170(5.6%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:286:0 for-loop [94] 100.0% ------------------------------------------------------------------------------------------ update-leader! [68] 100.0% [86] 11862(2.2%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [96] 100.0% ------------------------------------------------------------------------------------------ taylor-alt [69] 100.0% [87] 10622(2.0%) 0(0.0%) for-loop ...rbie/regime-testing/src/glue.rkt:139:6 ??? [159] 100.0% ------------------------------------------------------------------------------------------ ??? [73] 38.4% matcher [106] 61.6% [88] 6098(1.1%) 338(0.1%) rewriter ...ime-testing/src/core/matcher.rkt:131:2 for-loop [97] 62.7% *rules* [98] 14.1% expression->type [99] 12.3% f66 [110] 9.6% ------------------------------------------------------------------------------------------ for-loop [28] 32.1% for-loop [66] 67.9% [89] 1016(0.2%) 660(0.1%) ??? ...bie/regime-testing/src/core/ematch.rkt:50:5 custom-in-set [100] 35.0% ------------------------------------------------------------------------------------------ list-cartesian-product [72] 100.0% [90] 998(0.2%) 998(0.2%) for-loop ...egime-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------------------ enode-merge! [80] 100.0% [91] 654(0.1%) 334(0.1%) adopt-enode! ...e-testing/src/core/enode.rkt:105:0 custom-set-union [145] 48.9% ------------------------------------------------------------------------------------------ enode-merge! [80] 100.0% [92] 302(0.1%) 302(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------------ new-enode [83] 100.0% [93] 74500(13.7%) 680(0.1%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [102] 99.1% ------------------------------------------------------------------------------------------ oracle-error [85] 100.0% [94] 30170(5.6%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:288:2 loop [123] 69.0% map [117] 30.3% argmin [39] 0.7% ------------------------------------------------------------------------------------------ prepare-points [82] 100.0% [95] 29002(5.3%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 loop [103] 55.3% make-exacts* [104] 44.7% ------------------------------------------------------------------------------------------ for-loop [86] 100.0% [96] 11862(2.2%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [105] 100.0% ------------------------------------------------------------------------------------------ rewriter [88] 100.0% [97] 5752(1.1%) 338(0.1%) for-loop ...me-testing/src/core/matcher.rkt:134:10 matcher [106] 98.8% ------------------------------------------------------------------------------------------ rewriter [88] 100.0% [98] 2348(0.4%) 344(0.1%) *rules* ...gime-testing/src/syntax/rules.rkt:565:0 for-loop [209] 70.0% curry* [108] 15.3% ------------------------------------------------------------------------------------------ for-loop [107] 13.6% loop [15] 18.4% rewriter [88] 68.1% [99] 1700(0.3%) 312(0.1%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [107] 81.6% ------------------------------------------------------------------------------------------ ??? [81] 18.0% ??? [89] 21.2% match-e [38] 60.8% [100] 1678(0.3%) 1678(0.3%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------------------ prepare-points [82] 100.0% [101] 336(0.1%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [109] 100.0% ------------------------------------------------------------------------------------------ type-of-enode-expr [93] 100.0% [102] 73820(13.6%) 1078(0.2%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ??? [116] 39.3% ->flonum [171] 28.0% ??? [134] 19.4% ...sting/src/common.rkt:48:2 [111] 11.8% ------------------------------------------------------------------------------------------ loop [95] 36.8% prepare-points [82] 63.2% [103] 43558(8.0%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [123] 98.5% ??? [36] 1.5% ------------------------------------------------------------------------------------------ loop [95] 33.5% prepare-points [82] 66.5% [104] 38716(7.1%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 loop [123] 100.0% ------------------------------------------------------------------------------------------ for-loop [96] 100.0% [105] 11862(2.2%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [112] 100.0% ------------------------------------------------------------------------------------------ for-loop [113] 25.3% matcher [106] 26.3% for-loop [97] 48.4% [106] 5752(1.1%) 0(0.0%) matcher ...gime-testing/src/core/matcher.rkt:167:2 rewriter [88] 48.4% matcher [106] 26.3% for-loop [113] 25.3% ------------------------------------------------------------------------------------------ expression->type [99] 100.0% [107] 1388(0.3%) 0(0.0%) for-loop ...regime-testing/src/type-check.rkt:52:5 f66 [110] 83.4% expression->type [99] 16.6% ------------------------------------------------------------------------------------------ *rules* [98] 34.7% match-e [38] 65.3% [108] 1038(0.2%) 360(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [114] 65.3% ------------------------------------------------------------------------------------------ for-loop [101] 100.0% [109] 336(0.1%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 for-loop [115] 100.0% ------------------------------------------------------------------------------------------ append-map [121] 0.1% composed [207] 0.4% ??? [126] 0.4% parse-loop79 [190] 0.5% approximate9 [7] 0.7% map [117] 2.4% for-loop [107] 3.6% eval-prog [204] 4.3% rewriter [88] 4.4% simplify [32] 5.1% hash-ref! [173] 5.4% f66 [110] 14.7% split-table [31] 57.9% [110] 38518(7.1%) 1292(0.2%) f66 ...t/collects/racket/match/compiler.rkt:507:40 loop [123] 52.4% f66 [110] 14.7% map [117] 9.8% option-on-expr [136] 5.7% ??? [116] 4.4% ??? [159] 4.3% ->flonum [171] 1.8% ??? [134] 0.9% parse-app [122] 0.8% append-map [121] 0.6% composed [207] 0.4% taylor-invert [14] 0.3% loop [15] 0.3% ------------------------------------------------------------------------------------------ ??? [159] 1.9% get-sigs [102] 44.9% for-loop [53] 53.2% [111] 19406(3.6%) 6900(1.3%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [119] 43.5% ??? [120] 19.2% ------------------------------------------------------------------------------------------ hash-update! [105] 100.0% [112] 11862(2.2%) 0(0.0%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [118] 100.0% ------------------------------------------------------------------------------------------ matcher [106] 100.0% [113] 3712(0.7%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:183:21 matcher [106] 100.0% ------------------------------------------------------------------------------------------ curry* [108] 100.0% [114] 678(0.1%) 678(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ------------------------------------------------------------------------------------------ ??? [109] 100.0% [115] 336(0.1%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:231:9 ??? [159] 100.0% ------------------------------------------------------------------------------------------ for-loop [53] 2.2% f66 [110] 5.4% get-sigs [102] 92.4% [116] 31424(5.8%) 1974(0.4%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [124] 51.3% for-loop [125] 34.8% get/build-late-neg-projection [176] 6.6% ??? [128] 1.0% ------------------------------------------------------------------------------------------ loop [123] 3.9% f66 [110] 34.6% for-loop [94] 61.5% [117] 14878(2.7%) 300(0.1%) map ...acket/collects/racket/private/map.rkt:20:13 loop [123] 74.4% f66 [110] 11.6% ??? [126] 4.5% parse-loop79 [190] 3.4% ??? [6] 2.7% make-multiplication-node [130] 0.8% taylor-quotient [129] 0.7% ------------------------------------------------------------------------------------------ ??? [112] 100.0% [118] 11862(2.2%) 10502(1.9%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 update-en-expr [149] 11.5% ------------------------------------------------------------------------------------------ for-loop [225] 8.1% ??? [219] 14.0% ...sting/src/common.rkt:48:2 [111] 77.9% [119] 8444(1.6%) 2330(0.4%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [219] 66.1% ??? [227] 12.2% ??? [128] 4.0% ------------------------------------------------------------------------------------------ ...sting/src/common.rkt:48:2 [111] 100.0% [120] 3726(0.7%) 1028(0.2%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [223] 36.3% assoc-ref [127] 26.5% return/no-unsupplied [185] 9.7% ------------------------------------------------------------------------------------------ f66 [110] 100.0% [121] 658(0.1%) 332(0.1%) append-map ...acket/collects/racket/list.rkt:565:2 f66 [110] 24.8% free-variables [131] 24.8% ------------------------------------------------------------------------------------------ f66 [110] 100.0% [122] 310(0.1%) 0(0.0%) parse-app .../collects/racket/private/kw.rkt:951:2 loop [132] 100.0% ------------------------------------------------------------------------------------------ errors-score [182] 0.0% ??? [64] 0.0% make-exacts* [104] 0.2% loop [103] 0.4% parse-loop79 [190] 0.5% for-loop [52] 0.6% map [117] 1.1% match-e [38] 1.1% option-on-expr [136] 1.6% for-loop [94] 1.7% loop! [135] 2.3% baseline-error [84] 4.0% f66 [110] 6.5% loop [123] 79.6% [123] 213270(39.3%) 4804(0.9%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [123] 79.6% option-on-expr [136] 6.2% ??? [5] 2.8% loop! [135] 2.3% eval-errors [19] 2.1% ??? [6] 1.7% ??? [36] 1.5% alt-errors [186] 0.6% parse-loop79 [190] 0.3% simplify [32] 0.3% foldl [139] 0.3% ??? [159] 0.2% for-loop [138] 0.2% ??? [126] 0.2% curried [211] 0.2% ulp-difference [45] 0.1% ??? [13] 0.0% ??? [133] 0.0% eval-prog [204] 0.0% map [117] 0.0% ------------------------------------------------------------------------------------------ ??? [116] 100.0% [124] 16132(3.0%) 2040(0.4%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [137] 87.4% ------------------------------------------------------------------------------------------ for-loop [203] 31.8% ??? [116] 68.2% [125] 16012(2.9%) 2820(0.5%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [219] 76.0% ??? [229] 6.4% ------------------------------------------------------------------------------------------ map [117] 27.5% loop [123] 72.5% [126] 2412(0.4%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [173] 72.5% f66 [110] 27.5% ------------------------------------------------------------------------------------------ ??? [120] 100.0% [127] 986(0.2%) 986(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------------------ ??? [116] 48.8% ??? [119] 51.2% [128] 652(0.1%) 334(0.1%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [141] 48.8% ------------------------------------------------------------------------------------------ map [117] 49.8% hash-ref! [173] 50.2% [129] 602(0.1%) 302(0.1%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [142] 49.8% ------------------------------------------------------------------------------------------ map [117] 100.0% [130] 358(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [140] 100.0% ------------------------------------------------------------------------------------------ append-map [121] 100.0% [131] 326(0.1%) 0(0.0%) free-variables ...e-testing/src/programs.rkt:102:0 ??? [134] 100.0% ------------------------------------------------------------------------------------------ parse-app [122] 100.0% [132] 310(0.1%) 310(0.1%) loop .../collects/racket/private/stxcase.rkt:112:7 ------------------------------------------------------------------------------------------ loop [123] 2.3% ??? [51] 97.7% [133] 76206(14.0%) 74148(13.7%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bftan [153] 1.3% ------------------------------------------------------------------------------------------ free-variables [131] 0.5% debug7 [78] 0.6% f66 [110] 0.6% ??? [227] 2.8% substitute-e [54] 2.9% choose-best-alt! [47] 2.9% variable? [9] 11.8% match-e [38] 14.3% get-sigs [102] 24.1% finalize-iter! [40] 39.4% [134] 59320(10.9%) 13632(2.5%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [144] 37.7% hash-has-key? [143] 34.7% ??? [152] 2.9% atab-add-altns [154] 1.7% ------------------------------------------------------------------------------------------ for-loop [77] 2.2% merge-egraph-nodes! [55] 13.9% loop [123] 28.7% for-loop [37] 55.3% [135] 37936(7.0%) 4690(0.9%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 custom-set-union [145] 40.9% loop [123] 31.7% set [147] 14.9% update-en-expr [149] 6.1% ------------------------------------------------------------------------------------------ f66 [110] 12.0% loop [123] 88.0% [136] 24444(4.5%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [123] 37.5% sort-context-on-expr [148] 36.7% eval-errors [19] 9.6% err-lsts->split-indices [150] 9.5% pick-errors [156] 2.7% alt-errors [186] 2.6% eval-prog [204] 1.3% ------------------------------------------------------------------------------------------ ??? [124] 100.0% [137] 14092(2.6%) 1018(0.2%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [146] 92.8% ------------------------------------------------------------------------------------------ loop [123] 100.0% [138] 2962(0.5%) 310(0.1%) for-loop ...me-testing/src/core/simplify.rkt:195:2 setfindf [151] 66.2% curried [211] 23.4% ------------------------------------------------------------------------------------------ for-loop [52] 25.2% loop [123] 74.8% [139] 1410(0.3%) 722(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [155] 48.8% ------------------------------------------------------------------------------------------ make-multiplication-node [130] 100.0% [140] 358(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [157] 100.0% ------------------------------------------------------------------------------------------ ??? [128] 100.0% [141] 318(0.1%) 0(0.0%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [158] 100.0% ------------------------------------------------------------------------------------------ taylor-quotient [129] 100.0% [142] 300(0.1%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [173] 100.0% ------------------------------------------------------------------------------------------ mk-enode! [65] 11.3% ??? [134] 88.7% [143] 23770(4.4%) 8100(1.5%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [184] 64.6% ------------------------------------------------------------------------------------------ ??? [134] 100.0% [144] 22872(4.2%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [160] 100.0% ------------------------------------------------------------------------------------------ adopt-enode! [91] 1.9% loop! [135] 98.1% [145] 16836(3.1%) 6412(1.2%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [163] 52.1% for-loop [166] 9.8% ------------------------------------------------------------------------------------------ ??? [137] 100.0% [146] 13074(2.4%) 716(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [161] 94.5% ------------------------------------------------------------------------------------------ new-enode [83] 3.3% loop! [135] 96.7% [147] 10840(2.0%) 10840(2.0%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------------------ option-on-expr [136] 100.0% [148] 8962(1.7%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [162] 100.0% ------------------------------------------------------------------------------------------ for-loop [70] 14.7% for-loop [118] 18.4% loop! [135] 66.9% [149] 7406(1.4%) 7406(1.4%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------------------------ option-on-expr [136] 100.0% [150] 2330(0.4%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [164] 100.0% ------------------------------------------------------------------------------------------ for-loop [138] 100.0% [151] 1960(0.4%) 1638(0.3%) setfindf ...ie/regime-testing/src/common.rkt:187:0 for-loop [169] 16.4% ------------------------------------------------------------------------------------------ ??? [134] 100.0% [152] 1742(0.3%) 0(0.0%) ??? .../regime-testing/src/core/alt-table.rkt:54:0 ??? [159] 100.0% ------------------------------------------------------------------------------------------ ??? [133] 100.0% [153] 1014(0.2%) 338(0.1%) bftan ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [165] 66.7% ------------------------------------------------------------------------------------------ ??? [134] 100.0% [154] 982(0.2%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:50:0 atab-add-altn [160] 100.0% ------------------------------------------------------------------------------------------ foldl [139] 100.0% [155] 688(0.1%) 688(0.1%) merge2 .../regime-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------------------ option-on-expr [136] 100.0% [156] 672(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 point->alt [168] 52.4% for-loop [170] 47.6% ------------------------------------------------------------------------------------------ make-multiplication-subnode [140] 100.0% [157] 358(0.1%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:242:3 partition [167] 100.0% ------------------------------------------------------------------------------------------ check-hash/c [141] 100.0% [158] 318(0.1%) 318(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------------------ for-loop [115] 0.9% loop [22] 1.6% ??? [6] 3.6% ??? [152] 3.9% loop [123] 5.9% ??? [187] 7.1% ->flonum [171] 10.4% for-loop [87] 10.4% for-loop [29] 12.2% f66 [110] 18.3% ??? [36] 25.6% [159] 35986(6.6%) 1040(0.2%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ->flonum [171] 67.1% approximate9 [7] 10.4% hash-ref! [173] 8.6% ??? [227] 6.0% best-alt [180] 3.9% ...sting/src/common.rkt:48:2 [111] 1.0% ------------------------------------------------------------------------------------------ atab-add-altns [154] 4.1% for-loop [144] 95.9% [160] 23854(4.4%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [172] 86.1% override-at-pnts [178] 12.5% loop [181] 1.4% ------------------------------------------------------------------------------------------ ??? [146] 100.0% [161] 12358(2.3%) 2084(0.4%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [175] 58.4% get/build-late-neg-projection [176] 24.8% ------------------------------------------------------------------------------------------ localize-error [46] 3.5% sort-context-on-expr [148] 96.5% [162] 9286(1.7%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [174] 85.5% loop [205] 11.0% errors-score [182] 3.5% ------------------------------------------------------------------------------------------ custom-set-union [145] 100.0% [163] 8766(1.6%) 4358(0.8%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [177] 50.3% ------------------------------------------------------------------------------------------ err-lsts->split-indices [150] 100.0% [164] 2330(0.4%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [179] 100.0% ------------------------------------------------------------------------------------------ bftan [153] 33.6% real->bigfloat [75] 66.4% [165] 2012(0.4%) 2012(0.4%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------------------ custom-set-union [145] 100.0% [166] 1658(0.3%) 1658(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------------------ for-loop [157] 100.0% [167] 358(0.1%) 358(0.1%) partition ...racket/collects/racket/list.rkt:547:0 ------------------------------------------------------------------------------------------ pick-errors [156] 100.0% [168] 352(0.1%) 0(0.0%) point->alt ...e-testing/src/core/regimes.rkt:188:0 eval-prog [204] 100.0% ------------------------------------------------------------------------------------------ setfindf [151] 100.0% [169] 322(0.1%) 322(0.1%) for-loop ...ie/regime-testing/src/common.rkt:188:2 ------------------------------------------------------------------------------------------ pick-errors [156] 100.0% [170] 320(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:203:2 ??? [13] 100.0% ------------------------------------------------------------------------------------------ f66 [110] 0.2% get-sigs [102] 2.0% for-loop [53] 2.8% ??? [159] 8.0% ->flonum [171] 15.1% for-loop [183] 28.9% ??? [64] 42.7% [171] 340762(62.8%) 19682(3.6%) ->flonum ...s/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [3] 36.5% for-loop [183] 28.9% ->flonum [171] 15.1% loop [4] 5.9% ??? [184] 4.2% ??? [159] 1.9% ??? [223] 1.5% return/no-unsupplied [185] 1.4% mk-egraph [194] 0.3% *simplify-rules* [201] 0.2% loop [202] 0.1% ??? [219] 0.1% ------------------------------------------------------------------------------------------ atab-add-altn [160] 100.0% [172] 20534(3.8%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [19] 77.1% alt-errors [186] 19.5% for-loop [200] 3.4% ------------------------------------------------------------------------------------------ first-nonzero-exp [142] 0.9% ??? [33] 1.7% localize-error [46] 2.0% for-loop [25] 2.6% ??? [11] 3.3% update-leader! [68] 4.5% ??? [189] 8.0% for-loop [24] 8.5% ??? [126] 9.0% for-loop [23] 9.5% ??? [191] 10.0% loop [22] 11.4% ??? [159] 13.1% compile [74] 14.0% [173] 15910(2.9%) 4536(0.8%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [191] 16.5% ??? [8] 13.2% ??? [187] 11.4% parse-loop79 [190] 9.0% ??? [10] 8.5% simplify [32] 8.0% ??? [189] 8.0% ??? [11] 5.9% f66 [110] 4.1% taylor-quotient [129] 0.9% ------------------------------------------------------------------------------------------ ??? [162] 100.0% [174] 7940(1.5%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [188] 95.8% loop [205] 4.2% ------------------------------------------------------------------------------------------ for-loop [161] 100.0% [175] 7212(1.3%) 7212(1.3%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------------------ listof-late-neg-projection [199] 2.2% ??? [195] 15.6% ??? [116] 22.7% for-loop [161] 59.5% [176] 5142(0.9%) 1338(0.2%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [192] 53.4% ??? [195] 22.7% listof-late-neg-projection [199] 5.6% ------------------------------------------------------------------------------------------ for-loop [163] 100.0% [177] 4408(0.8%) 4408(0.8%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------------------ atab-add-altn [160] 100.0% [178] 2984(0.5%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:145:0 eval-errors [19] 54.6% alt-errors [186] 45.4% ------------------------------------------------------------------------------------------ add-splitpoint [164] 100.0% [179] 2330(0.4%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:255:4 for-loop [193] 100.0% ------------------------------------------------------------------------------------------ ??? [159] 100.0% [180] 1742(0.3%) 0(0.0%) best-alt ...erbie/regime-testing/src/glue.rkt:71:0 loop [196] 59.4% argmins [197] 40.6% ------------------------------------------------------------------------------------------ atab-add-altn [160] 100.0% [181] 336(0.1%) 0(0.0%) loop ...egime-testing/src/core/alt-table.rkt:182:2 loop [198] 100.0% ------------------------------------------------------------------------------------------ ??? [162] 100.0% [182] 324(0.1%) 0(0.0%) errors-score ...egime-testing/src/points.rkt:298:0 loop [123] 100.0% ------------------------------------------------------------------------------------------ ->flonum [171] 100.0% [183] 208980(38.5%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ->flonum [171] 100.0% ------------------------------------------------------------------------------------------ hash-has-key? [143] 29.6% ->flonum [171] 70.4% [184] 51884(9.6%) 21400(3.9%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [203] 45.3% ??? [213] 12.1% ??? [219] 1.3% ------------------------------------------------------------------------------------------ ??? [120] 3.7% ulp-difference [45] 4.7% ??? [67] 35.4% ->flonum [171] 56.2% [185] 9734(1.8%) 6560(1.2%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [206] 32.6% ------------------------------------------------------------------------------------------ composed [207] 3.8% option-on-expr [136] 6.8% override-at-pnts [178] 14.5% loop [123] 32.0% best-and-tied-at-points [172] 42.8% [186] 9354(1.7%) 0(0.0%) alt-errors ...ime-testing/src/alternative.rkt:59:0 eval-prog [204] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [173] 100.0% [187] 7642(1.4%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:67:15 ??? [159] 100.0% ------------------------------------------------------------------------------------------ copying-mergesort [188] 41.2% generic-sort/key [174] 58.8% [188] 7608(1.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 loop [205] 51.3% copying-mergesort [188] 41.2% jloop [12] 7.6% ------------------------------------------------------------------------------------------ hash-ref! [173] 100.0% [189] 7346(1.4%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:44:15 hash-ref! [173] 100.0% ------------------------------------------------------------------------------------------ loop [123] 6.8% map [117] 7.7% parse-loop79 [190] 23.1% hash-ref! [173] 28.5% simplify [32] 33.9% [190] 6144(1.1%) 4032(0.7%) parse-loop79 ...s/racket/match/compiler.rkt:418:15 loop [123] 35.2% parse-loop79 [190] 23.1% f66 [110] 5.9% ------------------------------------------------------------------------------------------ hash-ref! [173] 100.0% [191] 3456(0.6%) 1036(0.2%) ??? ...erbie/regime-testing/src/programs.rkt:194:5 hash-ref! [173] 70.0% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [176] 100.0% [192] 3086(0.6%) 356(0.1%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [208] 88.5% ------------------------------------------------------------------------------------------ for-loop [179] 100.0% [193] 2330(0.4%) 1658(0.3%) for-loop ...ime-testing/src/core/regimes.rkt:259:8 curried [211] 28.8% ------------------------------------------------------------------------------------------ ->flonum [171] 100.0% [194] 2318(0.4%) 0(0.0%) mk-egraph ...ime-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [210] 85.6% mk-enode! [65] 14.4% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [176] 100.0% [195] 2080(0.4%) 362(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [176] 82.6% ------------------------------------------------------------------------------------------ extract-alt [34] 41.0% best-alt [180] 59.0% [196] 1754(0.3%) 0(0.0%) loop ...herbie/regime-testing/src/common.rkt:154:2 composed [207] 100.0% ------------------------------------------------------------------------------------------ extract-alt [34] 33.7% best-alt [180] 66.3% [197] 1068(0.2%) 0(0.0%) argmins ...bie/regime-testing/src/common.rkt:153:0 composed [207] 100.0% ------------------------------------------------------------------------------------------ loop [181] 33.2% one-iter [18] 66.8% [198] 1012(0.2%) 1012(0.2%) loop ...ket/collects/racket/private/list.rkt:264:4 ------------------------------------------------------------------------------------------ get/build-late-neg-projection [176] 100.0% [199] 692(0.1%) 356(0.1%) listof-late-neg-projection ...ivate/list.rkt:162:0 get/build-late-neg-projection [176] 48.6% ------------------------------------------------------------------------------------------ best-and-tied-at-points [172] 100.0% [200] 690(0.1%) 690(0.1%) for-loop ...-testing/src/core/alt-table.rkt:124:16 ------------------------------------------------------------------------------------------ ->flonum [171] 100.0% [201] 666(0.1%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 for-loop [209] 100.0% ------------------------------------------------------------------------------------------ ->flonum [171] 100.0% [202] 336(0.1%) 0(0.0%) loop .../herbie/regime-testing/src/points.rkt:66:6 random-exp [212] 100.0% ------------------------------------------------------------------------------------------ ??? [184] 100.0% [203] 23488(4.3%) 10816(2.0%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [213] 29.5% for-loop [125] 21.7% successfully-got-the-right-kind-of-function [217] 2.8% ------------------------------------------------------------------------------------------ loop [123] 2.2% option-on-expr [136] 3.1% point->alt [168] 3.4% alt-errors [186] 91.3% [204] 10250(1.9%) 2628(0.5%) eval-prog ...regime-testing/src/programs.rkt:150:0 f66 [110] 64.4% ??? [216] 6.5% ??? [218] 3.5% ------------------------------------------------------------------------------------------ generic-sort/key [174] 5.0% ??? [162] 15.4% copying-mergesort [188] 79.6% [205] 6652(1.2%) 982(0.2%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [36] 85.2% ------------------------------------------------------------------------------------------ match-e [38] 8.8% for-loop [52] 9.3% return/no-unsupplied [185] 81.9% [206] 3874(0.7%) 3874(0.7%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------------------ f66 [110] 18.9% argmins [197] 30.7% loop [196] 50.4% [207] 3480(0.6%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 eval-errors [19] 70.7% f66 [110] 18.9% alt-errors [186] 10.3% ------------------------------------------------------------------------------------------ contract-struct-name [214] 12.6% ??? [192] 87.4% [208] 2730(0.5%) 1668(0.3%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [214] 51.5% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [55] 12.7% *simplify-rules* [201] 25.2% *rules* [98] 62.1% [209] 2646(0.5%) 1288(0.2%) for-loop ...ie/regime-testing/src/common.rkt:100:9 flag-set? [221] 25.7% loop [215] 25.6% ------------------------------------------------------------------------------------------ mk-enode-rec! [210] 41.0% mk-egraph [194] 59.0% [210] 1984(0.4%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode! [65] 59.0% mk-enode-rec! [210] 41.0% ------------------------------------------------------------------------------------------ loop [123] 19.2% for-loop [193] 39.8% for-loop [138] 41.0% [211] 1688(0.3%) 1688(0.3%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------------------ loop [202] 100.0% [212] 336(0.1%) 336(0.1%) random-exp .../regime-testing/src/common.rkt:254:0 ------------------------------------------------------------------------------------------ ??? [184] 47.6% for-loop [203] 52.4% [213] 13230(2.4%) 7224(1.3%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [220] 45.4% ------------------------------------------------------------------------------------------ build-compound-type-name [208] 100.0% [214] 1750(0.3%) 1062(0.2%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [208] 39.3% ------------------------------------------------------------------------------------------ for-loop [209] 100.0% [215] 678(0.1%) 360(0.1%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [221] 46.9% ------------------------------------------------------------------------------------------ eval-prog [204] 100.0% [216] 666(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:346:33 ??? [219] 52.9% ??? [229] 47.1% ------------------------------------------------------------------------------------------ for-loop [203] 100.0% [217] 648(0.1%) 648(0.1%) successfully-got-the-right-kind-of-function ...9:4 ------------------------------------------------------------------------------------------ eval-prog [204] 100.0% [218] 360(0.1%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [222] 100.0% ------------------------------------------------------------------------------------------ ??? [216] 1.7% ->flonum [171] 3.0% ??? [184] 3.3% ??? [119] 35.0% for-loop [125] 57.1% [219] 21308(3.9%) 6130(1.1%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [224] 47.4% ??? [119] 11.1% for-loop [225] 11.0% ??? [229] 1.7% ------------------------------------------------------------------------------------------ ??? [213] 100.0% [220] 6006(1.1%) 6006(1.1%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------------------ loop [215] 31.9% for-loop [209] 68.1% [221] 998(0.2%) 640(0.1%) flag-set? ...ie/regime-testing/src/config.rkt:34:0 ??? [223] 35.9% ------------------------------------------------------------------------------------------ ??? [218] 100.0% [222] 360(0.1%) 0(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 maybe-cons-kwd [226] 100.0% ------------------------------------------------------------------------------------------ flag-set? [221] 2.9% ulp-difference [45] 6.7% ??? [120] 11.0% ??? [67] 34.7% ->flonum [171] 44.5% [223] 12238(2.3%) 4742(0.9%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [228] 54.9% ??? [227] 6.3% ------------------------------------------------------------------------------------------ ??? [219] 100.0% [224] 10100(1.9%) 656(0.1%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [227] 80.8% ??? [229] 12.7% ------------------------------------------------------------------------------------------ ??? [219] 100.0% [225] 2346(0.4%) 984(0.2%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [119] 58.1% ------------------------------------------------------------------------------------------ unpack245 [222] 100.0% [226] 360(0.1%) 0(0.0%) maybe-cons-kwd ...ate/arrow-higher-order.rkt:498:0 arrow-higher-order:lnp [230] 100.0% ------------------------------------------------------------------------------------------ ??? [63] 2.6% ??? [223] 5.7% ??? [119] 15.3% ??? [159] 16.1% ??? [224] 60.3% [227] 13522(2.5%) 10698(2.0%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [134] 16.1% contract? [232] 4.8% ------------------------------------------------------------------------------------------ ??? [223] 100.0% [228] 6724(1.2%) 6344(1.2%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [233] 5.7% ------------------------------------------------------------------------------------------ ??? [216] 8.4% ??? [219] 9.7% ??? [51] 20.0% for-loop [125] 27.4% ??? [224] 34.5% [229] 3722(0.7%) 1764(0.3%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [231] 52.6% ------------------------------------------------------------------------------------------ maybe-cons-kwd [226] 100.0% [230] 360(0.1%) 360(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ------------------------------------------------------------------------------------------ ??? [229] 100.0% [231] 1958(0.4%) 360(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [234] 81.6% ------------------------------------------------------------------------------------------ ??? [227] 100.0% [232] 650(0.1%) 650(0.1%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------------------ ??? [228] 100.0% [233] 380(0.1%) 380(0.1%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------------------ ??? [231] 100.0% [234] 1598(0.3%) 1598(0.3%) ??? ...ects/racket/contract/private/list.rkt:141:5 ------------------------------------------------------------------------------------------