Profiling results ----------------- Total cpu time observed: 1859316ms (out of 1864876ms) Number of samples taken: 5579 (once every 333ms) (Hiding functions with self<1.0% and local<2.0%: 18 of 284 hidden) =========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================================== ??? [60] 100.0% [1] 1420322(76.4%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [15] 100.0% ------------------------------------------------------------------------------------------- ??? [60] 100.0% [2] 1319726(71.0%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 for-loop [16] 96.7% get-final-combination [19] 3.3% prepare-points [77] 0.0% setup-alt-simplified [25] 0.0% ------------------------------------------------------------------------------------------- ??? [161] 100.0% [3] 1282322(69.0%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [17] 98.4% map-enodes [20] 1.6% ------------------------------------------------------------------------------------------- ??? [161] 100.0% [4] 328220(17.7%) 0(0.0%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [18] 100.0% ------------------------------------------------------------------------------------------- map [100] 1.1% loop [150] 98.9% [5] 31784(1.7%) 646(0.0%) ??? ...herbie/regime-testing/src/points.rkt:289:26 ??? [142] 92.8% ulp-difference [168] 3.1% ??? [156] 1.1% ??? [152] 1.0% ------------------------------------------------------------------------------------------- loop [150] 100.0% [6] 30866(1.7%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:293:24 eval-errors [134] 97.9% map [100] 1.0% ------------------------------------------------------------------------------------------- f137 [143] 1.3% pattern-substitute [122] 2.7% substitute-e [54] 26.9% match-e [42] 69.1% [7] 24626(1.3%) 930(0.1%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [107] 96.2% ------------------------------------------------------------------------------------------- ??? [152] 100.0% [8] 5238(0.3%) 0(0.0%) approximate9 ...e-testing/src/core/taylor.rkt:12:0 loop [21] 88.2% f137 [143] 6.0% taylor-quotient [27] 5.9% ------------------------------------------------------------------------------------------- generic-sort/key [235] 7.1% copying-mergesort [248] 92.9% [9] 4342(0.2%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [142] 92.9% errors-score [28] 7.1% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [10] 3274(0.2%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:295:23 for-loop [22] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [11] 3246(0.2%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:285:26 for-loop [23] 100.0% ------------------------------------------------------------------------------------------- rewriter [79] 100.0% [12] 2700(0.1%) 0(0.0%) *rules* ...gime-testing/src/syntax/rules.rkt:565:0 for-loop [69] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [13] 2270(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:392:23 for-loop [24] 100.0% ------------------------------------------------------------------------------------------- map [100] 49.1% loop [150] 50.9% [14] 636(0.0%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [164] 40.8% f137 [143] 24.5% taylor-exp [26] 24.5% map [100] 10.2% ------------------------------------------------------------------------------------------- profile-thunk16 [1] 99.9% [15] 1421264(76.4%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [60] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [16] 1276054(68.6%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [29] 100.0% ------------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [17] 1261606(67.9%) 15092(0.8%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [30] 80.3% for-loop [32] 18.4% filter [214] 0.0% ------------------------------------------------------------------------------------------- loop [4] 100.0% [18] 328220(17.7%) 652(0.0%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [31] 99.5% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [19] 43002(2.3%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:266:0 split-table [33] 98.5% extract-alt [38] 0.7% ??? [152] 0.7% ------------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [20] 20358(1.1%) 0(0.0%) map-enodes ...me-testing/src/core/egraph.rkt:140:0 loop [150] 93.7% for-loop [166] 6.3% ------------------------------------------------------------------------------------------- approximate9 [8] 100.0% [21] 4618(0.2%) 0(0.0%) loop ...ie/regime-testing/src/core/taylor.rkt:86:4 hash-ref! [164] 64.4% ??? [152] 35.6% ------------------------------------------------------------------------------------------- ??? [10] 100.0% [22] 3274(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:298:27 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- ??? [11] 100.0% [23] 3246(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:285:52 hash-ref! [164] 62.2% ??? [36] 22.5% simplify [34] 15.3% ------------------------------------------------------------------------------------------- ??? [13] 100.0% [24] 2270(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:396:33 for-loop [35] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [25] 326(0.0%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [37] 100.0% ------------------------------------------------------------------------------------------- ??? [14] 100.0% [26] 312(0.0%) 0(0.0%) taylor-exp ...me-testing/src/core/taylor.rkt:386:0 simplify [34] 100.0% ------------------------------------------------------------------------------------------- approximate9 [8] 100.0% [27] 308(0.0%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [39] 100.0% ------------------------------------------------------------------------------------------- jloop [9] 100.0% [28] 308(0.0%) 0(0.0%) errors-score ...egime-testing/src/points.rkt:298:0 loop [150] 100.0% ------------------------------------------------------------------------------------------- for-loop [16] 100.0% [29] 1276054(68.6%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [40] 94.4% finalize-iter! [45] 4.6% gen-rewrites! [47] 0.5% gen-series! [48] 0.4% localize-error [50] 0.0% ------------------------------------------------------------------------------------------- one-iter [17] 100.0% [30] 1012934(54.5%) 3234(0.2%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [41] 91.8% match-e [42] 6.6% update-leader! [62] 0.8% reduce-to-single! [49] 0.4% ------------------------------------------------------------------------------------------- pass [18] 100.0% [31] 326524(17.6%) 4514(0.2%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [43] 72.9% loop [44] 20.4% for-loop [46] 4.5% make-sequence [191] 0.6% filter [214] 0.1% ------------------------------------------------------------------------------------------- for-loop [32] 48.8% one-iter [17] 51.2% [32] 231690(12.5%) 51528(2.8%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [32] 48.8% match-e [42] 38.9% ------------------------------------------------------------------------------------------- get-final-combination [19] 100.0% [33] 42372(2.3%) 0(0.0%) split-table ...e/regime-testing/src/glue.rkt:162:0 f137 [143] 100.0% ------------------------------------------------------------------------------------------- taylor-exp [26] 6.4% ??? [152] 6.8% for-loop [23] 13.3% hash-ref! [164] 73.4% [34] 4888(0.3%) 0(0.0%) simplify ...egime-testing/src/core/reduce.rkt:16:0 f137 [143] 67.3% debug-print [220] 19.5% parse-loop12 [192] 13.1% ------------------------------------------------------------------------------------------- for-loop [24] 100.0% [35] 2270(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:398:39 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- for-loop [23] 100.0% [36] 1254(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:288:19 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- setup-alt-simplified [25] 100.0% [37] 326(0.0%) 0(0.0%) simplify-alt ...e/regime-testing/src/glue.rkt:76:0 ??? [161] 100.0% ------------------------------------------------------------------------------------------- get-final-combination [19] 100.0% [38] 318(0.0%) 0(0.0%) extract-alt ...ie/regime-testing/src/glue.rkt:55:0 loop [200] 100.0% ------------------------------------------------------------------------------------------- taylor-quotient [27] 100.0% [39] 308(0.0%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- run-iter! [29] 100.0% [40] 1204390(64.8%) 0(0.0%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [51] 100.0% ------------------------------------------------------------------------------------------- for-loop [30] 100.0% [41] 930374(50.0%) 3316(0.2%) for-loop ...e-testing/src/core/simplify.rkt:148:10 mk-enode! [61] 31.2% merge-egraph-nodes! [52] 30.3% substitute-e [54] 24.4% loop! [162] 12.0% list-member? [183] 1.8% ------------------------------------------------------------------------------------------- for-loop [30] 17.6% for-loop [63] 22.6% for-loop [32] 59.8% [42] 246918(13.3%) 83700(4.5%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [55] 45.6% for-loop [63] 8.9% ??? [107] 6.7% variable? [7] 2.9% list-cartesian-product [67] 2.7% custom-in-set [237] 1.5% loop [150] 1.1% curry* [72] 0.4% ------------------------------------------------------------------------------------------- for-loop [31] 100.0% [43] 238146(12.8%) 334(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [53] 90.9% expression-cost [56] 8.9% ------------------------------------------------------------------------------------------- for-loop [31] 100.0% [44] 66698(3.6%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [53] 90.2% expression-cost [56] 9.8% ------------------------------------------------------------------------------------------- run-iter! [29] 100.0% [45] 58780(3.2%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [107] 100.0% ------------------------------------------------------------------------------------------- for-loop [31] 100.0% [46] 14582(0.8%) 14582(0.8%) for-loop ...e-testing/src/core/simplify.rkt:217:13 ------------------------------------------------------------------------------------------- run-iter! [29] 100.0% [47] 5982(0.3%) 0(0.0%) gen-rewrites! ...me-testing/src/mainloop.rkt:142:0 for-loop [57] 100.0% ------------------------------------------------------------------------------------------- run-iter! [29] 100.0% [48] 5572(0.3%) 0(0.0%) gen-series! ...gime-testing/src/mainloop.rkt:129:0 for-loop [58] 100.0% ------------------------------------------------------------------------------------------- for-loop [30] 100.0% [49] 4332(0.2%) 2594(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [59] 32.1% make-sequence [191] 8.0% ------------------------------------------------------------------------------------------- run-iter! [29] 100.0% [50] 632(0.0%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [164] 51.3% ??? [210] 48.7% ------------------------------------------------------------------------------------------- simplify! [40] 97.7% [51] 1232248(66.3%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [60] 100.0% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [52] 3.4% for-loop [64] 7.1% for-loop [41] 89.5% [52] 281482(15.1%) 4310(0.2%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [62] 55.3% loop! [162] 12.5% for-loop [64] 11.8% for-loop [65] 10.1% enode-merge! [68] 4.1% merge-egraph-nodes! [52] 3.4% for-loop [69] 1.0% make-sequence [191] 0.3% ------------------------------------------------------------------------------------------- loop [44] 21.7% argmin [43] 78.3% [53] 276752(14.9%) 9058(0.5%) for-loop .../regime-testing/src/programs.rkt:210:2 ??? [161] 69.7% ...sting/src/common.rkt:48:2 [110] 24.7% ??? [108] 2.3% ------------------------------------------------------------------------------------------- substitute-e [54] 5.4% for-loop [41] 94.6% [54] 226586(12.2%) 7550(0.4%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [61] 89.2% substitute-e [54] 5.4% ??? [107] 2.0% variable? [7] 1.1% ------------------------------------------------------------------------------------------- match-e [42] 100.0% [55] 140546(7.6%) 56208(3.0%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [63] 52.0% list-cartesian-product [67] 6.8% loop [150] 4.6% curry* [72] 0.8% foldl [170] 0.6% curried [260] 0.2% filter [214] 0.2% ------------------------------------------------------------------------------------------- loop [44] 23.5% argmin [43] 76.5% [56] 27758(1.5%) 606(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [66] 97.8% ------------------------------------------------------------------------------------------- gen-rewrites! [47] 100.0% [57] 5982(0.3%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:147:11 ??? [70] 100.0% ------------------------------------------------------------------------------------------- gen-series! [48] 100.0% [58] 5572(0.3%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:135:7 taylor-alt [71] 100.0% ------------------------------------------------------------------------------------------- reduce-to-single! [49] 100.0% [59] 1392(0.1%) 1392(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:326:8 ------------------------------------------------------------------------------------------- for-loop [51] 23.4% run [15] 27.8% [60] 1837098(98.8%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [161] 43.9% profile-thunk16 [1] 27.7% run-improve50 [2] 25.1% oracle-error [75] 1.4% baseline-error [76] 1.4% prepare-points [77] 0.4% eval-errors [134] 0.1% loop [150] 0.0% ------------------------------------------------------------------------------------------- mk-egraph [188] 0.1% mk-enode-rec! [213] 1.4% substitute-e [54] 40.4% for-loop [41] 58.2% [61] 499728(26.9%) 34936(1.9%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [73] 91.3% hash-has-key? [116] 1.6% mutable-set [93] 0.1% ------------------------------------------------------------------------------------------- for-loop [30] 4.7% merge-egraph-nodes! [52] 95.3% [62] 175294(9.4%) 14908(0.8%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [74] 85.7% custom-set-union! [83] 2.2% update-en-expr [178] 1.7% hash-ref! [164] 0.9% make-sequence [191] 0.6% mutable-set [93] 0.4% ------------------------------------------------------------------------------------------- match-e [42] 31.3% for-loop [55] 68.7% [63] 115628(6.2%) 10716(0.6%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [42] 87.2% ??? [80] 4.8% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [52] 100.0% [64] 53340(2.9%) 0(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [52] 75.0% loop! [162] 25.0% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [52] 100.0% [65] 28644(1.5%) 22690(1.2%) for-loop ...gime-testing/src/core/egraph.rkt:233:6 update-en-expr [178] 20.8% ------------------------------------------------------------------------------------------- expression-cost [56] 100.0% [66] 27152(1.5%) 632(0.0%) compile ...e/regime-testing/src/programs.rkt:186:0 hash-ref! [164] 97.7% ------------------------------------------------------------------------------------------- list-cartesian-product [67] 27.8% match-e [42] 30.5% for-loop [55] 41.7% [67] 20256(1.1%) 15952(0.9%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [67] 27.8% for-loop [82] 16.4% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [52] 100.0% [68] 12354(0.7%) 1674(0.1%) enode-merge! ...e-testing/src/core/enode.rkt:129:0 adopt-enode! [78] 67.5% custom-set-intersect! [84] 19.0% ------------------------------------------------------------------------------------------- *rules* [12] 44.9% merge-egraph-nodes! [52] 55.1% [69] 6016(0.3%) 2950(0.2%) for-loop ...ie/regime-testing/src/common.rkt:100:9 update-en-expr [178] 22.4% loop [85] 16.6% flag-set? [94] 6.0% ormap [86] 6.0% ------------------------------------------------------------------------------------------- for-loop [57] 100.0% [70] 5982(0.3%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:88:0 rewriter [79] 100.0% ------------------------------------------------------------------------------------------- for-loop [58] 100.0% [71] 5572(0.3%) 0(0.0%) taylor-alt ...ie/regime-testing/src/glue.rkt:134:0 for-loop [81] 100.0% ------------------------------------------------------------------------------------------- for-loop [55] 49.4% match-e [42] 50.6% [72] 2706(0.1%) 658(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [266] 75.7% ------------------------------------------------------------------------------------------- mk-enode! [61] 100.0% [73] 456052(24.5%) 2340(0.1%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [87] 98.1% set [179] 0.8% mutable-set [93] 0.3% ------------------------------------------------------------------------------------------- update-leader! [62] 100.0% [74] 150166(8.1%) 5342(0.3%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [88] 96.4% ------------------------------------------------------------------------------------------- ??? [60] 100.0% [75] 48842(2.6%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:286:0 for-loop [89] 100.0% ------------------------------------------------------------------------------------------- ??? [60] 100.0% [76] 46414(2.5%) 0(0.0%) baseline-error ...ime-testing/src/points.rkt:291:0 loop [150] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 1.4% pred [256] 36.7% ??? [60] 61.8% [77] 23888(1.3%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 make-exacts* [101] 57.6% loop [102] 25.1% loop [91] 16.0% for-loop [97] 1.3% ------------------------------------------------------------------------------------------- enode-merge! [68] 100.0% [78] 8336(0.4%) 3618(0.2%) adopt-enode! ...e-testing/src/core/enode.rkt:105:0 custom-set-union [177] 56.6% ------------------------------------------------------------------------------------------- ??? [70] 25.4% matcher [103] 74.6% [79] 5982(0.3%) 984(0.1%) rewriter ...ime-testing/src/core/matcher.rkt:131:2 for-loop [90] 80.9% *rules* [12] 8.5% expression->type [96] 4.8% f137 [143] 2.7% ------------------------------------------------------------------------------------------- for-loop [63] 100.0% [80] 5700(0.3%) 3008(0.2%) ??? ...bie/regime-testing/src/core/ematch.rkt:50:5 for-loop [92] 47.2% ------------------------------------------------------------------------------------------- taylor-alt [71] 100.0% [81] 5572(0.3%) 0(0.0%) for-loop ...rbie/regime-testing/src/glue.rkt:139:6 ??? [152] 100.0% ------------------------------------------------------------------------------------------- list-cartesian-product [67] 100.0% [82] 4304(0.2%) 4304(0.2%) for-loop ...egime-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------------------- update-leader! [62] 100.0% [83] 3940(0.2%) 2304(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [95] 41.5% ------------------------------------------------------------------------------------------- enode-merge! [68] 100.0% [84] 2344(0.1%) 2344(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------------- for-loop [69] 100.0% [85] 996(0.1%) 0(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [94] 100.0% ------------------------------------------------------------------------------------------- for-loop [69] 100.0% [86] 358(0.0%) 0(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [94] 100.0% ------------------------------------------------------------------------------------------- new-enode [73] 100.0% [87] 447590(24.1%) 10366(0.6%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [98] 97.5% parse-loop12 [192] 0.2% ------------------------------------------------------------------------------------------- for-loop [74] 100.0% [88] 144824(7.8%) 1900(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [99] 98.7% ------------------------------------------------------------------------------------------- oracle-error [75] 100.0% [89] 48842(2.6%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:288:2 loop [150] 64.1% map [100] 35.9% ------------------------------------------------------------------------------------------- rewriter [79] 100.0% [90] 5982(0.3%) 308(0.0%) for-loop ...me-testing/src/core/matcher.rkt:134:10 matcher [103] 99.3% ------------------------------------------------------------------------------------------- prepare-points [77] 100.0% [91] 3832(0.2%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 make-exacts* [101] 73.6% loop [102] 26.4% ------------------------------------------------------------------------------------------- ??? [80] 100.0% [92] 2692(0.1%) 2692(0.1%) for-loop ...egime-testing/src/core/ematch.rkt:51:7 ------------------------------------------------------------------------------------------- update-leader! [62] 24.6% mk-enode! [61] 27.3% new-enode [73] 48.0% [93] 2598(0.1%) 1956(0.1%) mutable-set .../racket/private/set-types.rkt:999:0 for-loop [105] 24.7% ------------------------------------------------------------------------------------------- ormap [86] 20.9% for-loop [69] 21.1% loop [85] 58.0% [94] 1716(0.1%) 358(0.0%) flag-set? ...ie/regime-testing/src/config.rkt:34:0 return/no-unsupplied [182] 58.0% ??? [180] 21.1% ------------------------------------------------------------------------------------------- custom-set-union! [83] 100.0% [95] 1636(0.1%) 1636(0.1%) for-loop ...cts/racket/private/set-types.rkt:253:4 ------------------------------------------------------------------------------------------- for-loop [104] 50.0% rewriter [79] 50.0% [96] 692(0.0%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [104] 100.0% ------------------------------------------------------------------------------------------- prepare-points [77] 100.0% [97] 312(0.0%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [106] 100.0% ------------------------------------------------------------------------------------------- type-of-enode-expr [87] 100.0% [98] 436236(23.5%) 7878(0.4%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ??? [108] 37.5% ??? [161] 32.7% ??? [107] 14.9% ...sting/src/common.rkt:48:2 [110] 13.2% ------------------------------------------------------------------------------------------- for-loop [88] 100.0% [99] 142924(7.7%) 1014(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [109] 99.3% ------------------------------------------------------------------------------------------- ??? [6] 1.4% ??? [14] 1.5% f137 [143] 18.0% for-loop [89] 79.1% [100] 22128(1.2%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [150] 78.9% f137 [143] 6.8% parse-loop12 [192] 6.3% simplify-node [112] 3.6% ??? [5] 1.6% ??? [152] 1.5% ??? [14] 0.9% ??? [114] 0.4% ------------------------------------------------------------------------------------------- loop [91] 17.0% prepare-points [77] 83.0% [101] 16576(0.9%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 eval-prog [140] 55.9% loop [150] 44.1% ------------------------------------------------------------------------------------------- loop [91] 14.5% prepare-points [77] 85.5% [102] 7000(0.4%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [150] 95.5% ??? [142] 4.5% ------------------------------------------------------------------------------------------- for-loop [111] 24.8% matcher [103] 27.0% for-loop [90] 48.2% [103] 5982(0.3%) 0(0.0%) matcher ...gime-testing/src/core/matcher.rkt:167:2 rewriter [79] 45.5% matcher [103] 27.0% for-loop [111] 24.8% for-loop [113] 2.7% ------------------------------------------------------------------------------------------- expression->type [96] 100.0% [104] 692(0.0%) 336(0.0%) for-loop ...regime-testing/src/type-check.rkt:52:5 expression->type [96] 50.0% f137 [143] 25.7% ------------------------------------------------------------------------------------------- mutable-set [93] 100.0% [105] 642(0.0%) 642(0.0%) for-loop ...cts/racket/private/set-types.rkt:943:2 ------------------------------------------------------------------------------------------- for-loop [97] 100.0% [106] 312(0.0%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 ??? [152] 100.0% ------------------------------------------------------------------------------------------- f137 [143] 0.5% ??? [246] 2.5% substitute-e [54] 5.3% variable? [7] 12.2% match-e [42] 16.7% finalize-iter! [45] 29.1% get-sigs [98] 33.3% [107] 194526(10.5%) 53466(2.9%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [116] 42.9% for-loop [119] 28.8% ??? [246] 0.2% ------------------------------------------------------------------------------------------- f137 [143] 0.4% ??? [152] 0.6% for-loop [53] 3.8% get-sigs [98] 95.3% [108] 171612(9.2%) 15664(0.8%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [118] 47.7% for-loop [117] 36.6% get/build-late-neg-projection [141] 5.8% ??? [236] 0.4% ??? [239] 0.2% ??? [123] 0.2% ------------------------------------------------------------------------------------------- hash-update! [99] 100.0% [109] 141910(7.6%) 1980(0.1%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [115] 98.2% make-sequence [191] 0.4% ------------------------------------------------------------------------------------------- f137 [143] 0.5% ??? [152] 3.0% get-sigs [98] 44.0% for-loop [53] 52.3% [110] 130424(7.0%) 38482(2.1%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [120] 37.3% ??? [121] 32.2% ------------------------------------------------------------------------------------------- matcher [103] 100.0% [111] 5662(0.3%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:183:21 matcher [103] 100.0% ------------------------------------------------------------------------------------------- map [100] 100.0% [112] 1034(0.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 append-map [155] 100.0% ------------------------------------------------------------------------------------------- matcher [103] 100.0% [113] 978(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/matcher.rkt:159:6 pattern-substitute [122] 69.1% pattern-match [128] 30.9% ------------------------------------------------------------------------------------------- map [100] 100.0% [114] 324(0.0%) 0(0.0%) ??? ...bie/regime-testing/src/core/reduce.rkt:61:5 for-loop [124] 100.0% ------------------------------------------------------------------------------------------- ??? [109] 100.0% [115] 139324(7.5%) 114156(6.1%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 update-en-expr [178] 18.1% ------------------------------------------------------------------------------------------- mk-enode! [61] 8.6% ??? [107] 91.4% [116] 93674(5.0%) 26590(1.4%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [176] 68.7% ??? [193] 2.9% ------------------------------------------------------------------------------------------- for-loop [205] 23.6% ??? [108] 76.4% [117] 82106(4.4%) 18330(1.0%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [206] 74.9% ??? [249] 2.8% ------------------------------------------------------------------------------------------- ??? [108] 100.0% [118] 81860(4.4%) 4958(0.3%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [125] 93.9% ------------------------------------------------------------------------------------------- ??? [107] 100.0% [119] 58140(3.1%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [126] 100.0% ------------------------------------------------------------------------------------------- ...sting/src/common.rkt:48:2 [110] 100.0% [120] 48656(2.6%) 15434(0.8%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [180] 30.0% assoc-ref [127] 19.4% return/no-unsupplied [182] 18.8% ------------------------------------------------------------------------------------------- for-loop [233] 8.0% ??? [206] 13.6% ...sting/src/common.rkt:48:2 [110] 78.5% [121] 41936(2.3%) 8136(0.4%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [206] 65.0% ??? [246] 14.3% ??? [236] 8.6% ------------------------------------------------------------------------------------------- for-loop [113] 38.2% pattern-substitute [122] 61.8% [122] 676(0.0%) 0(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [122] 61.8% variable? [7] 38.2% ------------------------------------------------------------------------------------------- ??? [108] 100.0% [123] 324(0.0%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:69:2 get-blame-party-info [129] 100.0% ------------------------------------------------------------------------------------------- ??? [114] 100.0% [124] 324(0.0%) 0(0.0%) for-loop ...egime-testing/src/core/reduce.rkt:62:7 pattern-match [128] 100.0% ------------------------------------------------------------------------------------------- ??? [118] 100.0% [125] 76902(4.1%) 2622(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [130] 96.6% ------------------------------------------------------------------------------------------- for-loop [119] 98.9% [126] 58780(3.2%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [131] 93.2% override-at-pnts [132] 6.3% loop [150] 0.5% ------------------------------------------------------------------------------------------- ??? [120] 100.0% [127] 9458(0.5%) 9458(0.5%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------------------- for-loop [113] 48.2% for-loop [124] 51.8% [128] 626(0.0%) 324(0.0%) pattern-match ...testing/src/core/matcher.rkt:48:0 for-loop [133] 48.2% ------------------------------------------------------------------------------------------- ??? [123] 100.0% [129] 324(0.0%) 324(0.0%) get-blame-party-info ...ate/arrow-common.rkt:136:0 ------------------------------------------------------------------------------------------- ??? [125] 100.0% [130] 74280(4.0%) 4104(0.2%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [135] 94.5% ------------------------------------------------------------------------------------------- atab-add-altn [126] 100.0% [131] 54796(2.9%) 334(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [134] 73.0% alt-errors [136] 25.8% for-loop [137] 0.6% ------------------------------------------------------------------------------------------- atab-add-altn [126] 100.0% [132] 3676(0.2%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:145:0 eval-errors [134] 82.9% alt-errors [136] 17.1% ------------------------------------------------------------------------------------------- pattern-match [128] 100.0% [133] 302(0.0%) 302(0.0%) for-loop ...gime-testing/src/core/matcher.rkt:66:9 ------------------------------------------------------------------------------------------- composed [225] 0.4% pred [256] 0.7% ??? [60] 2.2% option-on-expr [163] 2.9% override-at-pnts [132] 3.0% loop [150] 21.3% ??? [6] 29.9% best-and-tied-at-points [131] 39.6% [134] 101050(5.4%) 0(0.0%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [138] 99.7% ------------------------------------------------------------------------------------------- ??? [130] 100.0% [135] 70176(3.8%) 14618(0.8%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [139] 48.0% get/build-late-neg-projection [141] 31.2% ------------------------------------------------------------------------------------------- override-at-pnts [132] 3.3% composed [225] 5.0% option-on-expr [163] 8.4% loop [150] 10.2% best-and-tied-at-points [131] 73.1% [136] 19324(1.0%) 0(0.0%) alt-errors ...ime-testing/src/alternative.rkt:59:0 eval-prog [140] 100.0% ------------------------------------------------------------------------------------------- best-and-tied-at-points [131] 100.0% [137] 312(0.0%) 0(0.0%) for-loop ...-testing/src/core/alt-table.rkt:124:16 ??? [148] 100.0% ------------------------------------------------------------------------------------------- eval-errors [134] 100.0% [138] 100740(5.4%) 3000(0.2%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [142] 86.6% ??? [152] 6.5% ulp-difference [168] 3.6% ??? [148] 0.3% ------------------------------------------------------------------------------------------- for-loop [135] 100.0% [139] 33688(1.8%) 33688(1.8%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------------------- sindices->spoints [184] 0.9% loop [150] 2.0% point->alt [201] 3.0% pred [256] 8.1% make-exacts* [101] 27.9% alt-errors [136] 58.1% [140] 33260(1.8%) 4310(0.2%) eval-prog ...regime-testing/src/programs.rkt:150:0 f137 [143] 56.9% hash-ref! [164] 26.2% ??? [147] 2.0% go [149] 1.0% ??? [152] 1.0% ------------------------------------------------------------------------------------------- unconstrained-domain->-projection [146] 1.6% ??? [145] 12.1% ??? [108] 17.8% for-loop [135] 68.6% [141] 31884(1.7%) 5322(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [144] 69.7% ??? [145] 13.1% unconstrained-domain->-projection [146] 2.6% ------------------------------------------------------------------------------------------- loop [102] 0.2% ??? [238] 1.4% jloop [9] 2.6% loop [258] 4.4% loop [150] 16.7% ??? [5] 18.9% for-loop [138] 55.9% [142] 156176(8.4%) 2862(0.2%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [151] 89.2% ??? [152] 7.4% ??? [154] 1.3% ??? [156] 0.2% ------------------------------------------------------------------------------------------- free-variables [243] 0.1% for-loop [228] 0.1% ??? [14] 0.1% approximate9 [8] 0.1% hash-ref! [164] 0.2% loop [150] 0.2% for-loop [229] 0.3% parse-loop12 [192] 0.5% rewriter [79] 0.5% for-loop [104] 0.5% append-map [155] 0.8% map [100] 1.6% simplify [34] 3.0% eval-prog [140] 6.0% eval-const-expr [190] 7.5% f137 [143] 21.8% split-table [33] 56.7% [143] 64940(3.5%) 1344(0.1%) f137 .../collects/racket/match/compiler.rkt:507:40 loop [150] 53.2% f137 [143] 21.8% ??? [152] 6.1% map [100] 4.9% option-on-expr [163] 3.5% ??? [157] 2.1% ??? [156] 1.5% ??? [161] 1.1% ??? [107] 1.1% ??? [108] 1.0% ...sting/src/common.rkt:48:2 [110] 1.0% append-map [155] 0.9% taylor [158] 0.2% variable? [7] 0.1% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [141] 100.0% [144] 25574(1.4%) 6604(0.4%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [153] 74.2% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [141] 100.0% [145] 8012(0.4%) 322(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [141] 96.0% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [141] 100.0% [146] 1342(0.1%) 334(0.0%) unconstrained-domain->-projection ...rrow.rkt:60:0 get/build-late-neg-projection [141] 75.1% ------------------------------------------------------------------------------------------- eval-prog [140] 100.0% [147] 652(0.0%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [159] 100.0% ------------------------------------------------------------------------------------------- for-loop [137] 49.1% for-loop [138] 50.9% [148] 636(0.0%) 636(0.0%) ??? ...ket/collects/racket/private/for.rkt:1151:14 ------------------------------------------------------------------------------------------- eval-prog [140] 100.0% [149] 338(0.0%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [160] 100.0% ------------------------------------------------------------------------------------------- errors-score [28] 0.0% ??? [60] 0.0% atab-add-altn [126] 0.1% parse-loop12 [192] 0.1% loop [102] 0.2% make-exacts* [101] 0.2% option-on-expr [163] 1.2% match-e [42] 1.2% map-enodes [20] 1.2% map [100] 1.5% ??? [181] 1.8% for-loop [55] 1.9% for-loop [89] 2.4% baseline-error [76] 3.2% f137 [143] 7.9% loop! [162] 8.8% loop [150] 68.3% [150] 285410(15.4%) 14818(0.8%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [150] 68.3% loop! [162] 8.4% option-on-expr [163] 7.9% ??? [5] 2.4% ??? [6] 2.2% eval-errors [134] 1.8% hash-ref! [164] 1.8% ??? [142] 1.6% for-loop [166] 1.1% foldl [170] 0.6% curried [260] 0.6% alt-errors [136] 0.3% ??? [152] 0.2% ulp-difference [168] 0.1% set-precompute! [173] 0.1% f137 [143] 0.1% loop [174] 0.1% eval-prog [140] 0.0% ??? [14] 0.0% ??? [238] 0.0% ------------------------------------------------------------------------------------------- ??? [142] 100.0% [151] 139300(7.5%) 103728(5.6%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [165] 13.8% ??? [186] 7.0% ??? [169] 3.4% ??? [249] 1.0% parse-loop12 [192] 0.2% ------------------------------------------------------------------------------------------- get-final-combination [19] 0.7% ??? [106] 0.7% map [100] 0.7% eval-prog [140] 0.7% ??? [5] 0.7% loop [21] 1.1% loop [258] 1.3% ??? [195] 2.1% ??? [161] 4.2% for-loop [81] 4.2% loop [150] 8.4% for-loop [138] 13.2% ??? [142] 24.3% f137 [143] 36.5% [152] 47922(2.6%) 2368(0.1%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [161] 63.0% ??? [246] 12.6% ...sting/src/common.rkt:48:2 [110] 7.8% approximate9 [8] 3.9% hash-ref! [164] 3.2% ??? [108] 2.1% best-alt [172] 1.4% simplify [34] 0.3% ------------------------------------------------------------------------------------------- contract-struct-name [167] 13.0% ??? [144] 87.0% [153] 18970(1.0%) 10430(0.6%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [167] 55.5% ------------------------------------------------------------------------------------------- ??? [142] 100.0% [154] 2058(0.1%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [171] 100.0% ------------------------------------------------------------------------------------------- f137 [143] 39.7% simplify-node [112] 60.3% [155] 1716(0.1%) 1042(0.1%) append-map ...acket/collects/racket/list.rkt:565:2 parse-loop12 [192] 39.3% f137 [143] 33.3% ------------------------------------------------------------------------------------------- ??? [142] 20.1% ??? [5] 20.5% f137 [143] 59.4% [156] 1650(0.1%) 1312(0.1%) ??? ...tract/private/arrow-higher-order.rkt:145:21 ??? [249] 20.5% ------------------------------------------------------------------------------------------- f137 [143] 100.0% [157] 1618(0.1%) 642(0.0%) ??? ...tract/private/arrow-higher-order.rkt:336:46 ??? [246] 60.3% ------------------------------------------------------------------------------------------- f137 [143] 100.0% [158] 684(0.0%) 326(0.0%) taylor ...regime-testing/src/core/taylor.rkt:163:0 debug-print [220] 52.3% ------------------------------------------------------------------------------------------- ??? [147] 100.0% [159] 652(0.0%) 652(0.0%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------------------- go [149] 8.3% loop [160] 91.7% [160] 338(0.0%) 338(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [160] 91.7% ------------------------------------------------------------------------------------------- simplify-alt [37] 0.0% f137 [143] 0.0% ??? [152] 1.8% get-sigs [98] 2.9% ??? [161] 3.5% for-loop [53] 3.9% for-loop [175] 42.3% ??? [60] 45.3% [161] 1652590(88.9%) 98450(5.3%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [175] 42.3% iterate-egraph!13 [3] 37.4% loop [4] 8.0% ??? [176] 4.7% ??? [161] 3.5% ??? [180] 0.5% return/no-unsupplied [182] 0.4% mk-egraph [188] 0.2% ??? [152] 0.1% ??? [206] 0.1% dict? [259] 0.0% ??? [193] 0.0% ??? [203] 0.0% ------------------------------------------------------------------------------------------- for-loop [64] 5.5% merge-egraph-nodes! [52] 21.4% loop [150] 29.0% for-loop [41] 44.1% [162] 176500(9.5%) 30102(1.6%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 custom-set-union [177] 40.2% loop [150] 32.9% set [179] 10.9% update-en-expr [178] 5.9% ------------------------------------------------------------------------------------------- f137 [143] 6.7% loop [150] 93.3% [163] 42372(2.3%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [184] 31.0% sort-context-on-expr [185] 27.1% loop [150] 21.9% eval-errors [134] 6.9% alt-errors [136] 3.8% pick-errors [198] 3.7% err-lsts->split-indices [199] 3.1% point->alt [201] 2.3% ------------------------------------------------------------------------------------------- localize-error [50] 0.2% first-nonzero-exp [39] 0.2% ??? [36] 0.6% ??? [14] 0.6% for-loop [35] 0.8% for-loop [23] 1.2% for-loop [22] 1.7% loop [21] 1.8% ??? [194] 2.1% ??? [152] 2.9% update-leader! [62] 3.9% eval-prog [140] 9.0% loop [150] 11.7% compile [66] 27.6% ??? [181] 35.4% [164] 42112(2.3%) 24816(1.3%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [181] 50.4% bigfloat-hash [187] 8.7% ??? [11] 2.4% ??? [194] 2.1% ??? [195] 1.8% ??? [10] 1.7% simplify [34] 1.7% ??? [13] 0.8% f137 [143] 0.8% parse-loop12 [192] 0.8% ------------------------------------------------------------------------------------------- ??? [151] 100.0% [165] 19256(1.0%) 9104(0.5%) ??? ...regime-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [182] 28.7% ??? [180] 20.6% list-member? [183] 3.5% ------------------------------------------------------------------------------------------- map-enodes [20] 6.7% loop [150] 93.3% [166] 19078(1.0%) 5152(0.3%) for-loop ...me-testing/src/core/simplify.rkt:195:2 setfindf [189] 32.0% eval-const-expr [190] 30.8% compose [202] 5.0% curried [260] 3.5% ??? [186] 1.8% ------------------------------------------------------------------------------------------- build-compound-type-name [153] 100.0% [167] 12502(0.7%) 8540(0.5%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [153] 35.6% ------------------------------------------------------------------------------------------- loop [150] 12.8% ??? [5] 18.5% for-loop [138] 68.7% [168] 5328(0.3%) 2628(0.1%) ulp-difference ...egime-testing/src/float.rkt:19:0 ??? [180] 25.1% list-member? [183] 13.0% return/no-unsupplied [182] 12.6% ------------------------------------------------------------------------------------------- ??? [151] 100.0% [169] 4786(0.3%) 2030(0.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [196] 57.6% ------------------------------------------------------------------------------------------- for-loop [55] 24.0% loop [150] 76.0% [170] 4306(0.2%) 1936(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [197] 55.0% ------------------------------------------------------------------------------------------- ??? [154] 100.0% [171] 2058(0.1%) 1676(0.1%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [223] 18.6% ------------------------------------------------------------------------------------------- ??? [152] 100.0% [172] 1000(0.1%) 0(0.0%) best-alt ...erbie/regime-testing/src/glue.rkt:71:0 loop [200] 69.8% argmins [204] 30.2% ------------------------------------------------------------------------------------------- loop [150] 100.0% [173] 954(0.1%) 658(0.0%) set-precompute! ...ing/src/core/simplify.rkt:193:0 make-sequence [191] 31.0% ------------------------------------------------------------------------------------------- loop [150] 0.9% loop [174] 99.1% [174] 308(0.0%) 308(0.0%) loop ...ket/collects/racket/private/list.rkt:82:16 loop [174] 99.1% ------------------------------------------------------------------------------------------- ??? [161] 100.0% [175] 1499420(80.6%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ??? [161] 100.0% debug-print [220] 0.0% ??? [227] 0.0% ------------------------------------------------------------------------------------------- hash-has-key? [116] 22.1% ??? [161] 77.9% [176] 291786(15.7%) 118594(6.4%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [205] 42.8% ??? [230] 14.7% ??? [206] 0.8% successfully-got-the-right-kind-of-function [221] 0.6% arrow-higher-order:lnp [263] 0.5% ------------------------------------------------------------------------------------------- adopt-enode! [78] 5.8% loop! [162] 94.2% [177] 81854(4.4%) 27090(1.5%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [207] 57.6% for-loop [212] 9.3% ------------------------------------------------------------------------------------------- for-loop [69] 2.3% update-leader! [62] 5.2% for-loop [65] 10.3% loop! [162] 38.7% for-loop [115] 43.5% [178] 57868(3.1%) 56172(3.0%) update-en-expr ...esting/src/core/egraph.rkt:212:0 for-loop [219] 2.9% ------------------------------------------------------------------------------------------- new-enode [73] 8.9% loop! [162] 91.1% [179] 43416(2.3%) 43416(2.3%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------------------- flag-set? [94] 1.1% ulp-difference [168] 4.0% ??? [165] 11.7% ??? [161] 39.0% ??? [120] 43.3% [180] 33712(1.8%) 6416(0.3%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [208] 67.7% ??? [246] 13.3% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [181] 29014(1.6%) 3704(0.2%) ??? ...erbie/regime-testing/src/programs.rkt:194:5 hash-ref! [164] 72.4% loop [150] 23.1% ------------------------------------------------------------------------------------------- ulp-difference [168] 2.6% flag-set? [94] 3.8% ??? [165] 21.0% ??? [120] 34.8% ??? [161] 37.9% [182] 26338(1.4%) 20792(1.1%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [214] 21.1% ------------------------------------------------------------------------------------------- ??? [165] 3.7% ulp-difference [168] 3.8% for-loop [41] 92.5% [183] 18066(1.0%) 2024(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [211] 59.0% member [216] 29.8% ------------------------------------------------------------------------------------------- option-on-expr [163] 100.0% [184] 13142(0.7%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [209] 92.5% for-loop [228] 5.2% eval-prog [140] 2.3% ------------------------------------------------------------------------------------------- option-on-expr [163] 100.0% [185] 11502(0.6%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [210] 100.0% ------------------------------------------------------------------------------------------- for-loop [166] 3.4% ??? [151] 96.6% [186] 10110(0.5%) 10110(0.5%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [187] 7994(0.4%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [215] 71.0% sig+exp->bigfloat [218] 29.0% ------------------------------------------------------------------------------------------- ??? [161] 100.0% [188] 7428(0.4%) 0(0.0%) mk-egraph ...ime-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [213] 95.5% mk-enode! [61] 4.5% ------------------------------------------------------------------------------------------- for-loop [166] 100.0% [189] 6102(0.3%) 2850(0.2%) setfindf ...ie/regime-testing/src/common.rkt:187:0 for-loop [217] 53.3% ------------------------------------------------------------------------------------------- for-loop [166] 100.0% [190] 5868(0.3%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f137 [143] 83.5% ??? [227] 16.5% ------------------------------------------------------------------------------------------- set-precompute! [173] 5.7% reduce-to-single! [49] 6.7% ??? [109] 11.7% merge-egraph-nodes! [52] 19.1% update-leader! [62] 19.5% for-loop [31] 37.4% [191] 5188(0.3%) 3880(0.2%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [226] 25.2% ------------------------------------------------------------------------------------------- hash-ref! [164] 7.1% ??? [151] 7.6% simplify [34] 9.5% append-map [155] 11.2% parse-loop12 [192] 16.0% type-of-enode-expr [87] 21.6% map [100] 27.1% [192] 4576(0.2%) 3268(0.2%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 parse-loop12 [192] 16.0% for-loop [229] 11.2% loop [150] 9.4% f137 [143] 2.3% ------------------------------------------------------------------------------------------- ??? [161] 37.5% hash-has-key? [116] 62.5% [193] 4308(0.2%) 4308(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [194] 3934(0.2%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:44:15 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [195] 2976(0.2%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:67:15 ??? [152] 100.0% ------------------------------------------------------------------------------------------- ??? [169] 100.0% [196] 2756(0.1%) 2106(0.1%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [223] 23.6% ------------------------------------------------------------------------------------------- foldl [170] 100.0% [197] 2370(0.1%) 2370(0.1%) merge2 .../regime-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------------------- option-on-expr [163] 100.0% [198] 1582(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [222] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [163] 100.0% [199] 1330(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [224] 100.0% ------------------------------------------------------------------------------------------- extract-alt [38] 31.3% best-alt [172] 68.7% [200] 1016(0.1%) 0(0.0%) loop ...herbie/regime-testing/src/common.rkt:154:2 composed [225] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [163] 100.0% [201] 984(0.1%) 0(0.0%) point->alt ...e-testing/src/core/regimes.rkt:188:0 eval-prog [140] 100.0% ------------------------------------------------------------------------------------------- for-loop [166] 100.0% [202] 954(0.1%) 954(0.1%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------------------------- ??? [161] 100.0% [203] 344(0.0%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:60:15 ??? [223] 100.0% ------------------------------------------------------------------------------------------- best-alt [172] 100.0% [204] 302(0.0%) 0(0.0%) argmins ...bie/regime-testing/src/common.rkt:153:0 composed [225] 100.0% ------------------------------------------------------------------------------------------- ??? [176] 100.0% [205] 124786(6.7%) 62514(3.4%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [230] 29.8% for-loop [117] 15.5% ??? [236] 3.5% ??? [246] 0.8% arrow-higher-order:lnp [263] 0.3% ------------------------------------------------------------------------------------------- ??? [176] 2.2% ??? [161] 2.7% ??? [121] 35.3% for-loop [117] 59.8% [206] 102844(5.5%) 17100(0.9%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [231] 58.2% for-loop [233] 12.9% ??? [121] 11.1% ??? [249] 1.2% ------------------------------------------------------------------------------------------- custom-set-union [177] 100.0% [207] 47146(2.5%) 13654(0.7%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [232] 71.0% ------------------------------------------------------------------------------------------- ??? [180] 100.0% [208] 22808(1.2%) 21480(1.2%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [239] 5.8% ------------------------------------------------------------------------------------------- sindices->spoints [184] 100.0% [209] 12160(0.7%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 sidx->spoint [234] 100.0% ------------------------------------------------------------------------------------------- localize-error [50] 2.6% sort-context-on-expr [185] 97.4% [210] 11810(0.6%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [235] 88.8% loop [258] 11.2% ------------------------------------------------------------------------------------------- list-member? [183] 100.0% [211] 10664(0.6%) 10664(0.6%) loop (unknown source) ------------------------------------------------------------------------------------------- custom-set-union [177] 100.0% [212] 7618(0.4%) 7618(0.4%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------------------- mk-egraph [188] 45.1% mk-enode-rec! [213] 54.9% [213] 7096(0.4%) 324(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [213] 54.9% mk-enode! [61] 44.5% ------------------------------------------------------------------------------------------- for-loop [55] 4.6% for-loop [31] 4.8% one-iter [17] 9.0% return/no-unsupplied [182] 81.7% [214] 6792(0.4%) 6792(0.4%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------------------- bigfloat-hash [187] 100.0% [215] 5674(0.3%) 5674(0.3%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ------------------------------------------------------------------------------------------- list-member? [183] 100.0% [216] 5378(0.3%) 5378(0.3%) member (unknown source) ------------------------------------------------------------------------------------------- setfindf [189] 100.0% [217] 3252(0.2%) 3252(0.2%) for-loop ...ie/regime-testing/src/common.rkt:188:2 ------------------------------------------------------------------------------------------- bigfloat-hash [187] 100.0% [218] 2320(0.1%) 2320(0.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ------------------------------------------------------------------------------------------- update-en-expr [178] 100.0% [219] 1696(0.1%) 1696(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:214:6 ------------------------------------------------------------------------------------------- for-loop [175] 21.3% taylor [158] 21.5% simplify [34] 57.2% [220] 1668(0.1%) 714(0.0%) debug-print .../regime-testing/src/debug.rkt:107:0 for-loop [241] 57.2% ------------------------------------------------------------------------------------------- ??? [176] 100.0% [221] 1658(0.1%) 1334(0.1%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [245] 19.5% ------------------------------------------------------------------------------------------- pick-errors [198] 100.0% [222] 1582(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:203:2 ??? [238] 100.0% ------------------------------------------------------------------------------------------- ??? [203] 25.0% real->bigfloat [171] 27.8% bfdiv [196] 47.2% [223] 1376(0.1%) 1376(0.1%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------------------- err-lsts->split-indices [199] 100.0% [224] 1330(0.1%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [240] 100.0% ------------------------------------------------------------------------------------------- argmins [204] 22.9% loop [200] 77.1% [225] 1318(0.1%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 alt-errors [136] 72.7% eval-errors [134] 27.3% ------------------------------------------------------------------------------------------- make-sequence [191] 100.0% [226] 1308(0.1%) 346(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [237] 73.5% ------------------------------------------------------------------------------------------- for-loop [175] 24.4% eval-const-expr [190] 75.6% [227] 1278(0.1%) 640(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [242] 49.9% ------------------------------------------------------------------------------------------- sindices->spoints [184] 100.0% [228] 682(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:137:2 f137 [143] 50.7% free-variables [243] 49.3% ------------------------------------------------------------------------------------------- parse-loop12 [192] 100.0% [229] 674(0.0%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:89:11 f137 [143] 51.6% make-multiplication-node [244] 48.4% ------------------------------------------------------------------------------------------- for-loop [205] 46.5% ??? [176] 53.5% [230] 80102(4.3%) 34508(1.9%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [247] 56.9% ------------------------------------------------------------------------------------------- ??? [206] 100.0% [231] 59810(3.2%) 4890(0.3%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [246] 88.5% ??? [249] 3.3% ------------------------------------------------------------------------------------------- for-loop [207] 100.0% [232] 33492(1.8%) 33492(1.8%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------------------- ??? [206] 100.0% [233] 13270(0.7%) 6598(0.4%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [121] 50.3% ------------------------------------------------------------------------------------------- loop [209] 100.0% [234] 12160(0.7%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [250] 58.9% pred [256] 41.1% ------------------------------------------------------------------------------------------- ??? [210] 100.0% [235] 10484(0.6%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [248] 78.6% loop [258] 18.5% jloop [9] 2.9% ------------------------------------------------------------------------------------------- ??? [108] 7.6% ??? [121] 41.6% for-loop [205] 50.8% [236] 8704(0.5%) 1910(0.1%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [251] 78.1% ------------------------------------------------------------------------------------------- ??? [226] 19.5% match-e [42] 80.5% [237] 4942(0.3%) 4942(0.3%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------------------- loop [150] 29.3% for-loop [222] 70.7% [238] 2238(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/regimes.rkt:194:2 ??? [142] 100.0% ------------------------------------------------------------------------------------------- ??? [108] 20.0% ??? [208] 80.0% [239] 1660(0.1%) 1660(0.1%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------------------- add-splitpoint [224] 100.0% [240] 1330(0.1%) 336(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:255:4 for-loop [252] 74.7% ------------------------------------------------------------------------------------------- debug-print [220] 100.0% [241] 954(0.1%) 954(0.1%) for-loop ...bie/regime-testing/src/debug.rkt:113:2 ------------------------------------------------------------------------------------------- ??? [227] 100.0% [242] 638(0.0%) 0(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 maybe-cons-kwd [253] 100.0% ------------------------------------------------------------------------------------------- for-loop [228] 100.0% [243] 336(0.0%) 0(0.0%) free-variables ...e-testing/src/programs.rkt:102:0 f137 [143] 100.0% ------------------------------------------------------------------------------------------- for-loop [229] 100.0% [244] 326(0.0%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [254] 100.0% ------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [221]100.0% [245] 324(0.0%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [255] 100.0% ------------------------------------------------------------------------------------------- ??? [107] 0.4% for-loop [205] 1.2% ??? [157] 1.3% ??? [180] 5.8% ??? [152] 7.8% ??? [121] 15.4% ??? [231] 68.1% [246] 77682(4.2%) 57498(3.1%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [257] 12.8% ??? [107] 9.0% dict? [259] 4.1% ------------------------------------------------------------------------------------------- ??? [230] 100.0% [247] 45594(2.5%) 45594(2.5%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------------------- generic-sort/key [235] 49.2% copying-mergesort [248] 50.8% [248] 8238(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [248] 50.8% loop [258] 36.9% jloop [9] 12.2% ------------------------------------------------------------------------------------------- ??? [156] 4.6% ??? [206] 17.5% ??? [151] 19.4% ??? [231] 27.2% for-loop [117] 31.2% [249] 7280(0.4%) 4630(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [262] 36.4% ------------------------------------------------------------------------------------------- sidx->spoint [234] 100.0% [250] 7168(0.4%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [256] 100.0% ------------------------------------------------------------------------------------------- ??? [236] 100.0% [251] 6794(0.4%) 3590(0.2%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [261] 47.2% ------------------------------------------------------------------------------------------- for-loop [240] 100.0% [252] 994(0.1%) 334(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:259:8 curried [260] 66.4% ------------------------------------------------------------------------------------------- unpack245 [242] 100.0% [253] 638(0.0%) 0(0.0%) maybe-cons-kwd ...ate/arrow-higher-order.rkt:498:0 arrow-higher-order:lnp [263] 100.0% ------------------------------------------------------------------------------------------- make-multiplication-node [244] 100.0% [254] 326(0.0%) 326(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 ------------------------------------------------------------------------------------------- arity-checking-wrapper [245] 100.0% [255] 324(0.0%) 324(0.0%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ------------------------------------------------------------------------------------------- sidx->spoint [234] 41.1% binary-search-floats [250] 58.9% [256] 12160(0.7%) 0(0.0%) pred ...regime-testing/src/core/regimes.rkt:151:17 prepare-points [77] 72.1% eval-prog [140] 22.2% eval-errors [134] 5.7% ------------------------------------------------------------------------------------------- ??? [246] 100.0% [257] 9964(0.5%) 9964(0.5%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------------------- ??? [210] 17.8% generic-sort/key [235] 26.0% copying-mergesort [248] 56.3% [258] 7468(0.4%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [142] 91.7% ??? [152] 8.3% ------------------------------------------------------------------------------------------- ??? [161] 35.6% ??? [246] 64.4% [259] 4956(0.3%) 4956(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------------------- for-loop [55] 9.8% for-loop [166] 20.0% for-loop [252] 20.0% loop [150] 50.3% [260] 3302(0.2%) 3302(0.2%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------------------- check-hash/c [251] 100.0% [261] 3204(0.2%) 3204(0.2%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------------------- ??? [249] 100.0% [262] 2650(0.1%) 1666(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [265] 37.1% ------------------------------------------------------------------------------------------- for-loop [205] 12.8% maybe-cons-kwd [253] 25.0% ??? [176] 62.3% [263] 2556(0.1%) 962(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [264] 62.4% ------------------------------------------------------------------------------------------- arrow-higher-order:lnp [263] 100.0% [264] 1594(0.1%) 1282(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 procedure-arity [266] 19.6% ------------------------------------------------------------------------------------------- ??? [262] 100.0% [265] 984(0.1%) 984(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 ------------------------------------------------------------------------------------------- ??? [264] 13.2% curry* [72] 86.8% [266] 2360(0.1%) 2360(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 -------------------------------------------------------------------------------------------