Profiling results ----------------- Total cpu time observed: 496764ms (out of 498352ms) Number of samples taken: 1653 (once every 301ms) (Hiding functions with self<1.0% and local<2.0%: 19 of 272 hidden) ========================================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================= ??? [62] 100.0% [1] 421168(84.8%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [19] 100.0% ----------------------------------------------------------------------------------------- ??? [62] 100.0% [2] 403730(81.3%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 for-loop [20] 95.6% get-final-combination [23] 4.2% setup-alt-simplified [32] 0.1% prepare-points [77] 0.1% ----------------------------------------------------------------------------------------- ??? [168] 100.0% [3] 386426(77.8%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [21] 99.1% ----------------------------------------------------------------------------------------- ??? [168] 100.0% [4] 36420(7.3%) 0(0.0%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [22] 100.0% ----------------------------------------------------------------------------------------- ??? [167] 100.0% [5] 8664(1.7%) 0(0.0%) approximate9 ...e-testing/src/core/taylor.rkt:12:0 loop [24] 64.3% f45 [91] 20.7% for-loop [28] 15.0% ----------------------------------------------------------------------------------------- map [106] 3.4% loop [165] 96.6% [6] 5884(1.2%) 218(0.0%) ??? ...herbie/regime-testing/src/points.rkt:292:26 ??? [163] 85.8% ??? [167] 7.1% ulp-difference [177] 3.4% ----------------------------------------------------------------------------------------- hash-ref! [170] 100.0% [7] 4938(1.0%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:44:15 hash-ref! [170] 93.9% ??? [33] 6.1% ----------------------------------------------------------------------------------------- hash-ref! [170] 100.0% [8] 4680(0.9%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:295:23 for-loop [25] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [170] 100.0% [9] 3956(0.8%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:285:26 for-loop [26] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [170] 100.0% [10] 2138(0.4%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:338:33 for-loop [29] 59.0% hash-ref! [170] 41.0% ----------------------------------------------------------------------------------------- copying-mergesort [233] 100.0% [11] 1502(0.3%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [163] 85.1% ??? [167] 14.9% ----------------------------------------------------------------------------------------- hash-ref! [170] 100.0% [12] 1342(0.3%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:392:23 for-loop [27] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [170] 100.0% [13] 978(0.2%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:322:33 for-loop [30] 100.0% ----------------------------------------------------------------------------------------- f45 [91] 100.0% [14] 926(0.2%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [39] 67.8% first-nonzero-exp [124] 32.2% ----------------------------------------------------------------------------------------- hash-ref! [170] 100.0% [15] 820(0.2%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:483:23 for-loop [31] 100.0% ----------------------------------------------------------------------------------------- loop [165] 47.6% for-loop [218] 52.4% [16] 458(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/regimes.rkt:194:2 ??? [163] 100.0% ----------------------------------------------------------------------------------------- f45 [91] 100.0% [17] 278(0.1%) 0(0.0%) taylor-exp ...me-testing/src/core/taylor.rkt:386:0 simplify [39] 100.0% ----------------------------------------------------------------------------------------- f45 [91] 100.0% [18] 250(0.1%) 0(0.0%) loop ...e/regime-testing/src/core/taylor.rkt:262:2 hash-ref! [170] 100.0% ----------------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [19] 421168(84.8%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [62] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [20] 385972(77.7%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [34] 100.0% ----------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [21] 382892(77.1%) 5980(1.2%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [35] 68.9% for-loop [36] 29.3% filter [213] 0.1% ----------------------------------------------------------------------------------------- loop [4] 100.0% [22] 36420(7.3%) 336(0.1%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [37] 98.1% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [23] 17122(3.4%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:266:0 split-table [38] 97.7% extract-alt [42] 1.2% ??? [167] 1.2% ----------------------------------------------------------------------------------------- approximate9 [5] 100.0% [24] 5572(1.1%) 0(0.0%) loop ...ie/regime-testing/src/core/taylor.rkt:86:4 hash-ref! [170] 90.1% ??? [167] 9.9% ----------------------------------------------------------------------------------------- ??? [8] 100.0% [25] 4680(0.9%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:298:27 hash-ref! [170] 100.0% ----------------------------------------------------------------------------------------- ??? [9] 100.0% [26] 3956(0.8%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:285:52 hash-ref! [170] 93.7% simplify [39] 6.3% ----------------------------------------------------------------------------------------- ??? [12] 100.0% [27] 1342(0.3%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:396:33 for-loop [40] 100.0% ----------------------------------------------------------------------------------------- approximate9 [5] 100.0% [28] 1300(0.3%) 0(0.0%) for-loop ...gime-testing/src/core/taylor.rkt:29:18 f45 [91] 100.0% ----------------------------------------------------------------------------------------- ??? [10] 100.0% [29] 1262(0.3%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:341:46 hash-ref! [170] 100.0% ----------------------------------------------------------------------------------------- ??? [13] 100.0% [30] 978(0.2%) 318(0.1%) for-loop ...ime-testing/src/core/taylor.rkt:324:46 hash-ref! [170] 67.5% ----------------------------------------------------------------------------------------- ??? [15] 100.0% [31] 820(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:487:35 parse-loop12 [120] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [32] 324(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [41] 100.0% ----------------------------------------------------------------------------------------- ??? [7] 100.0% [33] 300(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:288:19 hash-ref! [170] 100.0% ----------------------------------------------------------------------------------------- for-loop [20] 100.0% [34] 385972(77.7%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [43] 92.6% finalize-iter! [47] 4.3% gen-series! [48] 2.3% gen-rewrites! [50] 0.3% localize-error [51] 0.3% ----------------------------------------------------------------------------------------- one-iter [21] 100.0% [35] 263908(53.1%) 2314(0.5%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [44] 87.3% match-e [45] 11.3% update-leader! [65] 0.3% ----------------------------------------------------------------------------------------- for-loop [36] 48.8% one-iter [21] 51.2% [36] 112096(22.6%) 23168(4.7%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [36] 48.8% match-e [45] 39.4% ??? [80] 0.2% ----------------------------------------------------------------------------------------- pass [22] 100.0% [37] 35728(7.2%) 912(0.2%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [46] 61.2% loop [95] 27.6% for-loop [49] 5.9% make-sequence [82] 1.9% ----------------------------------------------------------------------------------------- get-final-combination [23] 100.0% [38] 16720(3.4%) 0(0.0%) split-table ...e/regime-testing/src/glue.rkt:162:0 f45 [91] 100.0% ----------------------------------------------------------------------------------------- for-loop [26] 3.2% ??? [167] 3.2% taylor-exp [17] 3.5% first-nonzero-exp [124] 3.8% taylor-invert [14] 8.0% hash-ref! [170] 78.4% [39] 7890(1.6%) 0(0.0%) simplify ...egime-testing/src/core/reduce.rkt:16:0 f45 [91] 65.5% parse-loop12 [120] 15.9% simplify-node [52] 7.6% simplify* [122] 7.2% debug7 [53] 3.8% ----------------------------------------------------------------------------------------- for-loop [27] 100.0% [40] 1342(0.3%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:398:39 hash-ref! [170] 100.0% ----------------------------------------------------------------------------------------- setup-alt-simplified [32] 100.0% [41] 324(0.1%) 0(0.0%) simplify-alt ...e/regime-testing/src/glue.rkt:76:0 ??? [168] 100.0% ----------------------------------------------------------------------------------------- get-final-combination [23] 100.0% [42] 204(0.0%) 0(0.0%) extract-alt ...ie/regime-testing/src/glue.rkt:55:0 argmins [54] 100.0% ----------------------------------------------------------------------------------------- run-iter! [34] 100.0% [43] 357264(71.9%) 0(0.0%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [55] 100.0% ----------------------------------------------------------------------------------------- for-loop [35] 100.0% [44] 230412(46.4%) 950(0.2%) for-loop ...e-testing/src/core/simplify.rkt:148:10 mk-enode! [63] 31.8% loop! [75] 24.7% merge-egraph-nodes! [57] 24.6% substitute-e [58] 14.8% list-member? [183] 3.6% ----------------------------------------------------------------------------------------- for-loop [35] 16.5% for-loop [64] 23.3% for-loop [36] 60.2% [45] 118192(23.8%) 42082(8.5%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [56] 49.6% for-loop [64] 8.6% ??? [136] 5.3% variable? [130] 3.1% custom-in-set [110] 1.4% loop [165] 1.1% list-cartesian-product [67] 1.0% curry* [71] 0.1% ----------------------------------------------------------------------------------------- for-loop [37] 100.0% [46] 21852(4.4%) 474(0.1%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [103] 89.7% expression-cost [109] 8.2% ----------------------------------------------------------------------------------------- run-iter! [34] 100.0% [47] 16486(3.3%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [136] 100.0% ----------------------------------------------------------------------------------------- run-iter! [34] 100.0% [48] 8918(1.8%) 0(0.0%) gen-series! ...gime-testing/src/mainloop.rkt:129:0 for-loop [59] 100.0% ----------------------------------------------------------------------------------------- for-loop [37] 100.0% [49] 2124(0.4%) 2124(0.4%) for-loop ...e-testing/src/core/simplify.rkt:217:13 ----------------------------------------------------------------------------------------- run-iter! [34] 100.0% [50] 1318(0.3%) 0(0.0%) gen-rewrites! ...me-testing/src/mainloop.rkt:142:0 for-loop [61] 100.0% ----------------------------------------------------------------------------------------- run-iter! [34] 100.0% [51] 990(0.2%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [170] 100.0% ----------------------------------------------------------------------------------------- simplify [39] 100.0% [52] 600(0.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 append-map [60] 100.0% ----------------------------------------------------------------------------------------- simplify [39] 100.0% [53] 298(0.1%) 298(0.1%) debug7 ...erbie/regime-testing/src/debug.rkt:102:0 ----------------------------------------------------------------------------------------- extract-alt [42] 100.0% [54] 204(0.0%) 0(0.0%) argmins ...bie/regime-testing/src/common.rkt:153:0 composed [208] 100.0% ----------------------------------------------------------------------------------------- simplify! [43] 100.0% [55] 357264(71.9%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [62] 100.0% ----------------------------------------------------------------------------------------- match-e [45] 100.0% [56] 73366(14.8%) 27116(5.5%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [64] 50.1% list-cartesian-product [67] 8.4% loop [165] 7.0% curry* [71] 1.3% foldl [175] 0.5% curried [176] 0.4% ----------------------------------------------------------------------------------------- for-loop [66] 4.9% merge-egraph-nodes! [57] 5.6% for-loop [44] 89.4% [57] 56664(11.4%) 1624(0.3%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [65] 41.6% loop! [75] 16.6% for-loop [69] 14.9% for-loop [66] 11.6% merge-egraph-nodes! [57] 5.6% enode-merge! [70] 3.7% for-loop [209] 1.9% make-sequence [82] 1.2% ----------------------------------------------------------------------------------------- substitute-e [58] 7.7% for-loop [44] 92.3% [58] 34212(6.9%) 2658(0.5%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [63] 82.7% substitute-e [58] 7.7% ??? [136] 2.6% variable? [130] 1.4% ----------------------------------------------------------------------------------------- gen-series! [48] 100.0% [59] 8918(1.8%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:135:7 taylor-alt [68] 100.0% ----------------------------------------------------------------------------------------- simplify-node [52] 40.1% f45 [91] 59.9% [60] 1496(0.3%) 254(0.1%) append-map ...acket/collects/racket/list.rkt:565:2 parse-loop12 [120] 40.1% free-variables [73] 32.1% f45 [91] 25.0% ----------------------------------------------------------------------------------------- gen-rewrites! [50] 100.0% [61] 1318(0.3%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:147:11 ??? [72] 100.0% ----------------------------------------------------------------------------------------- for-loop [55] 24.2% run [19] 30.7% [62] 492382(99.1%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [168] 37.9% profile-thunk16 [1] 30.7% run-improve50 [2] 29.2% oracle-error [78] 1.1% prepare-points [77] 0.9% eval-errors [153] 0.2% loop [246] 0.0% loop [165] 0.0% baseline-error [88] 0.0% ----------------------------------------------------------------------------------------- mk-egraph [190] 0.6% mk-enode-rec! [210] 1.4% substitute-e [58] 27.3% for-loop [44] 70.7% [63] 103684(20.9%) 7786(1.6%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [74] 91.3% hash-has-key? [140] 0.9% ----------------------------------------------------------------------------------------- match-e [45] 30.7% for-loop [56] 69.3% [64] 57276(11.5%) 3542(0.7%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [45] 88.1% ??? [80] 6.9% ----------------------------------------------------------------------------------------- for-loop [35] 2.7% merge-egraph-nodes! [57] 97.3% [65] 26652(5.4%) 3782(0.8%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [76] 78.0% update-en-expr [220] 3.5% custom-set-union! [86] 2.2% make-sequence [82] 2.1% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [57] 100.0% [66] 9574(1.9%) 0(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [57] 59.0% loop! [75] 41.0% ----------------------------------------------------------------------------------------- match-e [45] 15.8% list-cartesian-product [67] 19.5% for-loop [56] 64.7% [67] 9236(1.9%) 7958(1.6%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [67] 19.5% for-loop [84] 13.8% ----------------------------------------------------------------------------------------- for-loop [59] 100.0% [68] 8918(1.8%) 0(0.0%) taylor-alt ...ie/regime-testing/src/glue.rkt:134:0 for-loop [79] 100.0% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [57] 100.0% [69] 8614(1.7%) 7636(1.5%) for-loop ...gime-testing/src/core/egraph.rkt:233:6 update-en-expr [220] 11.4% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [57] 100.0% [70] 2288(0.5%) 0(0.0%) enode-merge! ...e-testing/src/core/enode.rkt:129:0 adopt-enode! [81] 84.3% custom-set-intersect! [87] 15.7% ----------------------------------------------------------------------------------------- match-e [45] 20.5% for-loop [56] 79.5% [71] 1528(0.3%) 314(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [85] 79.5% ----------------------------------------------------------------------------------------- for-loop [61] 100.0% [72] 1318(0.3%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:88:0 rewriter [83] 100.0% ----------------------------------------------------------------------------------------- append-map [60] 100.0% [73] 642(0.1%) 324(0.1%) free-variables ...e-testing/src/programs.rkt:102:0 ??? [136] 49.5% ----------------------------------------------------------------------------------------- mk-enode! [63] 100.0% [74] 94624(19.0%) 550(0.1%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [89] 97.9% set [93] 0.4% ----------------------------------------------------------------------------------------- for-loop [66] 4.2% merge-egraph-nodes! [57] 13.3% loop [165] 27.5% for-loop [44] 55.0% [75] 73262(14.7%) 14494(2.9%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 custom-set-union [90] 41.7% loop [165] 30.5% set [93] 8.4% update-en-expr [220] 7.2% ----------------------------------------------------------------------------------------- update-leader! [65] 100.0% [76] 20790(4.2%) 992(0.2%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [92] 95.2% ----------------------------------------------------------------------------------------- run-improve50 [2] 2.8% pred [240] 19.9% ??? [62] 77.3% [77] 11294(2.3%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 loop [249] 51.4% make-exacts* [107] 29.4% loop [96] 17.5% for-loop [101] 1.8% ----------------------------------------------------------------------------------------- ??? [62] 100.0% [78] 9918(2.0%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:290:0 for-loop [94] 97.8% map [106] 2.2% ----------------------------------------------------------------------------------------- taylor-alt [68] 100.0% [79] 8918(1.8%) 0(0.0%) for-loop ...rbie/regime-testing/src/glue.rkt:139:6 ??? [167] 100.0% ----------------------------------------------------------------------------------------- for-loop [36] 10.6% for-loop [64] 89.4% [80] 4932(1.0%) 3754(0.8%) ??? ...bie/regime-testing/src/core/ematch.rkt:50:5 for-loop [98] 23.9% ----------------------------------------------------------------------------------------- enode-merge! [70] 100.0% [81] 1928(0.4%) 374(0.1%) adopt-enode! ...e-testing/src/core/enode.rkt:105:0 custom-set-union [90] 80.6% ----------------------------------------------------------------------------------------- update-leader! [65] 30.1% merge-egraph-nodes! [57] 34.9% for-loop [37] 35.1% [82] 1888(0.4%) 1228(0.2%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [99] 35.0% ----------------------------------------------------------------------------------------- ??? [72] 46.4% matcher [111] 53.6% [83] 1318(0.3%) 0(0.0%) rewriter ...ime-testing/src/core/matcher.rkt:131:2 for-loop [97] 53.6% f45 [91] 19.9% *rules* [100] 14.0% expression->type [156] 12.5% ----------------------------------------------------------------------------------------- list-cartesian-product [67] 100.0% [84] 1278(0.3%) 1278(0.3%) for-loop ...egime-testing/src/core/ematch.rkt:24:8 ----------------------------------------------------------------------------------------- curry* [71] 100.0% [85] 1214(0.2%) 1214(0.2%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ----------------------------------------------------------------------------------------- update-leader! [65] 100.0% [86] 586(0.1%) 586(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 ----------------------------------------------------------------------------------------- enode-merge! [70] 100.0% [87] 360(0.1%) 360(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ----------------------------------------------------------------------------------------- ??? [62] 100.0% [88] 228(0.0%) 0(0.0%) baseline-error ...ime-testing/src/points.rkt:294:0 loop [95] 100.0% ----------------------------------------------------------------------------------------- new-enode [74] 100.0% [89] 92600(18.6%) 1468(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [102] 98.4% ----------------------------------------------------------------------------------------- adopt-enode! [81] 4.5% loop! [75] 95.5% [90] 34822(7.0%) 10294(2.1%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [104] 59.1% for-loop [108] 11.4% ----------------------------------------------------------------------------------------- ??? [123] 0.6% composed [208] 0.7% append-map [60] 0.7% mterm->expr [152] 1.1% for-loop [28] 1.3% hash-ref! [170] 2.1% rewriter [83] 2.3% for-loop [161] 2.4% approximate9 [5] 2.6% map [106] 3.8% eval-prog [245] 4.4% f45 [91] 10.0% simplify [39] 10.2% split-table [38] 57.9% [91] 26442(5.3%) 826(0.2%) f45 ...t/collects/racket/match/compiler.rkt:507:40 loop [165] 52.6% map [106] 13.0% f45 [91] 10.0% option-on-expr [169] 5.3% ??? [167] 4.4% expression->type [156] 2.3% taylor-sqrt [112] 2.2% ??? [136] 1.7% ??? [168] 1.3% append-map [60] 1.2% taylor-quotient [113] 1.0% taylor-invert [14] 1.0% composed [208] 0.7% ??? [116] 0.6% taylor-exp [17] 0.2% loop [18] 0.1% ----------------------------------------------------------------------------------------- for-loop [76] 100.0% [92] 19798(4.0%) 596(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [105] 97.0% ----------------------------------------------------------------------------------------- new-enode [74] 2.6% loop! [75] 97.4% [93] 13148(2.6%) 13148(2.6%) set ...collects/racket/private/set-types.rkt:981:0 ----------------------------------------------------------------------------------------- oracle-error [78] 92.1% [94] 10536(2.1%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:291:2 loop [165] 77.8% map [106] 22.2% ----------------------------------------------------------------------------------------- baseline-error [88] 2.3% for-loop [37] 97.7% [95] 10106(2.0%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [103] 91.1% expression-cost [109] 6.6% ??? [114] 2.3% ----------------------------------------------------------------------------------------- loop [246] 10.5% prepare-points [77] 89.5% [96] 2206(0.4%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 loop [249] 55.8% make-exacts* [107] 44.2% ----------------------------------------------------------------------------------------- rewriter [83] 100.0% [97] 1318(0.3%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:134:10 matcher [111] 100.0% ----------------------------------------------------------------------------------------- ??? [80] 100.0% [98] 1178(0.2%) 928(0.2%) for-loop ...egime-testing/src/core/ematch.rkt:51:7 ??? [136] 21.2% ----------------------------------------------------------------------------------------- make-sequence [82] 100.0% [99] 660(0.1%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [110] 100.0% ----------------------------------------------------------------------------------------- rewriter [83] 100.0% [100] 368(0.1%) 0(0.0%) *rules* ...gime-testing/src/syntax/rules.rkt:565:0 for-loop [209] 100.0% ----------------------------------------------------------------------------------------- prepare-points [77] 100.0% [101] 200(0.0%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [115] 100.0% ----------------------------------------------------------------------------------------- type-of-enode-expr [89] 100.0% [102] 91132(18.3%) 2876(0.6%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ??? [168] 36.4% ??? [116] 36.1% ...sting/src/common.rkt:48:2 [118] 13.3% ??? [136] 11.0% ----------------------------------------------------------------------------------------- loop [95] 32.0% argmin [46] 68.0% [103] 28802(5.8%) 904(0.2%) for-loop .../regime-testing/src/programs.rkt:210:2 ??? [168] 71.4% ...sting/src/common.rkt:48:2 [118] 23.3% ??? [116] 2.2% ----------------------------------------------------------------------------------------- custom-set-union [90] 100.0% [104] 20566(4.1%) 7032(1.4%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [119] 65.8% ----------------------------------------------------------------------------------------- for-loop [92] 100.0% [105] 19202(3.9%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [117] 100.0% ----------------------------------------------------------------------------------------- oracle-error [78] 2.8% for-loop [94] 30.4% f45 [91] 66.8% [106] 7706(1.6%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [165] 34.2% f45 [91] 28.4% parse-loop12 [120] 17.9% simplify* [122] 13.0% ??? [123] 3.9% ??? [6] 2.6% ----------------------------------------------------------------------------------------- loop [246] 9.2% loop [96] 20.6% prepare-points [77] 70.2% [107] 4730(1.0%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 loop [165] 74.9% eval-prog [245] 25.1% ----------------------------------------------------------------------------------------- custom-set-union [90] 100.0% [108] 3962(0.8%) 3962(0.8%) for-loop ...cts/racket/private/set-types.rkt:152:2 ----------------------------------------------------------------------------------------- loop [95] 27.2% argmin [46] 72.8% [109] 2454(0.5%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [121] 100.0% ----------------------------------------------------------------------------------------- ??? [99] 28.9% match-e [45] 71.1% [110] 2280(0.5%) 2280(0.5%) custom-in-set ...acket/private/set-types.rkt:577:0 ----------------------------------------------------------------------------------------- matcher [111] 12.6% for-loop [125] 37.4% for-loop [97] 50.0% [111] 1318(0.3%) 0(0.0%) matcher ...gime-testing/src/core/matcher.rkt:167:2 rewriter [83] 50.0% for-loop [125] 37.4% matcher [111] 12.6% ----------------------------------------------------------------------------------------- f45 [91] 100.0% [112] 1294(0.3%) 0(0.0%) taylor-sqrt ...e-testing/src/core/taylor.rkt:346:0 first-nonzero-exp [124] 51.6% hash-ref! [170] 48.4% ----------------------------------------------------------------------------------------- f45 [91] 100.0% [113] 268(0.1%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [124] 100.0% ----------------------------------------------------------------------------------------- loop [95] 100.0% [114] 228(0.0%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:295:27 eval-errors [153] 100.0% ----------------------------------------------------------------------------------------- for-loop [101] 100.0% [115] 200(0.0%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 for-loop [126] 100.0% ----------------------------------------------------------------------------------------- f45 [91] 1.0% ??? [167] 1.0% for-loop [103] 1.8% get-sigs [102] 96.2% [116] 34186(6.9%) 944(0.2%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [129] 45.4% for-loop [127] 44.8% get/build-late-neg-projection [150] 7.0% ----------------------------------------------------------------------------------------- hash-update! [105] 100.0% [117] 19202(3.9%) 0(0.0%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [128] 100.0% ----------------------------------------------------------------------------------------- for-loop [103] 35.7% get-sigs [102] 64.3% [118] 18818(3.8%) 4352(0.9%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [131] 45.8% ??? [132] 31.0% ----------------------------------------------------------------------------------------- for-loop [104] 100.0% [119] 13534(2.7%) 13534(2.7%) for-loop ...cts/racket/private/set-types.rkt:178:5 ----------------------------------------------------------------------------------------- for-loop [31] 11.6% append-map [60] 12.8% hash-ref! [170] 21.2% simplify [39] 26.9% map [106] 27.4% [120] 4670(0.9%) 2458(0.5%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [165] 21.2% make-multiplication-node [133] 20.6% for-loop [134] 11.6% ----------------------------------------------------------------------------------------- expression-cost [109] 100.0% [121] 2454(0.5%) 0(0.0%) compile ...e/regime-testing/src/programs.rkt:186:0 hash-ref! [170] 100.0% ----------------------------------------------------------------------------------------- simplify [39] 26.6% map [106] 73.4% [122] 2124(0.4%) 254(0.1%) simplify* ...gime-testing/src/core/reduce.rkt:31:0 hash-ref! [170] 31.2% return/no-unsupplied [184] 25.4% ??? [135] 15.8% variable? [130] 15.6% ----------------------------------------------------------------------------------------- map [106] 23.1% loop [165] 76.9% [123] 1288(0.3%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [170] 63.0% f45 [91] 23.1% curried [176] 13.9% ----------------------------------------------------------------------------------------- taylor-quotient [113] 21.7% taylor-invert [14] 24.1% taylor-sqrt [112] 54.1% [124] 1234(0.2%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [170] 75.9% simplify [39] 24.1% ----------------------------------------------------------------------------------------- matcher [111] 100.0% [125] 986(0.2%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:183:21 matcher [111] 100.0% ----------------------------------------------------------------------------------------- ??? [115] 100.0% [126] 200(0.0%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:231:9 ??? [167] 100.0% ----------------------------------------------------------------------------------------- for-loop [202] 24.6% ??? [116] 75.4% [127] 20316(4.1%) 1536(0.3%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [201] 88.1% ??? [235] 4.3% ----------------------------------------------------------------------------------------- ??? [117] 100.0% [128] 19202(3.9%) 15894(3.2%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 update-en-expr [220] 17.2% ----------------------------------------------------------------------------------------- ??? [116] 100.0% [129] 15536(3.1%) 1666(0.3%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [137] 89.3% ----------------------------------------------------------------------------------------- simplify* [122] 3.1% expression->type [156] 3.4% substitute-e [58] 11.1% match-e [45] 82.4% [130] 10664(2.1%) 324(0.1%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [136] 97.0% ----------------------------------------------------------------------------------------- ...sting/src/common.rkt:48:2 [118] 100.0% [131] 8628(1.7%) 2982(0.6%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [182] 32.5% assoc-ref [138] 19.3% return/no-unsupplied [184] 13.7% ----------------------------------------------------------------------------------------- for-loop [226] 8.6% ??? [201] 10.4% ...sting/src/common.rkt:48:2 [118] 81.0% [132] 5838(1.2%) 1896(0.4%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [201] 70.6% ??? [231] 7.9% ----------------------------------------------------------------------------------------- parse-loop12 [120] 100.0% [133] 960(0.2%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [139] 100.0% ----------------------------------------------------------------------------------------- parse-loop12 [120] 100.0% [134] 820(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:490:59 hash-ref! [170] 100.0% ----------------------------------------------------------------------------------------- simplify* [122] 100.0% [135] 336(0.1%) 0(0.0%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [204] 100.0% ----------------------------------------------------------------------------------------- for-loop [98] 0.5% free-variables [73] 0.6% f45 [91] 1.1% ??? [231] 2.2% substitute-e [58] 3.9% get-sigs [102] 18.9% variable? [130] 19.5% match-e [45] 20.9% finalize-iter! [47] 30.5% [136] 53126(10.7%) 16774(3.4%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [140] 34.1% for-loop [141] 30.1% ??? [231] 2.1% ??? [143] 1.9% ----------------------------------------------------------------------------------------- ??? [129] 100.0% [137] 13870(2.8%) 578(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [142] 95.8% ----------------------------------------------------------------------------------------- ??? [131] 100.0% [138] 1664(0.3%) 1664(0.3%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ----------------------------------------------------------------------------------------- make-multiplication-node [133] 100.0% [139] 960(0.2%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [144] 100.0% ----------------------------------------------------------------------------------------- mk-enode! [63] 4.8% ??? [136] 95.2% [140] 19208(3.9%) 5614(1.1%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [181] 67.0% ??? [147] 3.8% ----------------------------------------------------------------------------------------- ??? [136] 100.0% [141] 16264(3.3%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [145] 100.0% ----------------------------------------------------------------------------------------- ??? [137] 100.0% [142] 13292(2.7%) 300(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [146] 97.7% ----------------------------------------------------------------------------------------- ??? [136] 100.0% [143] 996(0.2%) 0(0.0%) ??? .../regime-testing/src/core/alt-table.rkt:54:0 ??? [167] 100.0% ----------------------------------------------------------------------------------------- make-multiplication-subnode [139] 100.0% [144] 960(0.2%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:242:3 mterm->expr [152] 69.0% make-multiplication-subsubsubnode [148] 31.0% ----------------------------------------------------------------------------------------- for-loop [141] 98.7% [145] 16486(3.3%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [149] 98.2% ----------------------------------------------------------------------------------------- ??? [142] 100.0% [146] 12992(2.6%) 2944(0.6%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [151] 40.3% get/build-late-neg-projection [150] 37.0% ----------------------------------------------------------------------------------------- hash-has-key? [140] 100.0% [147] 730(0.1%) 730(0.1%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ----------------------------------------------------------------------------------------- for-loop [144] 100.0% [148] 298(0.1%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [152] 100.0% ----------------------------------------------------------------------------------------- atab-add-altn [145] 100.0% [149] 16190(3.3%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [153] 80.5% alt-errors [222] 16.4% for-loop [157] 3.1% ----------------------------------------------------------------------------------------- unconstrained-domain->-projection [158] 2.3% ??? [155] 14.3% ??? [116] 16.6% for-loop [146] 66.8% [150] 7192(1.4%) 1538(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [154] 64.0% ??? [155] 14.3% unconstrained-domain->-projection [158] 2.3% ----------------------------------------------------------------------------------------- for-loop [146] 100.0% [151] 5242(1.1%) 5242(1.1%) add-list-context ...ontract/private/list.rkt:752:0 ----------------------------------------------------------------------------------------- make-multiplication-subsubsubnode [148] 31.0% for-loop [144] 69.0% [152] 960(0.2%) 0(0.0%) mterm->expr ...e-testing/src/core/reduce.rkt:270:0 f45 [91] 62.5% expression->type [156] 37.5% ----------------------------------------------------------------------------------------- ??? [114] 1.2% composed [208] 4.4% option-on-expr [169] 4.5% ??? [62] 9.2% loop [165] 13.0% best-and-tied-at-points [149] 66.3% [153] 19666(4.0%) 0(0.0%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [159] 100.0% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [150] 100.0% [154] 5654(1.1%) 1766(0.4%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [160] 68.8% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [150] 100.0% [155] 2054(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [150] 100.0% ----------------------------------------------------------------------------------------- rewriter [83] 12.8% for-loop [161] 23.3% mterm->expr [152] 27.9% f45 [91] 36.0% [156] 1290(0.3%) 298(0.1%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [161] 66.3% variable? [130] 27.9% ----------------------------------------------------------------------------------------- best-and-tied-at-points [149] 100.0% [157] 504(0.1%) 0(0.0%) for-loop ...-testing/src/core/alt-table.rkt:124:16 ??? [162] 100.0% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [150] 100.0% [158] 332(0.1%) 0(0.0%) unconstrained-domain->-projection ...rrow.rkt:60:0 get/build-late-neg-projection [150] 100.0% ----------------------------------------------------------------------------------------- eval-errors [153] 100.0% [159] 19666(4.0%) 972(0.2%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [163] 82.7% ulp-difference [177] 6.9% ??? [167] 5.5% ----------------------------------------------------------------------------------------- contract-struct-name [164] 20.0% ??? [154] 80.0% [160] 3888(0.8%) 3100(0.6%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [164] 40.3% ----------------------------------------------------------------------------------------- expression->type [156] 100.0% [161] 930(0.2%) 0(0.0%) for-loop ...regime-testing/src/type-check.rkt:52:5 f45 [91] 62.4% expression->type [156] 37.6% ----------------------------------------------------------------------------------------- for-loop [157] 100.0% [162] 504(0.1%) 504(0.1%) ??? ...ket/collects/racket/private/for.rkt:1151:14 ----------------------------------------------------------------------------------------- ??? [16] 1.1% jloop [11] 3.1% loop [241] 7.5% ??? [6] 12.2% loop [165] 36.9% for-loop [159] 39.2% [163] 41426(8.3%) 528(0.1%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [166] 68.3% ??? [167] 16.3% loop [165] 9.5% ??? [172] 4.6% ----------------------------------------------------------------------------------------- build-compound-type-name [160] 100.0% [164] 2344(0.5%) 788(0.2%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [160] 66.4% ----------------------------------------------------------------------------------------- ??? [62] 0.0% errors-score [248] 0.1% parse-loop12 [120] 0.1% loop [249] 0.3% make-exacts* [107] 0.3% ??? [163] 1.1% map [106] 1.2% option-on-expr [169] 1.4% match-e [45] 1.8% for-loop [94] 2.6% for-loop [56] 3.0% f45 [91] 8.9% loop! [75] 9.7% loop [165] 68.6% [165] 89934(18.1%) 6194(1.2%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [165] 68.6% loop! [75] 9.4% option-on-expr [169] 8.9% ??? [6] 2.4% ??? [163] 1.9% foldl [175] 1.4% ??? [167] 1.2% for-loop [174] 0.8% eval-errors [153] 0.8% alt-errors [222] 0.5% curried [176] 0.4% ??? [123] 0.1% eval-prog [245] 0.0% ??? [172] 0.0% ulp-difference [177] 0.0% ??? [171] 0.0% ??? [16] 0.0% ----------------------------------------------------------------------------------------- ??? [163] 100.0% [166] 28276(5.7%) 16526(3.3%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [171] 15.7% ??? [173] 11.6% ??? [188] 7.4% bf* [178] 4.9% ??? [235] 1.9% ----------------------------------------------------------------------------------------- loop [24] 0.8% get-final-combination [23] 0.8% for-loop [126] 0.8% jloop [11] 0.9% ??? [6] 1.7% ??? [143] 3.5% for-loop [159] 4.5% ??? [185] 6.5% loop [165] 9.4% f45 [91] 13.5% ??? [168] 15.0% for-loop [79] 15.0% ??? [163] 27.6% [167] 23946(4.8%) 1872(0.4%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [168] 59.1% approximate9 [5] 14.5% hash-ref! [170] 7.2% ??? [231] 6.0% best-alt [179] 3.5% ??? [116] 1.4% simplify [39] 0.5% ----------------------------------------------------------------------------------------- simplify-alt [41] 0.0% f45 [91] 0.1% for-loop [103] 1.5% get-sigs [102] 2.5% ??? [168] 2.8% ??? [167] 3.8% for-loop [180] 43.4% ??? [62] 45.7% [168] 446346(89.9%) 20788(4.2%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [180] 43.6% iterate-egraph!13 [3] 42.1% loop [4] 3.3% ??? [168] 2.8% ??? [181] 2.5% ??? [167] 1.4% ??? [182] 0.7% return/no-unsupplied [184] 0.5% mk-egraph [190] 0.2% list-member? [183] 0.1% *simplify-rules* [196] 0.1% ----------------------------------------------------------------------------------------- f45 [91] 9.6% loop [165] 90.4% [169] 16720(3.4%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [165] 31.3% sort-context-on-expr [186] 28.8% sindices->spoints [189] 20.3% err-lsts->split-indices [194] 9.0% eval-errors [153] 5.3% alt-errors [222] 2.5% pick-errors [199] 1.4% point->alt [200] 1.3% ----------------------------------------------------------------------------------------- for-loop [134] 0.6% ??? [10] 0.8% ??? [33] 0.9% for-loop [40] 1.4% for-loop [30] 1.5% for-loop [29] 1.9% loop [18] 2.3% simplify* [122] 3.3% first-nonzero-exp [124] 3.3% localize-error [51] 3.6% taylor-sqrt [112] 3.7% ??? [123] 5.5% ??? [7] 6.0% for-loop [26] 7.1% ??? [167] 7.2% loop [24] 7.4% ??? [192] 8.1% for-loop [25] 9.5% ??? [185] 11.1% compile [121] 14.4% [170] 10864(2.2%) 2774(0.6%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [185] 18.6% simplify [39] 13.6% ??? [192] 11.3% ??? [8] 9.5% ??? [9] 9.4% parse-loop12 [120] 8.3% ??? [7] 6.9% ??? [10] 2.6% ??? [13] 1.9% ??? [12] 1.4% f45 [91] 1.1% ??? [15] 0.6% ----------------------------------------------------------------------------------------- loop [165] 5.9% ??? [166] 94.1% [171] 4732(1.0%) 3192(0.6%) ??? ...regime-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [184] 17.9% ??? [182] 14.6% ----------------------------------------------------------------------------------------- ??? [163] 45.4% loop [165] 54.6% [172] 4194(0.8%) 482(0.1%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [187] 88.5% ----------------------------------------------------------------------------------------- ??? [166] 100.0% [173] 3290(0.7%) 3290(0.7%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ----------------------------------------------------------------------------------------- loop [165] 100.0% [174] 2864(0.6%) 334(0.1%) for-loop ...me-testing/src/core/simplify.rkt:195:2 setfindf [193] 58.3% compose [197] 18.8% eval-const-expr [198] 11.2% ----------------------------------------------------------------------------------------- for-loop [56] 11.8% loop [165] 88.2% [175] 2840(0.6%) 808(0.2%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [191] 71.5% ----------------------------------------------------------------------------------------- ??? [123] 19.6% for-loop [56] 30.1% loop [165] 50.4% [176] 1830(0.4%) 1830(0.4%) curried ...cket/collects/racket/function.rkt:71:18 ----------------------------------------------------------------------------------------- ??? [6] 11.4% loop [165] 12.0% for-loop [159] 76.6% [177] 1772(0.4%) 810(0.2%) ulp-difference ...egime-testing/src/float.rkt:19:0 return/no-unsupplied [184] 34.1% ??? [182] 20.2% ----------------------------------------------------------------------------------------- ??? [166] 100.0% [178] 1390(0.3%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [188] 100.0% ----------------------------------------------------------------------------------------- ??? [167] 100.0% [179] 996(0.2%) 0(0.0%) best-alt ...erbie/regime-testing/src/glue.rkt:71:0 loop [195] 100.0% ----------------------------------------------------------------------------------------- ??? [168] 100.0% [180] 404456(81.4%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ??? [168] 99.8% ----------------------------------------------------------------------------------------- hash-has-key? [140] 28.7% ??? [168] 71.3% [181] 44870(9.0%) 17730(3.6%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [202] 45.1% ??? [221] 10.6% ??? [201] 2.7% arrow-higher-order:lnp [242] 1.4% successfully-got-the-right-kind-of-function [217] 0.7% ----------------------------------------------------------------------------------------- ulp-difference [177] 4.0% ??? [171] 7.7% ??? [131] 31.2% ??? [168] 57.1% [182] 8978(1.8%) 1698(0.3%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [204] 70.7% ??? [231] 10.4% ----------------------------------------------------------------------------------------- ??? [168] 6.7% for-loop [44] 93.3% [183] 8884(1.8%) 596(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [203] 82.9% member [212] 10.4% ----------------------------------------------------------------------------------------- simplify* [122] 9.1% ulp-difference [177] 10.2% ??? [171] 14.3% ??? [131] 19.9% ??? [168] 46.5% [184] 5928(1.2%) 5242(1.1%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [213] 11.6% ----------------------------------------------------------------------------------------- hash-ref! [170] 100.0% [185] 5018(1.0%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:67:15 hash-ref! [170] 60.3% ??? [167] 36.0% get-coeffs [214] 3.6% ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [186] 4820(1.0%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [205] 100.0% ----------------------------------------------------------------------------------------- ??? [172] 100.0% [187] 3712(0.7%) 2702(0.5%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [225] 27.2% ----------------------------------------------------------------------------------------- bf* [178] 40.0% ??? [166] 60.0% [188] 3476(0.7%) 230(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [207] 93.4% ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [189] 3400(0.7%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [206] 100.0% ----------------------------------------------------------------------------------------- ??? [168] 100.0% [190] 2086(0.4%) 0(0.0%) mk-egraph ...ime-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [210] 69.5% mk-enode! [63] 30.5% ----------------------------------------------------------------------------------------- foldl [175] 100.0% [191] 2032(0.4%) 2032(0.4%) merge2 .../regime-testing/src/core/ematch.rkt:31:0 ----------------------------------------------------------------------------------------- hash-ref! [170] 100.0% [192] 1834(0.4%) 342(0.1%) ??? ...erbie/regime-testing/src/programs.rkt:194:5 hash-ref! [170] 81.4% ----------------------------------------------------------------------------------------- for-loop [174] 100.0% [193] 1670(0.3%) 1310(0.3%) setfindf ...ie/regime-testing/src/common.rkt:187:0 for-loop [215] 21.6% ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [194] 1506(0.3%) 240(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [211] 84.1% ----------------------------------------------------------------------------------------- best-alt [179] 100.0% [195] 996(0.2%) 0(0.0%) loop ...herbie/regime-testing/src/common.rkt:154:2 composed [208] 100.0% ----------------------------------------------------------------------------------------- ??? [168] 100.0% [196] 582(0.1%) 278(0.1%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 for-loop [209] 52.2% ----------------------------------------------------------------------------------------- for-loop [174] 100.0% [197] 538(0.1%) 538(0.1%) compose ...collects/racket/private/list.rkt:385:12 ----------------------------------------------------------------------------------------- for-loop [174] 100.0% [198] 322(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 ??? [216] 100.0% ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [199] 240(0.0%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [218] 100.0% ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [200] 224(0.0%) 0(0.0%) point->alt ...e-testing/src/core/regimes.rkt:188:0 eval-prog [245] 100.0% ----------------------------------------------------------------------------------------- ??? [181] 5.0% ??? [132] 21.5% for-loop [127] 73.5% [201] 24364(4.9%) 3590(0.7%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [219] 71.0% for-loop [226] 6.6% ??? [132] 5.0% ??? [235] 2.6% ----------------------------------------------------------------------------------------- ??? [181] 100.0% [202] 20224(4.1%) 10808(2.2%) for-loop ...acket/contract/private/list.rkt:743:12 for-loop [127] 24.7% ??? [221] 19.3% arrow-higher-order:lnp [242] 1.5% ----------------------------------------------------------------------------------------- list-member? [183] 100.0% [203] 7364(1.5%) 7364(1.5%) loop (unknown source) ----------------------------------------------------------------------------------------- ??? [135] 5.0% ??? [182] 95.0% [204] 6684(1.3%) 6684(1.3%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ----------------------------------------------------------------------------------------- sort-context-on-expr [186] 100.0% [205] 4820(1.0%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [223] 82.0% loop [241] 18.0% ----------------------------------------------------------------------------------------- sindices->spoints [189] 100.0% [206] 3400(0.7%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 sidx->spoint [224] 100.0% ----------------------------------------------------------------------------------------- ??? [188] 100.0% [207] 3246(0.7%) 1620(0.3%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [225] 50.1% ----------------------------------------------------------------------------------------- argmins [54] 8.7% loop [195] 42.4% f45 [91] 48.9% [208] 2348(0.5%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 f45 [91] 48.9% eval-errors [153] 36.8% alt-errors [222] 14.3% ----------------------------------------------------------------------------------------- *simplify-rules* [196] 15.7% *rules* [100] 19.0% merge-egraph-nodes! [57] 65.3% [209] 1936(0.4%) 1300(0.3%) for-loop ...ie/regime-testing/src/common.rkt:100:9 update-en-expr [220] 17.1% ormap [230] 15.7% ----------------------------------------------------------------------------------------- mk-egraph [190] 27.1% mk-enode-rec! [210] 72.9% [210] 1450(0.3%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [210] 72.9% mk-enode! [63] 27.1% ----------------------------------------------------------------------------------------- err-lsts->split-indices [194] 100.0% [211] 1266(0.3%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [227] 100.0% ----------------------------------------------------------------------------------------- list-member? [183] 100.0% [212] 924(0.2%) 924(0.2%) member (unknown source) ----------------------------------------------------------------------------------------- one-iter [21] 25.3% return/no-unsupplied [184] 74.7% [213] 918(0.2%) 918(0.2%) filter ...t/collects/racket/private/list.rkt:256:2 ----------------------------------------------------------------------------------------- ??? [185] 100.0% [214] 366(0.1%) 366(0.1%) get-coeffs ...ime-testing/src/core/taylor.rkt:64:2 ----------------------------------------------------------------------------------------- setfindf [193] 100.0% [215] 360(0.1%) 360(0.1%) for-loop ...ie/regime-testing/src/common.rkt:188:2 ----------------------------------------------------------------------------------------- eval-const-expr [198] 100.0% [216] 322(0.1%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [228] 100.0% ----------------------------------------------------------------------------------------- ??? [181] 100.0% [217] 310(0.1%) 0(0.0%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [229] 100.0% ----------------------------------------------------------------------------------------- pick-errors [199] 100.0% [218] 240(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:203:2 ??? [16] 100.0% ----------------------------------------------------------------------------------------- ??? [201] 100.0% [219] 17306(3.5%) 2388(0.5%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [231] 82.7% ??? [235] 3.5% ----------------------------------------------------------------------------------------- for-loop [209] 2.1% update-leader! [65] 5.8% for-loop [69] 6.1% for-loop [128] 20.6% loop! [75] 65.5% [220] 16064(3.2%) 15732(3.2%) update-en-expr ...esting/src/core/egraph.rkt:212:0 for-loop [237] 2.1% ----------------------------------------------------------------------------------------- for-loop [202] 45.1% ??? [181] 54.9% [221] 8644(1.7%) 3686(0.7%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [232] 57.4% ----------------------------------------------------------------------------------------- composed [208] 6.5% option-on-expr [169] 8.1% loop [165] 34.6% best-and-tied-at-points [149] 50.8% [222] 5208(1.0%) 0(0.0%) alt-errors ...ime-testing/src/alternative.rkt:59:0 eval-prog [245] 100.0% ----------------------------------------------------------------------------------------- ??? [205] 100.0% [223] 3954(0.8%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [233] 93.9% loop [241] 6.1% ----------------------------------------------------------------------------------------- loop [206] 100.0% [224] 3400(0.7%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [234] 80.6% pred [240] 19.4% ----------------------------------------------------------------------------------------- real->bigfloat [187] 38.3% bfdiv [207] 61.7% [225] 2636(0.5%) 2636(0.5%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ----------------------------------------------------------------------------------------- ??? [201] 100.0% [226] 1614(0.3%) 610(0.1%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [132] 62.2% ----------------------------------------------------------------------------------------- add-splitpoint [211] 100.0% [227] 1266(0.3%) 660(0.1%) for-loop ...ime-testing/src/core/regimes.rkt:255:4 for-loop [236] 47.9% ----------------------------------------------------------------------------------------- ??? [216] 100.0% [228] 322(0.1%) 0(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 maybe-cons-kwd [238] 100.0% ----------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [217]100.0% [229] 310(0.1%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [239] 100.0% ----------------------------------------------------------------------------------------- for-loop [209] 100.0% [230] 304(0.1%) 304(0.1%) ormap ...et/collects/racket/private/map.rkt:105:13 ----------------------------------------------------------------------------------------- ??? [132] 5.0% ??? [182] 5.0% ??? [136] 6.0% ??? [167] 7.7% ??? [219] 76.4% [231] 18732(3.8%) 16368(3.3%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [136] 7.7% contract? [243] 5.0% ----------------------------------------------------------------------------------------- ??? [221] 100.0% [232] 4958(1.0%) 4958(1.0%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ----------------------------------------------------------------------------------------- generic-sort/key [223] 45.3% copying-mergesort [233] 54.7% [233] 3714(0.7%) 200(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [233] 54.7% loop [241] 32.5% jloop [11] 10.1% ----------------------------------------------------------------------------------------- sidx->spoint [224] 100.0% [234] 2742(0.6%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [240] 100.0% ----------------------------------------------------------------------------------------- ??? [166] 20.0% ??? [219] 22.8% ??? [201] 24.0% for-loop [127] 33.1% [235] 2656(0.5%) 2106(0.4%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [244] 20.7% ----------------------------------------------------------------------------------------- for-loop [227] 100.0% [236] 606(0.1%) 606(0.1%) for-loop ...ime-testing/src/core/regimes.rkt:259:8 ----------------------------------------------------------------------------------------- update-en-expr [220] 100.0% [237] 332(0.1%) 332(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:214:6 ----------------------------------------------------------------------------------------- unpack245 [228] 100.0% [238] 322(0.1%) 0(0.0%) maybe-cons-kwd ...ate/arrow-higher-order.rkt:498:0 arrow-higher-order:lnp [242] 100.0% ----------------------------------------------------------------------------------------- arity-checking-wrapper [229] 100.0% [239] 310(0.1%) 310(0.1%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ----------------------------------------------------------------------------------------- sidx->spoint [224] 19.4% binary-search-floats [234] 80.6% [240] 3400(0.7%) 0(0.0%) pred ...regime-testing/src/core/regimes.rkt:151:17 prepare-points [77] 66.2% loop [246] 19.7% eval-prog [245] 7.1% errors-score [248] 7.0% ----------------------------------------------------------------------------------------- generic-sort/key [223] 7.7% ??? [205] 27.8% copying-mergesort [233] 64.5% [241] 3118(0.6%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [163] 100.0% ----------------------------------------------------------------------------------------- for-loop [202] 23.9% maybe-cons-kwd [238] 25.7% ??? [181] 50.4% [242] 1254(0.3%) 632(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [247] 49.6% ----------------------------------------------------------------------------------------- ??? [231] 100.0% [243] 928(0.2%) 928(0.2%) contract? ...acket/contract/private/guts.rkt:109:0 ----------------------------------------------------------------------------------------- ??? [235] 100.0% [244] 550(0.1%) 550(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ----------------------------------------------------------------------------------------- point->alt [200] 3.2% loop [165] 3.2% pred [240] 3.4% make-exacts* [107] 16.7% alt-errors [222] 73.5% [245] 7088(1.4%) 3374(0.7%) eval-prog ...regime-testing/src/programs.rkt:150:0 f45 [91] 45.6% go [250] 3.4% ??? [251] 3.4% ----------------------------------------------------------------------------------------- ??? [62] 38.9% pred [240] 61.1% [246] 1096(0.2%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:238:2 make-exacts* [107] 39.6% loop [249] 39.2% loop [96] 21.2% ----------------------------------------------------------------------------------------- arrow-higher-order:lnp [242] 100.0% [247] 622(0.1%) 622(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 ----------------------------------------------------------------------------------------- pred [240] 100.0% [248] 238(0.0%) 0(0.0%) errors-score ...egime-testing/src/points.rkt:301:0 loop [165] 100.0% ----------------------------------------------------------------------------------------- loop [246] 5.8% loop [96] 16.5% prepare-points [77] 77.7% [249] 7460(1.5%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [165] 100.0% ----------------------------------------------------------------------------------------- eval-prog [245] 100.0% [250] 242(0.0%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [252] 100.0% ----------------------------------------------------------------------------------------- eval-prog [245] 100.0% [251] 238(0.0%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [253] 100.0% ----------------------------------------------------------------------------------------- go [250] 33.3% loop [252] 66.7% [252] 242(0.0%) 242(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [252] 66.7% ----------------------------------------------------------------------------------------- ??? [251] 100.0% [253] 238(0.0%) 238(0.0%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 -----------------------------------------------------------------------------------------