Profiling results ----------------- Total cpu time observed: 112878ms (out of 114916ms) Number of samples taken: 421 (once every 268ms) (Hiding functions with self<1.0% and local<2.0%: 4 of 170 hidden) ========================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================== ??? [44] 100.0% [1] 95640(84.7%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [10] 100.0% -------------------------------------------------------------------------- ??? [134] 100.0% [2] 89446(79.2%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [11] 99.6% -------------------------------------------------------------------------- ??? [44] 100.0% [3] 85122(75.4%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [12] 94.2% setup-alt-simplified [14] 3.8% get-final-combination [15] 1.2% prepare-points [58] 0.4% ??? [79] 0.4% -------------------------------------------------------------------------- ??? [134] 100.0% [4] 6534(5.8%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [13] 100.0% -------------------------------------------------------------------------- match-e [26] 45.2% substitute-e [37] 54.8% [5] 1532(1.4%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [79] 100.0% -------------------------------------------------------------------------- hash-ref! [136] 100.0% [6] 956(0.8%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [78] 100.0% -------------------------------------------------------------------------- ??? [128] 100.0% [7] 566(0.5%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [16] 100.0% -------------------------------------------------------------------------- hash-ref! [136] 100.0% [8] 310(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [17] 100.0% -------------------------------------------------------------------------- loop [78] 100.0% [9] 224(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [128] 100.0% -------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [10] 95640(84.7%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [44] 100.0% -------------------------------------------------------------------------- iterate-egraph!13 [2] 100.0% [11] 89104(78.9%) 990(0.9%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [19] 78.2% for-loop [20] 20.1% -------------------------------------------------------------------------- run-improve50 [3] 100.0% [12] 80160(71.0%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [18] 100.0% -------------------------------------------------------------------------- loop [4] 100.0% [13] 6534(5.8%) 232(0.2%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [21] 96.4% -------------------------------------------------------------------------- run-improve50 [3] 100.0% [14] 3242(2.9%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [22] 100.0% -------------------------------------------------------------------------- run-improve50 [3] 100.0% [15] 1064(0.9%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [23] 100.0% -------------------------------------------------------------------------- approximate9 [7] 100.0% [16] 566(0.5%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 hash-ref! [136] 100.0% -------------------------------------------------------------------------- ??? [8] 100.0% [17] 310(0.3%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [136] 100.0% -------------------------------------------------------------------------- for-loop [12] 100.0% [18] 80160(71.0%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [24] 96.2% finalize-iter! [28] 2.3% choose-best-alt! [31] 0.7% gen-series! [32] 0.7% -------------------------------------------------------------------------- one-iter [11] 100.0% [19] 69684(61.7%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [25] 92.3% match-e [26] 7.1% -------------------------------------------------------------------------- for-loop [20] 50.0% one-iter [11] 50.0% [20] 17900(15.9%) 4030(3.6%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [20] 50.0% match-e [26] 38.0% ??? [33] 0.8% -------------------------------------------------------------------------- pass [13] 100.0% [21] 6302(5.6%) 0(0.0%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [27] 70.4% loop [29] 26.3% for-loop [34] 3.3% -------------------------------------------------------------------------- setup-alt-simplified [14] 100.0% [22] 3242(2.9%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [134] 100.0% -------------------------------------------------------------------------- get-final-combination [15] 100.0% [23] 1064(0.9%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f12 [30] 100.0% -------------------------------------------------------------------------- run-iter! [18] 100.0% [24] 77152(68.3%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [35] 100.0% -------------------------------------------------------------------------- for-loop [19] 100.0% [25] 64312(57.0%) 0(0.0%) for-loop ...t-testing/src/core/simplify.rkt:148:10 loop! [56] 29.6% merge-egraph-nodes! [36] 27.0% mk-enode! [45] 24.2% substitute-e [37] 16.4% list-member? [40] 2.8% -------------------------------------------------------------------------- for-loop [19] 17.2% for-loop [47] 18.1% for-loop [20] 64.7% [26] 18532(16.4%) 5008(4.4%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [38] 46.6% ??? [79] 13.9% for-loop [47] 8.3% list-cartesian-product [48] 2.7% custom-in-set [42] 2.7% variable? [5] 1.9% loop [78] 1.0% -------------------------------------------------------------------------- for-loop [21] 100.0% [27] 4436(3.9%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [39] 100.0% -------------------------------------------------------------------------- run-iter! [18] 100.0% [28] 1872(1.7%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [79] 100.0% -------------------------------------------------------------------------- for-loop [21] 100.0% [29] 1660(1.5%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [39] 100.0% -------------------------------------------------------------------------- split-table [23] 100.0% [30] 1064(0.9%) 0(0.0%) f12 ...t/collects/racket/match/compiler.rkt:507:40 loop [78] 59.8% option-on-expr [91] 40.2% -------------------------------------------------------------------------- run-iter! [18] 100.0% [31] 570(0.5%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [79] 100.0% -------------------------------------------------------------------------- run-iter! [18] 100.0% [32] 566(0.5%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [41] 100.0% -------------------------------------------------------------------------- for-loop [20] 100.0% [33] 274(0.2%) 0(0.0%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [43] 100.0% -------------------------------------------------------------------------- for-loop [21] 100.0% [34] 206(0.2%) 206(0.2%) for-loop ...t-testing/src/core/simplify.rkt:217:13 -------------------------------------------------------------------------- simplify! [24] 100.0% [35] 77152(68.3%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [44] 100.0% -------------------------------------------------------------------------- for-loop [49] 3.0% merge-egraph-nodes! [36] 3.7% for-loop [25] 93.3% [36] 17384(15.4%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [46] 53.6% loop! [56] 24.3% for-loop [50] 7.6% for-loop [49] 6.9% enode-merge! [53] 3.9% merge-egraph-nodes! [36] 3.7% -------------------------------------------------------------------------- substitute-e [37] 10.5% for-loop [25] 89.5% [37] 10524(9.3%) 1598(1.4%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [45] 72.0% substitute-e [37] 10.5% variable? [5] 3.0% ??? [79] 2.4% -------------------------------------------------------------------------- match-e [26] 100.0% [38] 10334(9.2%) 4676(4.1%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [47] 40.1% list-cartesian-product [48] 10.9% curry* [55] 2.6% curried [131] 1.1% -------------------------------------------------------------------------- loop [29] 27.2% argmin [27] 72.8% [39] 6096(5.4%) 0(0.0%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [134] 80.8% ...sting/src/common.rkt:47:2 [82] 19.2% -------------------------------------------------------------------------- for-loop [25] 100.0% [40] 1824(1.6%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [51] 57.6% member [52] 42.4% -------------------------------------------------------------------------- gen-series! [32] 100.0% [41] 566(0.5%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [54] 100.0% -------------------------------------------------------------------------- match-e [26] 100.0% [42] 494(0.4%) 494(0.4%) custom-in-set ...acket/private/set-types.rkt:577:0 -------------------------------------------------------------------------- ??? [33] 100.0% [43] 274(0.2%) 274(0.2%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 -------------------------------------------------------------------------- for-loop [35] 23.2% run [10] 31.6% [44] 110616(98.0%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [134] 36.0% profile-thunk16 [1] 31.6% run-improve50 [3] 27.3% prepare-points [58] 4.4% loop [60] 0.8% -------------------------------------------------------------------------- mk-egraph [145] 1.2% mk-enode-rec! [156] 2.0% substitute-e [37] 31.7% for-loop [25] 65.1% [45] 23902(21.2%) 2158(1.9%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [57] 87.3% hash-has-key? [86] 3.6% -------------------------------------------------------------------------- merge-egraph-nodes! [36] 100.0% [46] 9774(8.7%) 1120(1.0%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [59] 85.1% hash-ref! [136] 3.4% -------------------------------------------------------------------------- match-e [26] 41.1% for-loop [38] 58.9% [47] 6870(6.1%) 850(0.8%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [26] 89.2% -------------------------------------------------------------------------- list-cartesian-product [48] 11.9% match-e [26] 29.3% for-loop [38] 58.8% [48] 1732(1.5%) 1528(1.4%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [48] 11.9% for-loop [64] 11.8% -------------------------------------------------------------------------- merge-egraph-nodes! [36] 100.0% [49] 1722(1.5%) 258(0.2%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [36] 60.6% loop! [56] 24.4% -------------------------------------------------------------------------- merge-egraph-nodes! [36] 100.0% [50] 1328(1.2%) 1126(1.0%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [95] 15.2% -------------------------------------------------------------------------- list-member? [40] 100.0% [51] 1050(0.9%) 1050(0.9%) loop (unknown source) -------------------------------------------------------------------------- list-member? [40] 100.0% [52] 774(0.7%) 774(0.7%) member (unknown source) -------------------------------------------------------------------------- merge-egraph-nodes! [36] 100.0% [53] 774(0.7%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [62] 67.7% custom-set-intersect! [63] 32.3% -------------------------------------------------------------------------- for-loop [41] 100.0% [54] 566(0.5%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [61] 100.0% -------------------------------------------------------------------------- for-loop [38] 100.0% [55] 272(0.2%) 272(0.2%) curry* ...racket/collects/racket/function.rkt:44:2 -------------------------------------------------------------------------- for-loop [49] 1.3% merge-egraph-nodes! [36] 13.8% loop [78] 28.8% for-loop [25] 56.2% [56] 24258(21.5%) 4796(4.2%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 loop [78] 35.7% custom-set-union [67] 31.8% set [68] 13.1% update-en-expr [95] 8.1% -------------------------------------------------------------------------- mk-enode! [45] 100.0% [57] 20872(18.5%) 432(0.4%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [65] 96.6% set [68] 1.3% -------------------------------------------------------------------------- run-improve50 [3] 3.4% ??? [44] 96.6% [58] 9982(8.8%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [73] 52.2% loop [69] 30.3% make-exacts* [75] 15.5% for-loop [70] 2.0% -------------------------------------------------------------------------- update-leader! [46] 100.0% [59] 8320(7.4%) 260(0.2%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [66] 96.9% -------------------------------------------------------------------------- ??? [44] 100.0% [60] 1780(1.6%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 make-exacts* [75] 60.0% loop [69] 24.4% loop [73] 15.6% -------------------------------------------------------------------------- taylor-alt [54] 100.0% [61] 566(0.5%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [128] 100.0% -------------------------------------------------------------------------- enode-merge! [53] 100.0% [62] 524(0.5%) 322(0.3%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [67] 38.5% -------------------------------------------------------------------------- enode-merge! [53] 100.0% [63] 250(0.2%) 250(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 -------------------------------------------------------------------------- list-cartesian-product [48] 100.0% [64] 204(0.2%) 204(0.2%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 -------------------------------------------------------------------------- new-enode [57] 100.0% [65] 20166(17.9%) 322(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [71] 98.4% -------------------------------------------------------------------------- for-loop [59] 100.0% [66] 8060(7.1%) 0(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [72] 100.0% -------------------------------------------------------------------------- adopt-enode! [62] 2.6% loop! [56] 97.4% [67] 7910(7.0%) 2138(1.9%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [74] 69.5% for-loop [76] 3.5% -------------------------------------------------------------------------- new-enode [57] 4.1% loop! [56] 95.9% [68] 6754(6.0%) 6754(6.0%) set ...collects/racket/private/set-types.rkt:981:0 -------------------------------------------------------------------------- loop [60] 12.5% prepare-points [58] 87.5% [69] 3460(3.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [75] 55.7% loop [73] 44.3% -------------------------------------------------------------------------- prepare-points [58] 100.0% [70] 200(0.2%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [77] 100.0% -------------------------------------------------------------------------- type-of-enode-expr [65] 100.0% [71] 19844(17.6%) 270(0.2%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [80] 50.2% ??? [134] 23.5% ...sting/src/common.rkt:47:2 [82] 13.3% ??? [79] 11.7% -------------------------------------------------------------------------- for-loop [66] 100.0% [72] 8060(7.1%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [81] 100.0% -------------------------------------------------------------------------- loop [60] 4.0% loop [69] 21.8% prepare-points [58] 74.2% [73] 7016(6.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [78] 100.0% -------------------------------------------------------------------------- custom-set-union [67] 100.0% [74] 5498(4.9%) 2710(2.4%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [83] 50.7% -------------------------------------------------------------------------- loop [60] 23.5% prepare-points [58] 34.1% loop [69] 42.4% [75] 4546(4.0%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [78] 79.0% eval-prog [124] 21.0% -------------------------------------------------------------------------- custom-set-union [67] 100.0% [76] 274(0.2%) 274(0.2%) for-loop ...cts/racket/private/set-types.rkt:152:2 -------------------------------------------------------------------------- for-loop [70] 100.0% [77] 200(0.2%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 for-loop [84] 100.0% -------------------------------------------------------------------------- option-on-expr [91] 0.0% loop [73] 0.1% make-exacts* [75] 0.8% match-e [26] 1.3% f12 [30] 2.2% ??? [6] 3.4% loop! [56] 10.0% loop [78] 82.2% [78] 28420(25.2%) 2318(2.1%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [78] 82.2% loop! [56] 8.5% hash-ref! [136] 3.4% option-on-expr [91] 2.2% ??? [135] 0.9% ??? [128] 0.0% ??? [9] 0.0% -------------------------------------------------------------------------- run-improve50 [3] 2.8% substitute-e [37] 4.5% choose-best-alt! [31] 5.0% variable? [5] 13.5% finalize-iter! [28] 16.5% get-sigs [71] 20.5% match-e [26] 37.2% [79] 11328(10.0%) 3608(3.2%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [86] 40.8% for-loop [89] 16.5% atab-pick-alt8 [93] 5.0% ??? [114] 3.0% atab-add-altns [94] 2.8% -------------------------------------------------------------------------- get-sigs [71] 100.0% [80] 9958(8.8%) 574(0.5%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [87] 53.6% for-loop [88] 33.9% get/build-late-neg-projection [122] 6.7% -------------------------------------------------------------------------- hash-update! [72] 100.0% [81] 8060(7.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [85] 100.0% -------------------------------------------------------------------------- for-loop [39] 30.8% get-sigs [71] 69.2% [82] 3798(3.4%) 1242(1.1%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [90] 40.5% ??? [92] 26.8% -------------------------------------------------------------------------- for-loop [74] 100.0% [83] 2788(2.5%) 2788(2.5%) for-loop ...cts/racket/private/set-types.rkt:178:5 -------------------------------------------------------------------------- ??? [77] 100.0% [84] 200(0.2%) 0(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:231:9 ??? [128] 100.0% -------------------------------------------------------------------------- ??? [81] 100.0% [85] 8060(7.1%) 6446(5.7%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [95] 20.0% -------------------------------------------------------------------------- mk-enode! [45] 15.9% ??? [79] 84.1% [86] 5498(4.9%) 2722(2.4%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [139] 50.5% -------------------------------------------------------------------------- ??? [80] 100.0% [87] 5336(4.7%) 224(0.2%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [97] 95.8% -------------------------------------------------------------------------- for-loop [152] 18.4% ??? [80] 81.6% [88] 4142(3.7%) 222(0.2%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [96] 94.6% -------------------------------------------------------------------------- ??? [79] 100.0% [89] 1872(1.7%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:53:2 atab-add-altn [98] 100.0% -------------------------------------------------------------------------- for-loop [108] 19.4% ...sting/src/common.rkt:47:2 [82] 80.6% [90] 1540(1.4%) 266(0.2%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [96] 65.0% ??? [102] 15.6% ??? [114] 10.8% -------------------------------------------------------------------------- f12 [30] 40.2% loop [78] 59.8% [91] 1064(0.9%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [100] 39.1% loop [78] 21.1% err-lsts->split-indices [103] 20.7% errors [115] 19.2% -------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [82] 100.0% [92] 1016(0.9%) 440(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [144] 32.1% assoc-ref [101] 24.6% -------------------------------------------------------------------------- ??? [79] 100.0% [93] 570(0.5%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:64:0 write-json* [99] 100.0% -------------------------------------------------------------------------- ??? [79] 100.0% [94] 312(0.3%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [98] 100.0% -------------------------------------------------------------------------- for-loop [50] 3.7% for-loop [85] 29.9% loop! [56] 66.4% [95] 5406(4.8%) 4598(4.1%) update-en-expr ...esting/src/core/egraph.rkt:212:0 for-loop [107] 14.9% -------------------------------------------------------------------------- ??? [90] 24.9% for-loop [88] 75.1% [96] 5220(4.6%) 702(0.6%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [105] 75.1% for-loop [108] 11.5% -------------------------------------------------------------------------- ??? [87] 100.0% [97] 5112(4.5%) 236(0.2%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [104] 95.4% -------------------------------------------------------------------------- atab-add-altns [94] 14.3% for-loop [89] 85.7% [98] 2184(1.9%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [106] 85.7% override-at-pnts [111] 14.3% -------------------------------------------------------------------------- atab-pick-alt8 [93] 100.0% [99] 570(0.5%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:69:0 loop [109] 100.0% -------------------------------------------------------------------------- option-on-expr [91] 100.0% [100] 416(0.4%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [110] 100.0% -------------------------------------------------------------------------- ??? [92] 100.0% [101] 250(0.2%) 250(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 -------------------------------------------------------------------------- ??? [90] 100.0% [102] 240(0.2%) 240(0.2%) ??? ...ects/racket/contract/private/hash.rkt:222:6 -------------------------------------------------------------------------- option-on-expr [91] 100.0% [103] 220(0.2%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [112] 100.0% -------------------------------------------------------------------------- ??? [97] 100.0% [104] 4876(4.3%) 330(0.3%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [113] 93.2% -------------------------------------------------------------------------- ??? [96] 100.0% [105] 3920(3.5%) 662(0.6%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [114] 77.8% ??? [120] 5.3% -------------------------------------------------------------------------- atab-add-altn [98] 100.0% [106] 1872(1.7%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [115] 100.0% -------------------------------------------------------------------------- update-en-expr [95] 100.0% [107] 808(0.7%) 808(0.7%) for-loop .../alt-testing/src/core/egraph.rkt:214:6 -------------------------------------------------------------------------- ??? [96] 100.0% [108] 598(0.5%) 0(0.0%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [90] 100.0% -------------------------------------------------------------------------- loop [109] 11.3% for-loop [116] 29.6% for-loop [117] 29.6% write-json* [99] 29.6% [109] 570(0.5%) 570(0.5%) loop .../share/racket/collects/json/main.rkt:103:2 for-loop [117] 29.6% for-loop [116] 29.6% loop [109] 11.3% -------------------------------------------------------------------------- sort-context-on-expr [100] 100.0% [110] 416(0.4%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [118] 100.0% -------------------------------------------------------------------------- atab-add-altn [98] 100.0% [111] 312(0.3%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [115] 100.0% -------------------------------------------------------------------------- err-lsts->split-indices [103] 100.0% [112] 220(0.2%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [119] 100.0% -------------------------------------------------------------------------- ??? [104] 100.0% [113] 4546(4.0%) 644(0.6%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [121] 52.7% get/build-late-neg-projection [122] 33.1% -------------------------------------------------------------------------- ??? [90] 8.9% ??? [79] 9.1% ??? [105] 81.9% [114] 3722(3.3%) 3390(3.0%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [126] 8.9% -------------------------------------------------------------------------- option-on-expr [91] 8.5% override-at-pnts [111] 13.1% best-and-tied-at-points [106] 78.4% [115] 2388(2.1%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [123] 82.2% eval-prog [124] 17.8% -------------------------------------------------------------------------- loop [109] 100.0% [116] 570(0.5%) 0(0.0%) for-loop ...e/racket/collects/json/main.rkt:113:13 loop [109] 100.0% -------------------------------------------------------------------------- loop [109] 100.0% [117] 570(0.5%) 0(0.0%) for-loop ...e/racket/collects/json/main.rkt:118:11 loop [109] 100.0% -------------------------------------------------------------------------- ??? [110] 100.0% [118] 416(0.4%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [125] 100.0% -------------------------------------------------------------------------- add-splitpoint [112] 100.0% [119] 220(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [127] 100.0% -------------------------------------------------------------------------- ??? [105] 100.0% [120] 208(0.2%) 208(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 -------------------------------------------------------------------------- for-loop [113] 100.0% [121] 2396(2.1%) 2396(2.1%) add-list-context ...ontract/private/list.rkt:752:0 -------------------------------------------------------------------------- ??? [130] 15.4% ??? [80] 15.4% for-loop [113] 69.2% [122] 2176(1.9%) 346(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [129] 76.7% ??? [130] 15.4% -------------------------------------------------------------------------- errors [115] 100.0% [123] 1962(1.7%) 0(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [135] 65.5% ??? [128] 24.2% ulp-difference [133] 10.3% -------------------------------------------------------------------------- errors [115] 30.8% make-exacts* [75] 69.2% [124] 1382(1.2%) 426(0.4%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 hash-ref! [136] 69.2% -------------------------------------------------------------------------- copying-mergesort [125] 34.6% generic-sort/key [118] 65.4% [125] 416(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 loop [132] 65.4% copying-mergesort [125] 34.6% -------------------------------------------------------------------------- ??? [114] 100.0% [126] 332(0.3%) 332(0.3%) contract? ...acket/contract/private/guts.rkt:109:0 -------------------------------------------------------------------------- for-loop [119] 100.0% [127] 220(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [131] 100.0% -------------------------------------------------------------------------- ??? [147] 5.9% ??? [134] 5.9% for-loop [61] 5.9% ??? [135] 6.3% for-loop [84] 6.3% loop [132] 6.8% ??? [9] 7.1% for-loop [123] 14.9% loop [78] 40.8% [128] 3174(2.8%) 216(0.2%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [134] 81.3% approximate9 [7] 5.9% hash-ref! [136] 5.9% -------------------------------------------------------------------------- get/build-late-neg-projection [122]100.0% [129] 1830(1.6%) 696(0.6%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [137] 62.0% -------------------------------------------------------------------------- get/build-late-neg-projection [122]100.0% [130] 670(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [122]100.0% -------------------------------------------------------------------------- for-loop [127] 48.7% for-loop [38] 51.3% [131] 452(0.4%) 452(0.4%) curried ...cket/collects/racket/function.rkt:71:18 -------------------------------------------------------------------------- copying-mergesort [125] 100.0% [132] 416(0.4%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [128] 51.9% ??? [135] 48.1% -------------------------------------------------------------------------- for-loop [123] 100.0% [133] 202(0.2%) 0(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [143] 100.0% -------------------------------------------------------------------------- get-sigs [71] 1.6% simplify-alt [22] 1.6% for-loop [39] 1.6% ??? [128] 3.0% ??? [134] 7.9% for-loop [138] 38.9% ??? [44] 44.2% [134] 99690(88.3%) 3744(3.3%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [2] 44.2% for-loop [138] 38.9% ??? [134] 7.9% loop [4] 2.5% ??? [139] 2.4% ??? [128] 0.6% return/no-unsupplied [143] 0.5% mk-egraph [145] 0.4% ??? [144] 0.3% -------------------------------------------------------------------------- loop [132] 1.9% for-loop [123] 12.2% loop [78] 85.9% [135] 10528(9.3%) 234(0.2%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [140] 63.9% ??? [141] 32.0% ??? [128] 1.9% -------------------------------------------------------------------------- for-loop [17] 3.3% ??? [149] 3.3% ??? [128] 7.9% ??? [147] 7.9% loop [16] 7.9% eval-prog [124] 16.1% update-leader! [46] 18.0% loop [78] 35.4% [136] 1856(1.6%) 334(0.3%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [6] 35.4% bigfloat-hash [142] 16.1% ??? [147] 15.9% taylor [150] 4.6% ??? [149] 3.3% ??? [8] 3.3% simplify [148] 3.3% -------------------------------------------------------------------------- contract-struct-name [146] 15.3% ??? [129] 84.7% [137] 1134(1.0%) 834(0.7%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [146] 41.8% -------------------------------------------------------------------------- ??? [134] 100.0% [138] 80720(71.5%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [134] 100.0% -------------------------------------------------------------------------- hash-has-key? [86] 28.1% ??? [134] 71.9% [139] 9874(8.7%) 6288(5.6%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [152] 23.9% ??? [162] 9.0% arrow-higher-order:lnp [158] 3.4% -------------------------------------------------------------------------- ??? [135] 100.0% [140] 6724(6.0%) 2672(2.4%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [161] 34.1% bf* [153] 26.2% -------------------------------------------------------------------------- ??? [135] 100.0% [141] 3370(3.0%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [151] 100.0% -------------------------------------------------------------------------- hash-ref! [136] 100.0% [142] 956(0.8%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 sig+exp->bigfloat [154] 100.0% -------------------------------------------------------------------------- ulp-difference [133] 22.5% ??? [134] 77.5% [143] 898(0.8%) 426(0.4%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [157] 52.6% -------------------------------------------------------------------------- ??? [92] 42.2% ??? [134] 57.8% [144] 772(0.7%) 206(0.2%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [155] 73.3% -------------------------------------------------------------------------- ??? [134] 100.0% [145] 752(0.7%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [156] 63.3% mk-enode! [45] 36.7% -------------------------------------------------------------------------- build-compound-type-name [137] 100.0% [146] 648(0.6%) 300(0.3%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [137] 53.7% -------------------------------------------------------------------------- hash-ref! [136] 100.0% [147] 566(0.5%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 hash-ref! [136] 50.0% ??? [128] 50.0% -------------------------------------------------------------------------- hash-ref! [136] 100.0% [148] 310(0.3%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 debug7 [159] 100.0% -------------------------------------------------------------------------- hash-ref! [136] 100.0% [149] 310(0.3%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [136] 100.0% -------------------------------------------------------------------------- hash-ref! [136] 100.0% [150] 256(0.2%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 debug-print [160] 100.0% -------------------------------------------------------------------------- ??? [141] 100.0% [151] 3370(3.0%) 2688(2.4%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [166] 20.2% -------------------------------------------------------------------------- ??? [139] 100.0% [152] 2360(2.1%) 734(0.7%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [162] 36.5% for-loop [88] 32.4% -------------------------------------------------------------------------- ??? [140] 100.0% [153] 1760(1.6%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [161] 100.0% -------------------------------------------------------------------------- bigfloat-hash [142] 100.0% [154] 956(0.8%) 956(0.8%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 -------------------------------------------------------------------------- ??? [144] 100.0% [155] 566(0.5%) 566(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 -------------------------------------------------------------------------- mk-enode-rec! [156] 50.0% mk-egraph [145] 50.0% [156] 476(0.4%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [156] 50.0% mk-enode! [45] 50.0% -------------------------------------------------------------------------- return/no-unsupplied [143] 100.0% [157] 472(0.4%) 472(0.4%) filter ...t/collects/racket/private/list.rkt:256:2 -------------------------------------------------------------------------- ??? [139] 100.0% [158] 334(0.3%) 334(0.3%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 -------------------------------------------------------------------------- simplify [148] 100.0% [159] 310(0.3%) 310(0.3%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 -------------------------------------------------------------------------- taylor [150] 100.0% [160] 256(0.2%) 0(0.0%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 for-loop [163] 100.0% -------------------------------------------------------------------------- bf* [153] 43.4% ??? [140] 56.6% [161] 4052(3.6%) 234(0.2%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [164] 94.2% -------------------------------------------------------------------------- for-loop [152] 49.1% ??? [139] 50.9% [162] 1754(1.6%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [165] 100.0% -------------------------------------------------------------------------- debug-print [160] 100.0% [163] 256(0.2%) 256(0.2%) for-loop ...herbie/alt-testing/src/debug.rkt:113:2 -------------------------------------------------------------------------- ??? [161] 100.0% [164] 3818(3.4%) 2676(2.4%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [166] 29.9% -------------------------------------------------------------------------- ??? [162] 100.0% [165] 1754(1.6%) 1754(1.6%) make-keyword-procedure ...ket/private/kw.rkt:260:4 -------------------------------------------------------------------------- real->bigfloat [151] 37.4% bfmul [164] 62.6% [166] 1824(1.6%) 1824(1.6%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 --------------------------------------------------------------------------