Profiling results ----------------- Total cpu time observed: 1936956ms (out of 1944180ms) Number of samples taken: 5738 (once every 338ms) (Hiding functions with self<1.0% and local<2.0%: 22 of 289 hidden) =========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================================== ??? [79] 100.0% [1] 1601282(82.7%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [21] 100.0% ------------------------------------------------------------------------------------------- ??? [79] 100.0% [2] 1497736(77.3%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:234:0 for-loop [22] 96.5% get-final-combination [25] 2.3% loop [95] 0.6% prepare-points [96] 0.4% setup-alt-simplified [30] 0.2% ??? [123] 0.0% ------------------------------------------------------------------------------------------- ??? [216] 100.0% [3] 1280652(66.1%) 306(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [23] 98.3% debug-print [92] 0.0% ------------------------------------------------------------------------------------------- ??? [216] 100.0% [4] 342804(17.7%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [24] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [207] 100.0% [5] 77338(4.0%) 5194(0.3%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [158] 59.1% hash-ref! [207] 38.2% ------------------------------------------------------------------------------------------- pattern-substitute [221] 1.2% expression->type [162] 1.2% substitute-e [70] 21.1% match-e [54] 76.4% [6] 26676(1.4%) 2000(0.1%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [123] 92.5% ------------------------------------------------------------------------------------------- loop [158] 98.3% [7] 19202(1.0%) 4948(0.3%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [26] 48.3% eval-const-expr [31] 11.9% curried [231] 7.3% compose [34] 6.7% ------------------------------------------------------------------------------------------- ??? [165] 100.0% [8] 12572(0.6%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [27] 73.5% f137 [153] 26.5% ------------------------------------------------------------------------------------------- hash-ref! [207] 100.0% [9] 8608(0.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [207] 96.1% ??? [45] 3.9% ------------------------------------------------------------------------------------------- hash-ref! [207] 100.0% [10] 8582(0.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [165] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [207] 100.0% [11] 7618(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [28] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [207] 100.0% [12] 6640(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [29] 100.0% ------------------------------------------------------------------------------------------- generic-sort/key [210] 8.4% copying-mergesort [220] 91.6% [13] 4270(0.2%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [152] 91.6% errors-score [36] 8.4% ------------------------------------------------------------------------------------------- hash-ref! [207] 100.0% [14] 3668(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [207] 50.6% for-loop [32] 49.4% ------------------------------------------------------------------------------------------- f137 [153] 100.0% [15] 1318(0.1%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [43] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [207] 100.0% [16] 1304(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 for-loop [33] 100.0% ------------------------------------------------------------------------------------------- f137 [153] 100.0% [17] 1006(0.1%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 debug-print [92] 36.2% debug7 [65] 32.0% loop [158] 31.8% ------------------------------------------------------------------------------------------- hash-ref! [207] 100.0% [18] 652(0.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [35] 100.0% ------------------------------------------------------------------------------------------- f137 [153] 100.0% [19] 304(0.0%) 0(0.0%) taylor-exp ...lt-testing/src/core/taylor.rkt:386:0 simplify [43] 100.0% ------------------------------------------------------------------------------------------- f137 [153] 100.0% [20] 304(0.0%) 0(0.0%) exprs-to-branch-on ...ng/src/core/regimes.rkt:42:0 all-critical-subexpressions [37] 100.0% ------------------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [21] 1601616(82.7%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [79] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [22] 1445564(74.6%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:249:10 run-iter! [38] 100.0% ------------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [23] 1259400(65.0%) 17794(0.9%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [39] 77.0% for-loop [41] 21.4% ------------------------------------------------------------------------------------------- loop [4] 100.0% [24] 342804(17.7%) 1896(0.1%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [40] 99.3% loop [48] 0.1% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [25] 34328(1.8%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:264:0 split-table [42] 96.1% extract-alt [46] 3.9% ------------------------------------------------------------------------------------------- for-loop [7] 100.0% [26] 9280(0.5%) 6686(0.3%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 for-loop [47] 14.2% ??? [123] 13.8% ------------------------------------------------------------------------------------------- approximate9 [8] 100.0% [27] 9246(0.5%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 hash-ref! [207] 92.8% ??? [165] 7.2% ------------------------------------------------------------------------------------------- ??? [11] 100.0% [28] 7618(0.4%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 hash-ref! [207] 90.9% ??? [45] 4.8% simplify [43] 4.3% ------------------------------------------------------------------------------------------- ??? [12] 100.0% [29] 6640(0.3%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [207] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [30] 3614(0.2%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [44] 100.0% ------------------------------------------------------------------------------------------- for-loop [7] 100.0% [31] 2288(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f137 [153] 73.3% ??? [50] 26.7% ------------------------------------------------------------------------------------------- ??? [14] 100.0% [32] 1980(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [207] 100.0% ------------------------------------------------------------------------------------------- ??? [16] 100.0% [33] 1304(0.1%) 298(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:324:46 simplify [43] 77.1% ------------------------------------------------------------------------------------------- for-loop [7] 100.0% [34] 1282(0.1%) 1282(0.1%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------------------------- ??? [18] 100.0% [35] 652(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [49] 100.0% ------------------------------------------------------------------------------------------- jloop [13] 100.0% [36] 360(0.0%) 0(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 loop [48] 100.0% ------------------------------------------------------------------------------------------- exprs-to-branch-on [20] 100.0% [37] 304(0.0%) 0(0.0%) all-critical-subexpressions ...re/regimes.rkt:58:0 for-loop [51] 100.0% ------------------------------------------------------------------------------------------- for-loop [22] 100.0% [38] 1445564(74.6%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:215:0 simplify! [52] 92.5% finalize-iter! [56] 5.1% gen-series! [59] 0.9% choose-best-alt! [60] 0.7% gen-rewrites! [61] 0.6% localize-error [63] 0.2% ------------------------------------------------------------------------------------------- one-iter [23] 100.0% [39] 969530(50.1%) 4600(0.2%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [53] 88.1% match-e [54] 6.9% update-leader! [81] 4.3% reduce-to-single! [62] 0.3% ------------------------------------------------------------------------------------------- pass [24] 100.0% [40] 340248(17.6%) 4576(0.2%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [55] 74.5% loop [57] 18.9% for-loop [58] 4.6% make-sequence [182] 0.7% ------------------------------------------------------------------------------------------- for-loop [41] 49.2% one-iter [23] 50.8% [41] 270056(13.9%) 60462(3.1%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [41] 49.2% match-e [54] 38.5% ??? [99] 0.3% ------------------------------------------------------------------------------------------- get-final-combination [25] 100.0% [42] 33004(1.7%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f137 [153] 100.0% ------------------------------------------------------------------------------------------- taylor-exp [19] 2.7% loop [158] 2.8% for-loop [28] 2.9% for-loop [33] 8.9% taylor-invert [15] 11.7% hash-ref! [207] 71.0% [43] 11288(0.6%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f137 [153] 55.3% parse-loop12 [219] 17.9% simplify-node [173] 8.9% debug-print [92] 5.9% simplify* [64] 5.8% make-multiplication-node [242] 3.2% debug7 [65] 3.0% ------------------------------------------------------------------------------------------- setup-alt-simplified [30] 100.0% [44] 3614(0.2%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [216] 100.0% ------------------------------------------------------------------------------------------- ??? [9] 25.1% for-loop [28] 74.9% [45] 1348(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [207] 100.0% ------------------------------------------------------------------------------------------- get-final-combination [25] 100.0% [46] 1324(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 loop [197] 75.7% argmins [199] 24.3% ------------------------------------------------------------------------------------------- setfindf [26] 100.0% [47] 1318(0.1%) 1318(0.1%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 ------------------------------------------------------------------------------------------- pass [24] 46.9% errors-score [36] 53.1% [48] 678(0.0%) 678(0.0%) loop ...hare/racket/collects/racket/list.rkt:551:2 ------------------------------------------------------------------------------------------- for-loop [35] 100.0% [49] 652(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [207] 100.0% ------------------------------------------------------------------------------------------- eval-const-expr [31] 100.0% [50] 610(0.0%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [66] 100.0% ------------------------------------------------------------------------------------------- all-critical-subexpressions [37] 100.0% [51] 304(0.0%) 0(0.0%) for-loop .../alt-testing/src/core/regimes.rkt:62:2 f137 [153] 100.0% ------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [52] 1337150(69.0%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:155:0 for-loop [67] 100.0% ------------------------------------------------------------------------------------------- for-loop [39] 100.0% [53] 853996(44.1%) 4046(0.2%) for-loop ...t-testing/src/core/simplify.rkt:148:10 mk-enode! [80] 32.3% merge-egraph-nodes! [69] 28.4% substitute-e [70] 26.0% loop! [164] 11.3% list-member? [74] 1.4% ------------------------------------------------------------------------------------------- for-loop [39] 14.9% for-loop [82] 23.5% for-loop [41] 61.6% [54] 274414(14.2%) 101108(5.2%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [71] 44.3% for-loop [82] 8.6% ??? [123] 6.6% variable? [6] 2.9% list-cartesian-product [85] 2.9% loop [158] 1.3% custom-in-set [212] 1.0% curry* [163] 0.4% filter [241] 0.1% ------------------------------------------------------------------------------------------- for-loop [40] 100.0% [55] 253486(13.1%) 336(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [68] 88.0% expression-cost [72] 11.8% ------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [56] 73010(3.8%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:169:0 ??? [123] 100.0% ------------------------------------------------------------------------------------------- for-loop [40] 100.0% [57] 64240(3.3%) 336(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [68] 90.1% expression-cost [72] 9.4% ------------------------------------------------------------------------------------------- for-loop [40] 100.0% [58] 15594(0.8%) 15594(0.8%) for-loop ...t-testing/src/core/simplify.rkt:217:13 ------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [59] 12906(0.7%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:129:0 for-loop [73] 100.0% ------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [60] 10660(0.6%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:115:0 ??? [123] 100.0% ------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [61] 9046(0.5%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:142:0 for-loop [75] 100.0% ------------------------------------------------------------------------------------------- for-loop [39] 100.0% [62] 2930(0.2%) 620(0.0%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [76] 55.3% make-sequence [182] 23.5% ------------------------------------------------------------------------------------------- run-iter! [38] 100.0% [63] 2792(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [207] 87.1% ??? [194] 12.9% ------------------------------------------------------------------------------------------- map [161] 33.7% simplify [43] 66.3% [64] 990(0.1%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [207] 66.3% ??? [78] 33.7% ------------------------------------------------------------------------------------------- taylor [17] 48.8% simplify [43] 51.2% [65] 660(0.0%) 0(0.0%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 ??? [123] 100.0% ------------------------------------------------------------------------------------------- ??? [50] 100.0% [66] 610(0.0%) 0(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 maybe-cons-kwd [77] 100.0% ------------------------------------------------------------------------------------------- simplify! [52] 96.4% [67] 1387776(71.6%) 310(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:159:6 ??? [79] 99.9% foldl [170] 0.0% debug-print [92] 0.0% ------------------------------------------------------------------------------------------- loop [57] 20.6% argmin [55] 79.4% [68] 281042(14.5%) 7032(0.4%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [216] 71.2% ...sting/src/common.rkt:47:2 [126] 23.6% ??? [124] 2.6% ------------------------------------------------------------------------------------------- for-loop [86] 3.9% merge-egraph-nodes! [69] 4.8% for-loop [53] 91.3% [69] 242934(12.5%) 7316(0.4%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [81] 60.8% loop! [164] 11.1% for-loop [84] 10.9% for-loop [86] 5.2% merge-egraph-nodes! [69] 4.8% enode-merge! [89] 3.2% for-loop [120] 0.8% make-sequence [182] 0.3% ------------------------------------------------------------------------------------------- substitute-e [70] 4.5% for-loop [53] 95.5% [70] 222360(11.5%) 5750(0.3%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [80] 90.8% substitute-e [70] 4.5% ??? [123] 1.8% variable? [6] 1.1% ------------------------------------------------------------------------------------------- match-e [54] 100.0% [71] 159432(8.2%) 56754(2.9%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [82] 53.7% list-cartesian-product [85] 7.8% loop [158] 4.4% curry* [163] 0.8% curried [231] 0.8% foldl [170] 0.6% filter [241] 0.4% ------------------------------------------------------------------------------------------- loop [57] 16.8% argmin [55] 83.2% [72] 36012(1.9%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [83] 100.0% ------------------------------------------------------------------------------------------- gen-series! [59] 100.0% [73] 12906(0.7%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:135:7 taylor-alt [87] 100.0% ------------------------------------------------------------------------------------------- for-loop [53] 100.0% [74] 12342(0.6%) 1002(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [90] 57.3% member [91] 34.5% ------------------------------------------------------------------------------------------- gen-rewrites! [61] 100.0% [75] 9046(0.5%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:147:11 ??? [88] 100.0% ------------------------------------------------------------------------------------------- reduce-to-single! [62] 100.0% [76] 1620(0.1%) 1620(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 ------------------------------------------------------------------------------------------- unpack245 [66] 100.0% [77] 610(0.0%) 0(0.0%) maybe-cons-kwd ...ate/arrow-higher-order.rkt:498:0 arrow-higher-order:lnp [252] 51.1% successfully-got-the-right-kind-of-function [243] 48.9% ------------------------------------------------------------------------------------------- simplify* [64] 100.0% [78] 334(0.0%) 334(0.0%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ------------------------------------------------------------------------------------------- for-loop [67] 26.1% run [21] 30.4% [79] 1903892(98.3%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [216] 38.9% profile-thunk16 [1] 30.4% run-improve50 [2] 27.8% loop [95] 1.7% prepare-points [96] 1.2% ------------------------------------------------------------------------------------------- mk-egraph [228] 0.1% mk-enode-rec! [240] 2.5% substitute-e [70] 41.1% for-loop [53] 56.3% [80] 490864(25.3%) 38642(2.0%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [93] 90.0% hash-has-key? [132] 1.7% mutable-set [109] 0.4% ------------------------------------------------------------------------------------------- for-loop [39] 20.7% merge-egraph-nodes! [69] 79.3% [81] 200520(10.4%) 11942(0.6%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [94] 89.2% custom-set-union! [101] 1.7% update-en-expr [177] 1.5% hash-ref! [207] 0.7% mutable-set [109] 0.6% make-sequence [182] 0.3% ------------------------------------------------------------------------------------------- match-e [54] 31.2% for-loop [71] 68.8% [82] 128866(6.7%) 8554(0.4%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [54] 90.5% ??? [99] 3.8% ------------------------------------------------------------------------------------------- expression-cost [72] 100.0% [83] 36012(1.9%) 664(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [207] 98.2% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [69] 100.0% [84] 26860(1.4%) 21898(1.1%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [177] 18.5% ------------------------------------------------------------------------------------------- match-e [54] 29.1% list-cartesian-product [85] 29.1% for-loop [71] 41.8% [85] 24702(1.3%) 21820(1.1%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [85] 29.1% for-loop [102] 10.3% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [69] 100.0% [86] 22170(1.1%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [69] 85.6% loop! [164] 14.4% ------------------------------------------------------------------------------------------- for-loop [73] 100.0% [87] 12906(0.7%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [97] 97.4% f137 [153] 2.6% ------------------------------------------------------------------------------------------- for-loop [75] 100.0% [88] 9046(0.5%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [98] 100.0% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [69] 100.0% [89] 7862(0.4%) 1338(0.1%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [100] 62.3% custom-set-intersect! [103] 20.7% ------------------------------------------------------------------------------------------- list-member? [74] 100.0% [90] 7078(0.4%) 7078(0.4%) loop (unknown source) ------------------------------------------------------------------------------------------- list-member? [74] 100.0% [91] 4262(0.2%) 4262(0.2%) member (unknown source) ------------------------------------------------------------------------------------------- for-loop [67] 18.7% iterate-egraph!13 [3] 19.9% taylor [17] 21.6% simplify [43] 39.8% [92] 1682(0.1%) 1004(0.1%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 for-loop [104] 40.3% ------------------------------------------------------------------------------------------- mk-enode! [80] 100.0% [93] 441910(22.8%) 2544(0.1%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [105] 97.8% set [178] 1.0% mutable-set [109] 0.5% ------------------------------------------------------------------------------------------- update-leader! [81] 100.0% [94] 178956(9.2%) 3916(0.2%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [106] 97.6% update-en-expr [177] 0.2% ------------------------------------------------------------------------------------------- run-improve50 [2] 11.7% ??? [79] 88.3% [95] 72376(3.7%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 loop [107] 46.4% make-exacts* [117] 33.0% loop [118] 20.6% ------------------------------------------------------------------------------------------- run-improve50 [2] 10.3% ??? [79] 89.7% [96] 52790(2.7%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [107] 46.1% make-exacts* [117] 29.8% loop [118] 23.5% filter-points [113] 0.7% ------------------------------------------------------------------------------------------- taylor-alt [87] 100.0% [97] 12572(0.6%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [165] 100.0% ------------------------------------------------------------------------------------------- ??? [88] 31.7% matcher [119] 68.3% [98] 9046(0.5%) 1012(0.1%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [108] 73.9% expression->type [162] 10.8% *rules* [111] 8.3% f137 [153] 4.3% ------------------------------------------------------------------------------------------- for-loop [41] 24.8% for-loop [82] 75.2% [99] 6578(0.3%) 4898(0.3%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [112] 20.4% custom-in-set [212] 5.1% ------------------------------------------------------------------------------------------- enode-merge! [89] 100.0% [100] 4900(0.3%) 1286(0.1%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [176] 73.8% ------------------------------------------------------------------------------------------- update-leader! [81] 100.0% [101] 3318(0.2%) 928(0.0%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [110] 72.0% ------------------------------------------------------------------------------------------- list-cartesian-product [85] 100.0% [102] 2882(0.1%) 2882(0.1%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------------------- enode-merge! [89] 100.0% [103] 1624(0.1%) 1624(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------------- debug-print [92] 100.0% [104] 678(0.0%) 364(0.0%) for-loop ...herbie/alt-testing/src/debug.rkt:113:2 write-proc [114] 46.3% ------------------------------------------------------------------------------------------- new-enode [93] 100.0% [105] 432100(22.3%) 6106(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [115] 98.1% parse-loop12 [219] 0.5% ------------------------------------------------------------------------------------------- for-loop [94] 100.0% [106] 174732(9.0%) 1322(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [116] 99.2% ------------------------------------------------------------------------------------------- prepare-points [96] 42.0% loop [95] 58.0% [107] 57882(3.0%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [117] 82.3% loop [118] 17.7% ------------------------------------------------------------------------------------------- rewriter [98] 100.0% [108] 8712(0.4%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [119] 100.0% ------------------------------------------------------------------------------------------- update-leader! [81] 22.7% mk-enode! [80] 35.9% new-enode [93] 41.4% [109] 5560(0.3%) 5224(0.3%) mutable-set .../racket/private/set-types.rkt:999:0 for-loop [122] 6.0% ------------------------------------------------------------------------------------------- custom-set-union! [101] 100.0% [110] 2390(0.1%) 2390(0.1%) for-loop ...cts/racket/private/set-types.rkt:253:4 ------------------------------------------------------------------------------------------- rewriter [98] 100.0% [111] 1932(0.1%) 336(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [120] 82.6% ------------------------------------------------------------------------------------------- ??? [99] 100.0% [112] 1342(0.1%) 1342(0.1%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ------------------------------------------------------------------------------------------- prepare-points [96] 100.0% [113] 368(0.0%) 0(0.0%) filter-points .../alt-testing/src/points.rkt:171:0 for-loop [121] 100.0% ------------------------------------------------------------------------------------------- for-loop [104] 100.0% [114] 314(0.0%) 314(0.0%) write-proc ...alt-testing/src/alternative.rkt:29:9 ------------------------------------------------------------------------------------------- type-of-enode-expr [105] 100.0% [115] 423916(21.9%) 7772(0.4%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [124] 38.9% ??? [216] 31.5% ??? [123] 14.8% ...sting/src/common.rkt:47:2 [126] 12.9% ------------------------------------------------------------------------------------------- for-loop [106] 100.0% [116] 173410(9.0%) 1668(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [125] 99.0% ------------------------------------------------------------------------------------------- prepare-points [96] 18.0% loop [95] 27.4% loop [107] 54.6% [117] 87264(4.5%) 1420(0.1%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [148] 56.3% loop [158] 42.1% ------------------------------------------------------------------------------------------- loop [107] 27.3% prepare-points [96] 33.0% loop [95] 39.7% [118] 37534(1.9%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [158] 95.9% ??? [152] 4.1% ------------------------------------------------------------------------------------------- matcher [119] 22.1% for-loop [127] 27.2% for-loop [108] 50.7% [119] 8712(0.4%) 346(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [98] 47.4% for-loop [127] 27.2% matcher [119] 22.1% for-loop [129] 1.9% ------------------------------------------------------------------------------------------- *rules* [111] 36.8% merge-egraph-nodes! [69] 63.2% [120] 4338(0.2%) 2688(0.1%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 flag-set? [139] 14.4% update-en-expr [177] 8.3% loop [128] 7.7% ormap [130] 7.7% ------------------------------------------------------------------------------------------- filter-points [113] 100.0% [121] 368(0.0%) 368(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:174:4 ------------------------------------------------------------------------------------------- mutable-set [109] 100.0% [122] 336(0.0%) 336(0.0%) for-loop ...cts/racket/private/set-types.rkt:943:2 ------------------------------------------------------------------------------------------- run-improve50 [2] 0.1% pattern-substitute [221] 0.2% debug7 [65] 0.3% setfindf [26] 0.6% f137 [153] 0.8% ??? [256] 2.5% substitute-e [70] 4.1% choose-best-alt! [60] 4.6% variable? [6] 11.2% match-e [54] 15.3% get-sigs [115] 28.4% finalize-iter! [56] 31.9% [123] 221270(11.4%) 50742(2.6%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [132] 39.8% for-loop [135] 31.6% atab-pick-alt8 [138] 4.6% ??? [256] 0.7% ------------------------------------------------------------------------------------------- ??? [165] 0.5% f137 [153] 1.5% for-loop [68] 4.2% get-sigs [115] 93.8% [124] 175968(9.1%) 13922(0.7%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [134] 43.9% for-loop [133] 41.2% get/build-late-neg-projection [151] 6.1% ??? [250] 0.6% ------------------------------------------------------------------------------------------- hash-update! [116] 100.0% [125] 171742(8.9%) 4232(0.2%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [131] 96.8% make-sequence [182] 0.8% ------------------------------------------------------------------------------------------- f137 [153] 1.3% ??? [165] 2.3% get-sigs [115] 43.6% for-loop [68] 52.8% [126] 125738(6.5%) 44500(2.3%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [136] 35.8% ??? [137] 28.3% ------------------------------------------------------------------------------------------- matcher [119] 100.0% [127] 7726(0.4%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [119] 100.0% ------------------------------------------------------------------------------------------- for-loop [120] 100.0% [128] 334(0.0%) 0(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [139] 100.0% ------------------------------------------------------------------------------------------- matcher [119] 100.0% [129] 332(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/matcher.rkt:159:6 pattern-substitute [221] 100.0% ------------------------------------------------------------------------------------------- for-loop [120] 100.0% [130] 332(0.0%) 0(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [139] 100.0% ------------------------------------------------------------------------------------------- ??? [125] 100.0% [131] 166206(8.6%) 141144(7.3%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [177] 15.1% ------------------------------------------------------------------------------------------- mk-enode! [80] 8.4% ??? [123] 91.6% [132] 99108(5.1%) 30612(1.6%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [224] 66.8% ??? [233] 2.3% ------------------------------------------------------------------------------------------- for-loop [237] 24.5% ??? [124] 75.5% [133] 96092(5.0%) 14040(0.7%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [238] 84.7% ??? [258] 0.7% ------------------------------------------------------------------------------------------- ??? [124] 100.0% [134] 77326(4.0%) 4958(0.3%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [141] 93.6% ------------------------------------------------------------------------------------------- ??? [123] 100.0% [135] 72296(3.7%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:52:2 atab-add-altn [140] 100.0% ------------------------------------------------------------------------------------------- for-loop [249] 8.9% ??? [238] 11.5% ...sting/src/common.rkt:47:2 [126] 79.6% [136] 44960(2.3%) 9274(0.5%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [238] 65.8% ??? [256] 12.3% ??? [250] 9.4% ------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [126] 100.0% [137] 35584(1.8%) 13988(0.7%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [226] 35.3% return/no-unsupplied [227] 13.0% assoc-ref [143] 12.4% ------------------------------------------------------------------------------------------- ??? [123] 100.0% [138] 10660(0.6%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:61:0 point-best-alt [142] 67.1% ??? [165] 32.9% ------------------------------------------------------------------------------------------- ormap [130] 25.7% loop [128] 25.9% for-loop [120] 48.4% [139] 1290(0.1%) 664(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [227] 25.7% ??? [226] 22.8% ------------------------------------------------------------------------------------------- for-loop [135] 98.6% [140] 73320(3.8%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:243:0 best-and-tied-at-points [144] 98.7% ------------------------------------------------------------------------------------------- ??? [134] 100.0% [141] 72368(3.7%) 2360(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [145] 96.7% ------------------------------------------------------------------------------------------- atab-pick-alt8 [138] 100.0% [142] 7148(0.4%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:55:0 loop [158] 100.0% ------------------------------------------------------------------------------------------- ??? [137] 100.0% [143] 4414(0.2%) 4414(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------------------- atab-add-altn [140] 100.0% [144] 72396(3.7%) 334(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:157:0 errors [146] 98.2% ------------------------------------------------------------------------------------------- ??? [141] 100.0% [145] 70008(3.6%) 2948(0.2%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [147] 95.8% ------------------------------------------------------------------------------------------- option-on-expr [166] 3.6% composed [211] 4.9% loop [158] 18.1% best-and-tied-at-points [144] 72.4% [146] 98170(5.1%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [149] 75.8% eval-prog [148] 24.2% ------------------------------------------------------------------------------------------- ??? [145] 100.0% [147] 67060(3.5%) 15900(0.8%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [150] 52.8% get/build-late-neg-projection [151] 23.5% ------------------------------------------------------------------------------------------- sort-context-on-expr [180] 0.4% option-on-expr [166] 0.9% point->alt [188] 0.9% errors [146] 31.9% make-exacts* [117] 65.9% [148] 74528(3.8%) 4980(0.3%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 hash-ref! [207] 63.9% f137 [153] 28.6% ??? [214] 0.4% ------------------------------------------------------------------------------------------- errors [146] 100.0% [149] 74398(3.8%) 1906(0.1%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [152] 91.7% ulp-difference [156] 4.5% ??? [165] 1.3% ------------------------------------------------------------------------------------------- for-loop [147] 100.0% [150] 35396(1.8%) 35396(1.8%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------------------- listof-late-neg-projection [157] 1.2% ??? [155] 16.1% ??? [124] 22.8% for-loop [147] 59.4% [151] 26546(1.4%) 4606(0.2%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [154] 64.2% ??? [155] 19.7% listof-late-neg-projection [157] 4.2% ------------------------------------------------------------------------------------------- loop [118] 1.0% ??? [213] 1.5% jloop [13] 2.5% loop [229] 5.4% for-loop [149] 43.6% loop [158] 46.1% [152] 156416(8.1%) 636(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [159] 94.7% ??? [181] 4.2% ??? [165] 0.6% ------------------------------------------------------------------------------------------- for-loop [51] 0.1% composed [211] 0.1% ??? [172] 0.2% ??? [216] 0.2% hash-ref! [207] 0.2% taylor-alt [87] 0.2% parse-loop12 [219] 0.4% append-map [185] 0.6% simplify-node [173] 0.8% approximate9 [8] 1.2% mterm->expr [265] 1.7% map [161] 2.1% eval-const-expr [31] 2.4% rewriter [98] 2.6% simplify [43] 4.7% for-loop [171] 6.2% eval-prog [148] 7.6% f137 [153] 24.7% split-table [42] 43.8% [153] 69036(3.6%) 3968(0.2%) f137 .../collects/racket/match/compiler.rkt:507:40 loop [158] 38.6% f137 [153] 24.7% ??? [165] 7.4% option-on-expr [166] 5.2% map [161] 3.7% ??? [216] 3.3% ??? [124] 3.1% expression->type [162] 2.0% ??? [123] 1.8% ...sting/src/common.rkt:47:2 [126] 1.5% append-map [185] 1.0% taylor-quotient [186] 0.5% taylor-invert [15] 0.5% curry* [163] 0.2% taylor [17] 0.2% parse-loop12 [219] 0.1% composed [211] 0.1% exprs-to-branch-on [20] 0.1% taylor-exp [19] 0.1% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [151] 100.0% [154] 19378(1.0%) 5398(0.3%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [160] 72.1% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [151] 100.0% [155] 9816(0.5%) 976(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [151] 90.1% ------------------------------------------------------------------------------------------- for-loop [149] 100.0% [156] 3336(0.2%) 1038(0.1%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [227] 48.6% ??? [226] 20.3% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [151] 100.0% [157] 2542(0.1%) 1586(0.1%) listof-late-neg-projection ...ivate/list.rkt:162:0 get/build-late-neg-projection [151] 37.6% ------------------------------------------------------------------------------------------- taylor [17] 0.1% loop [118] 0.1% make-exacts* [117] 0.3% parse-loop12 [219] 0.4% option-on-expr [166] 1.7% match-e [54] 1.7% point-best-alt [142] 1.8% for-loop [71] 2.7% f137 [153] 7.3% loop! [164] 7.5% ??? [5] 16.7% loop [158] 58.7% [158] 273150(14.1%) 12856(0.7%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [158] 58.7% hash-ref! [207] 16.7% option-on-expr [166] 7.3% loop! [164] 7.3% errors [146] 3.4% foldl [170] 1.1% for-loop [7] 0.9% curried [231] 0.4% ??? [152] 0.3% ??? [172] 0.2% parse-loop12 [219] 0.1% simplify [43] 0.1% set-precompute! [175] 0.0% ??? [213] 0.0% ??? [165] 0.0% ??? [192] 0.0% ------------------------------------------------------------------------------------------- ??? [152] 100.0% [159] 148172(7.6%) 78058(4.0%) ??? ...acket/collects/racket/private/kw.rkt:444:14 bf* [179] 16.3% ??? [192] 12.7% ??? [167] 11.1% ??? [169] 4.9% ??? [258] 1.1% parse-loop12 [219] 1.0% ------------------------------------------------------------------------------------------- contract-struct-name [168] 18.9% ??? [154] 81.1% [160] 13980(0.7%) 8238(0.4%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [168] 56.4% ------------------------------------------------------------------------------------------- ??? [172] 3.7% parse-loop12 [219] 22.2% f137 [153] 74.1% [161] 8010(0.4%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 f137 [153] 46.1% ??? [172] 27.1% simplify-node [173] 14.4% make-multiplication-node [242] 4.2% ??? [165] 3.7% parse-loop12 [219] 2.2% ??? [236] 1.3% simplify* [64] 1.0% ------------------------------------------------------------------------------------------- f137 [153] 22.5% for-loop [171] 25.9% rewriter [98] 51.6% [162] 5488(0.3%) 298(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [171] 96.2% variable? [6] 2.0% ------------------------------------------------------------------------------------------- f137 [153] 12.0% match-e [54] 38.4% for-loop [71] 49.5% [163] 2544(0.1%) 606(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [174] 76.2% ------------------------------------------------------------------------------------------- for-loop [86] 1.5% merge-egraph-nodes! [69] 18.2% loop [158] 28.0% for-loop [53] 52.2% [164] 134626(7.0%) 36598(1.9%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [176] 34.9% loop [158] 32.0% set [178] 11.2% update-en-expr [177] 5.2% ------------------------------------------------------------------------------------------- loop [27] 0.5% ??? [190] 0.8% loop [234] 0.9% map [161] 1.7% ??? [152] 2.4% for-loop [149] 2.4% loop [158] 3.3% loop [230] 4.8% ??? [216] 6.9% ??? [10] 7.1% atab-pick-alt8 [138] 7.9% for-loop [97] 11.7% f137 [153] 49.5% [165] 40428(2.1%) 644(0.0%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [216] 40.6% ??? [256] 19.6% approximate9 [8] 11.7% best-alt [183] 7.9% hash-ref! [207] 7.6% ...sting/src/common.rkt:47:2 [126] 7.1% ??? [124] 1.9% ??? [181] 1.9% ------------------------------------------------------------------------------------------- f137 [153] 12.7% loop [158] 87.3% [166] 32700(1.7%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [158] 39.7% sort-context-on-expr [180] 38.6% errors [146] 10.8% pick-errors [187] 3.0% point->alt [188] 2.1% eval-prog [148] 2.0% err-lsts->split-indices [189] 1.9% ??? [213] 1.0% sindices->spoints [191] 0.9% ------------------------------------------------------------------------------------------- ??? [159] 100.0% [167] 16382(0.8%) 9380(0.5%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [226] 26.7% return/no-unsupplied [227] 16.0% ------------------------------------------------------------------------------------------- build-compound-type-name [160] 100.0% [168] 10026(0.5%) 5742(0.3%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [160] 47.7% ------------------------------------------------------------------------------------------- ??? [159] 100.0% [169] 7258(0.4%) 7258(0.4%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------- for-loop [67] 5.8% for-loop [71] 22.8% loop [158] 71.4% [170] 5734(0.3%) 1982(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [184] 59.6% ??? [190] 5.8% ------------------------------------------------------------------------------------------- expression->type [162] 100.0% [171] 5488(0.3%) 0(0.0%) for-loop ...ie/alt-testing/src/type-check.rkt:52:5 f137 [153] 72.2% expression->type [162] 27.8% ------------------------------------------------------------------------------------------- loop [158] 32.6% map [161] 67.4% [172] 3416(0.2%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [207] 55.6% f137 [153] 29.4% taylor-quotient [186] 9.8% map [161] 5.2% ------------------------------------------------------------------------------------------- simplify [43] 37.9% map [161] 62.1% [173] 2642(0.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 append-map [185] 63.0% f137 [153] 37.0% ------------------------------------------------------------------------------------------- curry* [163] 100.0% [174] 1938(0.1%) 1938(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ------------------------------------------------------------------------------------------- loop [158] 100.0% [175] 1390(0.1%) 1048(0.1%) set-precompute! ...ing/src/core/simplify.rkt:193:0 make-sequence [182] 24.6% ------------------------------------------------------------------------------------------- adopt-enode! [100] 6.7% loop! [164] 93.3% [176] 53848(2.8%) 20072(1.0%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [193] 48.0% for-loop [195] 14.7% ------------------------------------------------------------------------------------------- for-loop [94] 0.7% for-loop [120] 0.8% update-leader! [81] 6.4% for-loop [84] 10.6% loop! [164] 28.2% for-loop [131] 53.4% [177] 46912(2.4%) 45216(2.3%) update-en-expr ...esting/src/core/egraph.rkt:212:0 for-loop [198] 3.6% ------------------------------------------------------------------------------------------- new-enode [93] 13.8% loop! [164] 86.2% [178] 33628(1.7%) 33628(1.7%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------------------- ??? [159] 98.6% [179] 24536(1.3%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [192] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [166] 100.0% [180] 12612(0.7%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [194] 97.6% eval-prog [148] 2.4% ------------------------------------------------------------------------------------------- ??? [165] 10.1% ??? [152] 89.9% [181] 7394(0.4%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [196] 89.9% integer->bigfloat [202] 10.1% ------------------------------------------------------------------------------------------- set-precompute! [175] 5.7% update-leader! [81] 10.8% reduce-to-single! [62] 11.4% merge-egraph-nodes! [69] 11.5% ??? [125] 21.6% for-loop [40] 39.0% [182] 6034(0.3%) 5380(0.3%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [203] 10.8% ------------------------------------------------------------------------------------------- ??? [165] 100.0% [183] 3512(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 loop [197] 64.0% argmins [199] 36.0% ------------------------------------------------------------------------------------------- foldl [170] 100.0% [184] 3418(0.2%) 3418(0.2%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------------------- parse-loop12 [219] 6.6% f137 [153] 43.2% simplify-node [173] 50.2% [185] 2648(0.1%) 304(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 parse-loop12 [219] 75.5% f137 [153] 20.0% free-variables [205] 2.6% ------------------------------------------------------------------------------------------- ??? [172] 32.2% f137 [153] 67.8% [186] 1036(0.1%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [200] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [166] 100.0% [187] 972(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [201] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [166] 100.0% [188] 678(0.0%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [148] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [166] 100.0% [189] 628(0.0%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [204] 100.0% ------------------------------------------------------------------------------------------- foldl [170] 100.0% [190] 334(0.0%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:66:9 ??? [165] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [166] 100.0% [191] 306(0.0%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 for-loop [206] 100.0% ------------------------------------------------------------------------------------------- loop [158] 0.8% ??? [159] 43.0% bf* [179] 56.2% [192] 43650(2.3%) 3586(0.2%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [208] 91.8% ------------------------------------------------------------------------------------------- custom-set-union [176] 100.0% [193] 25866(1.3%) 6016(0.3%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [209] 76.7% ------------------------------------------------------------------------------------------- localize-error [63] 2.8% sort-context-on-expr [180] 97.2% [194] 12668(0.7%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [210] 86.8% loop [229] 13.2% ------------------------------------------------------------------------------------------- custom-set-union [176] 100.0% [195] 7910(0.4%) 7910(0.4%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------------------- ??? [181] 100.0% [196] 6644(0.3%) 5628(0.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [218] 15.3% ------------------------------------------------------------------------------------------- extract-alt [46] 30.8% best-alt [183] 69.2% [197] 3250(0.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [211] 100.0% ------------------------------------------------------------------------------------------- update-en-expr [177] 100.0% [198] 1696(0.1%) 1696(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:214:6 ------------------------------------------------------------------------------------------- extract-alt [46] 20.3% best-alt [183] 79.7% [199] 1586(0.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [211] 100.0% ------------------------------------------------------------------------------------------- taylor-quotient [186] 100.0% [200] 1036(0.1%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [207] 100.0% ------------------------------------------------------------------------------------------- pick-errors [187] 100.0% [201] 972(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [213] 100.0% ------------------------------------------------------------------------------------------- ??? [181] 100.0% [202] 750(0.0%) 750(0.0%) integer->bigfloat ...ivate/bigfloat/mpfr.rkt:399:0 ------------------------------------------------------------------------------------------- make-sequence [182] 100.0% [203] 654(0.0%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [212] 100.0% ------------------------------------------------------------------------------------------- err-lsts->split-indices [189] 100.0% [204] 628(0.0%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [215] 100.0% ------------------------------------------------------------------------------------------- append-map [185] 100.0% [205] 346(0.0%) 346(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 ------------------------------------------------------------------------------------------- sindices->spoints [191] 100.0% [206] 306(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:137:2 ??? [214] 100.0% ------------------------------------------------------------------------------------------- for-loop [49] 0.1% ??? [45] 0.2% ??? [14] 0.2% for-loop [32] 0.3% first-nonzero-exp [200] 0.6% simplify* [64] 0.7% localize-error [63] 0.9% update-leader! [81] 1.4% ??? [9] 1.6% ??? [172] 1.6% for-loop [28] 1.7% loop [27] 1.7% ??? [165] 2.0% for-loop [29] 2.1% eval-prog [148] 11.0% compile [83] 14.9% ??? [5] 21.2% loop [158] 37.7% [207] 97736(5.0%) 33138(1.7%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [5] 61.1% bigfloat-hash [217] 10.4% parse-loop12 [219] 2.5% ??? [12] 2.1% simplify [43] 2.0% ??? [11] 2.0% ??? [10] 1.7% ??? [9] 1.7% ??? [14] 0.5% f137 [153] 0.3% ??? [16] 0.1% ??? [18] 0.1% ------------------------------------------------------------------------------------------- ??? [192] 100.0% [208] 40064(2.1%) 28320(1.5%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [218] 29.3% ------------------------------------------------------------------------------------------- for-loop [193] 100.0% [209] 19850(1.0%) 19850(1.0%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------------------- ??? [194] 100.0% [210] 10990(0.6%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [220] 84.9% loop [229] 11.8% jloop [13] 3.3% ------------------------------------------------------------------------------------------- f137 [153] 6.7% argmins [199] 30.6% loop [197] 62.7% [211] 5182(0.3%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [146] 93.3% f137 [153] 6.7% ------------------------------------------------------------------------------------------- ??? [99] 7.8% ??? [203] 15.1% match-e [54] 77.1% [212] 4340(0.2%) 4340(0.2%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------------------- option-on-expr [166] 12.0% for-loop [201] 37.0% loop [158] 51.0% [213] 2626(0.1%) 356(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [152] 86.4% ------------------------------------------------------------------------------------------- for-loop [206] 31.9% eval-prog [148] 33.3% loop [230] 34.8% [214] 960(0.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:346:33 pattern-substitute [221] 34.8% ??? [258] 33.3% ??? [216] 31.9% ------------------------------------------------------------------------------------------- add-splitpoint [204] 100.0% [215] 628(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [222] 100.0% ------------------------------------------------------------------------------------------- loop [230] 0.0% ??? [214] 0.0% f137 [153] 0.1% simplify-alt [44] 0.1% ??? [165] 0.9% get-sigs [115] 2.7% for-loop [68] 4.0% ??? [216] 4.4% for-loop [223] 42.0% ??? [79] 45.7% [216] 1663550(85.9%) 89764(4.6%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [223] 42.1% iterate-egraph!13 [3] 37.2% loop [4] 8.3% ??? [224] 4.8% ??? [216] 4.4% mk-egraph [228] 0.4% ??? [226] 0.2% ??? [165] 0.1% return/no-unsupplied [227] 0.1% loop [230] 0.1% ??? [238] 0.1% dict? [264] 0.0% f137 [153] 0.0% ??? [233] 0.0% ------------------------------------------------------------------------------------------- hash-ref! [207] 100.0% [217] 46690(2.4%) 322(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [225] 92.8% sig+exp->bigfloat [232] 6.5% ------------------------------------------------------------------------------------------- real->bigfloat [196] 8.0% bfmul [208] 92.0% [218] 12760(0.7%) 12760(0.7%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------------------- loop [158] 0.8% f137 [153] 2.9% map [161] 3.2% parse-loop12 [219] 8.3% simplify [43] 13.0% ??? [159] 14.2% append-map [185] 15.5% type-of-enode-expr [105] 19.4% hash-ref! [207] 22.7% [219] 10710(0.6%) 5292(0.3%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [158] 15.0% parse-loop12 [219] 8.3% make-multiplication-node [242] 7.7% map [161] 7.3% f137 [153] 6.3% loop [234] 4.1% for-loop [235] 3.9% append-map [185] 0.8% ??? [236] 0.8% ------------------------------------------------------------------------------------------- generic-sort/key [210] 43.5% copying-mergesort [220] 56.5% [220] 9336(0.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [220] 56.5% loop [229] 33.1% jloop [13] 10.5% ------------------------------------------------------------------------------------------- ??? [214] 10.0% for-loop [129] 24.9% pattern-substitute [221] 65.0% [221] 666(0.0%) 0(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [221] 65.0% variable? [6] 24.9% ??? [123] 10.0% ------------------------------------------------------------------------------------------- for-loop [215] 100.0% [222] 628(0.0%) 308(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [231] 51.0% ------------------------------------------------------------------------------------------- ??? [216] 100.0% [223] 1497628(77.3%) 314(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [216] 100.0% ------------------------------------------------------------------------------------------- hash-has-key? [132] 22.4% ??? [216] 77.6% [224] 295086(15.2%) 115184(5.9%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [237] 43.9% ??? [248] 14.6% ??? [238] 1.3% arrow-higher-order:lnp [252] 0.7% successfully-got-the-right-kind-of-function [243] 0.4% ------------------------------------------------------------------------------------------- bigfloat-hash [217] 100.0% [225] 43318(2.2%) 42980(2.2%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 bigfloat->sig+exp [245] 0.8% ------------------------------------------------------------------------------------------- flag-set? [139] 1.0% ulp-difference [156] 2.2% ??? [167] 14.4% ??? [216] 41.1% ??? [137] 41.3% [226] 30374(1.6%) 8608(0.4%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [239] 58.7% ??? [256] 12.9% ------------------------------------------------------------------------------------------- flag-set? [139] 2.2% ulp-difference [156] 10.7% ??? [167] 17.3% ??? [137] 30.6% ??? [216] 39.1% [227] 15128(0.8%) 11454(0.6%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [241] 24.3% ------------------------------------------------------------------------------------------- ??? [216] 100.0% [228] 12828(0.7%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [240] 97.4% mk-enode! [80] 2.6% ------------------------------------------------------------------------------------------- generic-sort/key [210] 15.4% ??? [194] 20.0% copying-mergesort [220] 64.6% [229] 8398(0.4%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [152] 100.0% ------------------------------------------------------------------------------------------- loop [230] 24.4% ??? [216] 75.6% [230] 5992(0.3%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 ??? [165] 67.6% loop [230] 24.4% ??? [216] 5.2% ??? [214] 2.8% ------------------------------------------------------------------------------------------- for-loop [222] 7.2% loop [158] 29.7% for-loop [7] 31.5% for-loop [71] 31.6% [231] 4454(0.2%) 4454(0.2%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------------------- bigfloat-hash [217] 100.0% [232] 3050(0.2%) 2726(0.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 integer->mpz [246] 10.6% ------------------------------------------------------------------------------------------- ??? [216] 21.7% hash-has-key? [132] 78.3% [233] 2958(0.2%) 2958(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------------------- loop [234] 50.0% parse-loop12 [219] 50.0% [234] 702(0.0%) 346(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [234] 50.0% ??? [165] 0.8% ------------------------------------------------------------------------------------------- parse-loop12 [219] 100.0% [235] 682(0.0%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:99:13 make-multiplication-node [242] 100.0% ------------------------------------------------------------------------------------------- map [161] 47.8% parse-loop12 [219] 52.2% [236] 636(0.0%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 for-loop [244] 100.0% ------------------------------------------------------------------------------------------- ??? [224] 100.0% [237] 129620(6.7%) 71398(3.7%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [248] 25.2% for-loop [133] 18.2% ??? [250] 1.0% arrow-higher-order:lnp [252] 0.2% ??? [256] 0.2% ------------------------------------------------------------------------------------------- ??? [216] 2.4% ??? [224] 3.0% ??? [136] 30.5% for-loop [133] 64.1% [238] 126998(6.6%) 24428(1.3%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [247] 59.8% for-loop [249] 10.5% ??? [136] 8.1% ??? [258] 2.3% ------------------------------------------------------------------------------------------- ??? [226] 100.0% [239] 17840(0.9%) 16848(0.9%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [253] 5.6% ------------------------------------------------------------------------------------------- mk-egraph [228] 37.7% mk-enode-rec! [240] 62.3% [240] 12494(0.6%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [240] 62.3% mk-enode! [80] 37.7% ------------------------------------------------------------------------------------------- for-loop [71] 12.3% match-e [54] 13.7% return/no-unsupplied [227] 74.0% [241] 4964(0.3%) 4964(0.3%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------------------- simplify [43] 13.2% map [161] 24.9% for-loop [235] 25.2% parse-loop12 [219] 36.7% [242] 2710(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [251] 100.0% ------------------------------------------------------------------------------------------- maybe-cons-kwd [77] 19.2% ??? [224] 80.8% [243] 1550(0.1%) 1252(0.1%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [255] 19.2% ------------------------------------------------------------------------------------------- ??? [236] 100.0% [244] 636(0.0%) 636(0.0%) for-loop ...e/alt-testing/src/core/reduce.rkt:62:7 ------------------------------------------------------------------------------------------- bfcanonicalize [225] 100.0% [245] 338(0.0%) 0(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:370:0 new-mpz [254] 100.0% ------------------------------------------------------------------------------------------- sig+exp->bigfloat [232] 100.0% [246] 324(0.0%) 324(0.0%) integer->mpz ...math/private/bigfloat/gmp.rkt:87:0 ------------------------------------------------------------------------------------------- ??? [238] 100.0% [247] 75968(3.9%) 5858(0.3%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [256] 85.5% ??? [258] 6.8% ------------------------------------------------------------------------------------------- for-loop [237] 43.1% ??? [224] 56.9% [248] 75848(3.9%) 35810(1.8%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [257] 52.8% ------------------------------------------------------------------------------------------- ??? [238] 100.0% [249] 13362(0.7%) 5386(0.3%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [136] 59.7% ------------------------------------------------------------------------------------------- ??? [124] 15.7% for-loop [237] 20.3% ??? [136] 64.0% [250] 6622(0.3%) 1624(0.1%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [259] 75.5% ------------------------------------------------------------------------------------------- make-multiplication-node [242] 100.0% [251] 2710(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [260] 100.0% ------------------------------------------------------------------------------------------- maybe-cons-kwd [77] 11.7% for-loop [237] 12.1% ??? [224] 76.3% [252] 2670(0.1%) 312(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [261] 88.3% ------------------------------------------------------------------------------------------- ??? [239] 100.0% [253] 992(0.1%) 992(0.1%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------------------- bigfloat->sig+exp [245] 100.0% [254] 338(0.0%) 338(0.0%) new-mpz ...-lib/math/private/bigfloat/gmp.rkt:73:0 ------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [243]100.0% [255] 298(0.0%) 298(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 ------------------------------------------------------------------------------------------- for-loop [237] 0.3% ??? [123] 1.8% ??? [226] 4.3% ??? [165] 8.7% ??? [136] 12.2% ??? [247] 71.8% [256] 90418(4.7%) 70580(3.6%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [262] 10.2% ??? [123] 9.1% dict? [264] 2.6% ------------------------------------------------------------------------------------------- ??? [248] 100.0% [257] 40038(2.1%) 40038(2.1%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------------------- ??? [214] 3.0% for-loop [133] 6.2% ??? [159] 15.5% ??? [238] 27.1% ??? [247] 48.3% [258] 10746(0.6%) 4932(0.3%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [263] 54.1% ------------------------------------------------------------------------------------------- ??? [250] 100.0% [259] 4998(0.3%) 2354(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [266] 52.9% ------------------------------------------------------------------------------------------- make-multiplication-subnode [251] 100.0% [260] 2710(0.1%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:242:3 mterm->expr [265] 100.0% ------------------------------------------------------------------------------------------- arrow-higher-order:lnp [252] 100.0% [261] 2358(0.1%) 2358(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 ------------------------------------------------------------------------------------------- ??? [256] 100.0% [262] 9252(0.5%) 9252(0.5%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------------------- ??? [258] 100.0% [263] 5814(0.3%) 2588(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [267] 55.5% ------------------------------------------------------------------------------------------- ??? [216] 41.8% ??? [256] 58.2% [264] 3982(0.2%) 3982(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------------------- for-loop [260] 100.0% [265] 2710(0.1%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 f137 [153] 100.0% ------------------------------------------------------------------------------------------- check-hash/c [259] 100.0% [266] 2644(0.1%) 2644(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------------------- ??? [263] 100.0% [267] 3226(0.2%) 3226(0.2%) ??? ...ects/racket/contract/private/list.rkt:141:5 -------------------------------------------------------------------------------------------