Profiling results ----------------- Total cpu time observed: 1556136ms (out of 1563560ms) Number of samples taken: 4545 (once every 342ms) (Hiding functions with self<1.0% and local<2.0%: 17 of 278 hidden) =========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================================== ??? [74] 100.0% [1] 1178956(75.8%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [16] 100.0% ------------------------------------------------------------------------------------------- ??? [74] 100.0% [2] 1025630(65.9%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [17] 92.5% get-final-combination [20] 5.8% loop [90] 1.1% prepare-points [93] 0.4% setup-alt-simplified [25] 0.2% ??? [76] 0.0% ------------------------------------------------------------------------------------------- ??? [133] 100.0% [3] 842792(54.2%) 312(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [18] 97.3% map-enodes [21] 2.7% ------------------------------------------------------------------------------------------- ??? [133] 100.0% [4] 235512(15.1%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [19] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [197] 100.0% [5] 63292(4.1%) 1360(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [134] 72.7% hash-ref! [197] 26.7% ------------------------------------------------------------------------------------------- loop [134] 100.0% [6] 21538(1.4%) 4048(0.3%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 eval-const-expr [23] 39.3% setfindf [24] 34.3% curried [232] 3.2% compose [29] 3.0% composed [156] 1.4% ------------------------------------------------------------------------------------------- rewriter [95] 100.0% [7] 19738(1.3%) 608(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [22] 96.9% ------------------------------------------------------------------------------------------- pattern-substitute [162] 2.1% substitute-e [66] 10.0% match-e [51] 87.9% [8] 17302(1.1%) 336(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [76] 98.1% ------------------------------------------------------------------------------------------- copying-mergesort [215] 100.0% [9] 9404(0.6%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [196] 89.3% errors-score [28] 7.2% ??? [109] 3.6% ------------------------------------------------------------------------------------------- hash-ref! [197] 100.0% [10] 1634(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [26] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [197] 100.0% [11] 996(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [27] 100.0% ------------------------------------------------------------------------------------------- loop [242] 100.0% [12] 736(0.0%) 0(0.0%) ??? ...bie/alt-testing/src/core/localize.rkt:43:32 ulp-difference [208] 50.5% ??? [109] 49.5% ------------------------------------------------------------------------------------------- map [85] 100.0% [13] 350(0.0%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [30] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [197] 100.0% [14] 340(0.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [31] 100.0% ------------------------------------------------------------------------------------------- f137 [68] 100.0% [15] 334(0.0%) 0(0.0%) exprs-to-branch-on ...ng/src/core/regimes.rkt:42:0 for-loop [32] 100.0% ------------------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [16] 1178956(75.8%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [74] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [17] 949006(61.0%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [33] 100.0% ------------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [18] 819930(52.7%) 11376(0.7%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [34] 79.2% for-loop [36] 19.2% ------------------------------------------------------------------------------------------- loop [4] 100.0% [19] 235512(15.1%) 338(0.0%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [35] 99.4% loop [44] 0.3% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [20] 59688(3.8%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [37] 97.6% extract-alt [43] 2.4% ------------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [21] 22550(1.4%) 0(0.0%) map-enodes ...lt-testing/src/core/egraph.rkt:140:0 loop [134] 100.0% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [65] 6.8% *rules* [7] 93.2% [22] 20530(1.3%) 7660(0.5%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 loop [38] 27.9% flag-set? [56] 16.6% ormap [40] 16.4% curry* [88] 1.8% ------------------------------------------------------------------------------------------- for-loop [6] 100.0% [23] 8466(0.5%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f137 [68] 67.9% ??? [41] 28.0% ??? [45] 4.0% ------------------------------------------------------------------------------------------- for-loop [6] 100.0% [24] 7378(0.5%) 3596(0.2%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 for-loop [39] 51.3% ------------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [25] 1676(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [42] 100.0% ------------------------------------------------------------------------------------------- ??? [10] 100.0% [26] 1634(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 hash-ref! [197] 78.6% simplify [128] 21.4% ------------------------------------------------------------------------------------------- ??? [11] 100.0% [27] 996(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [197] 100.0% ------------------------------------------------------------------------------------------- jloop [9] 100.0% [28] 676(0.0%) 0(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 loop [134] 52.1% loop [44] 47.9% ------------------------------------------------------------------------------------------- for-loop [6] 100.0% [29] 654(0.0%) 654(0.0%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------------------------- taylor-quotient [13] 100.0% [30] 350(0.0%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [197] 100.0% ------------------------------------------------------------------------------------------- ??? [14] 100.0% [31] 340(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [46] 100.0% ------------------------------------------------------------------------------------------- exprs-to-branch-on [15] 100.0% [32] 334(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:44:27 all-critical-subexpressions [47] 100.0% ------------------------------------------------------------------------------------------- for-loop [17] 100.0% [33] 949006(61.0%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [48] 85.4% finalize-iter! [52] 9.3% gen-rewrites! [54] 2.7% choose-best-alt! [55] 1.8% localize-error [58] 0.5% gen-series! [61] 0.2% ------------------------------------------------------------------------------------------- one-iter [18] 100.0% [34] 649612(41.7%) 2626(0.2%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [49] 88.9% match-e [51] 8.1% update-leader! [77] 2.1% reduce-to-single! [59] 0.5% ------------------------------------------------------------------------------------------- pass [19] 100.0% [35] 234126(15.0%) 2704(0.2%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [50] 75.6% loop [53] 18.2% for-loop [57] 4.4% make-sequence [157] 0.7% ------------------------------------------------------------------------------------------- for-loop [36] 49.4% one-iter [18] 50.6% [36] 157258(10.1%) 41338(2.7%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [36] 49.4% match-e [51] 36.5% ??? [97] 0.4% ------------------------------------------------------------------------------------------- get-final-combination [20] 100.0% [37] 58248(3.7%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f137 [68] 100.0% ------------------------------------------------------------------------------------------- for-loop [22] 100.0% [38] 5736(0.4%) 650(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [56] 82.9% curried [232] 5.8% ------------------------------------------------------------------------------------------- setfindf [24] 100.0% [39] 3782(0.2%) 3782(0.2%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 ------------------------------------------------------------------------------------------- for-loop [22] 100.0% [40] 3358(0.2%) 344(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [56] 79.6% curried [232] 10.1% ------------------------------------------------------------------------------------------- eval-const-expr [23] 100.0% [41] 2374(0.2%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [60] 100.0% ------------------------------------------------------------------------------------------- setup-alt-simplified [25] 100.0% [42] 1676(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [133] 100.0% ------------------------------------------------------------------------------------------- get-final-combination [20] 100.0% [43] 1440(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 loop [139] 100.0% ------------------------------------------------------------------------------------------- errors-score [28] 31.1% pass [19] 68.9% [44] 1042(0.1%) 1042(0.1%) loop ...hare/racket/collects/racket/list.rkt:551:2 ------------------------------------------------------------------------------------------- eval-const-expr [23] 100.0% [45] 342(0.0%) 342(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1635:39 ------------------------------------------------------------------------------------------- for-loop [31] 100.0% [46] 340(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [197] 100.0% ------------------------------------------------------------------------------------------- for-loop [32] 100.0% [47] 334(0.0%) 0(0.0%) all-critical-subexpressions ...re/regimes.rkt:58:0 for-loop [62] 100.0% ------------------------------------------------------------------------------------------- run-iter! [33] 100.0% [48] 810834(52.1%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [63] 100.0% ------------------------------------------------------------------------------------------- for-loop [34] 100.0% [49] 577800(37.1%) 1380(0.1%) for-loop ...t-testing/src/core/simplify.rkt:148:10 mk-enode! [75] 32.7% merge-egraph-nodes! [65] 27.2% substitute-e [66] 24.9% loop! [148] 10.9% list-member? [154] 4.1% ------------------------------------------------------------------------------------------- for-loop [35] 100.0% [50] 176958(11.4%) 718(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [64] 88.5% expression-cost [70] 11.1% ------------------------------------------------------------------------------------------- for-loop [34] 19.6% for-loop [78] 23.6% for-loop [36] 56.7% [51] 167146(10.7%) 60746(3.9%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [67] 44.4% for-loop [78] 11.1% ??? [76] 5.6% variable? [8] 3.6% list-cartesian-product [83] 2.3% custom-in-set [189] 1.3% loop [134] 0.5% curry* [88] 0.2% filter [248] 0.1% ------------------------------------------------------------------------------------------- run-iter! [33] 100.0% [52] 88370(5.7%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [76] 100.0% ------------------------------------------------------------------------------------------- for-loop [35] 100.0% [53] 42528(2.7%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [64] 90.6% expression-cost [70] 9.4% ------------------------------------------------------------------------------------------- run-iter! [33] 100.0% [54] 25158(1.6%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 for-loop [69] 100.0% ------------------------------------------------------------------------------------------- run-iter! [33] 100.0% [55] 17476(1.1%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [76] 100.0% ------------------------------------------------------------------------------------------- ormap [40] 24.7% for-loop [22] 31.5% loop [38] 43.8% [56] 10844(0.7%) 4348(0.3%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [239] 40.8% ??? [238] 19.1% ------------------------------------------------------------------------------------------- for-loop [35] 100.0% [57] 10278(0.7%) 10278(0.7%) for-loop ...t-testing/src/core/simplify.rkt:217:13 ------------------------------------------------------------------------------------------- run-iter! [33] 100.0% [58] 4862(0.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [197] 86.1% ??? [186] 13.9% ------------------------------------------------------------------------------------------- for-loop [34] 100.0% [59] 3038(0.2%) 1044(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [73] 55.0% make-sequence [157] 10.7% ------------------------------------------------------------------------------------------- ??? [41] 100.0% [60] 2374(0.2%) 0(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 maybe-cons-kwd [71] 100.0% ------------------------------------------------------------------------------------------- run-iter! [33] 100.0% [61] 2306(0.1%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [72] 100.0% ------------------------------------------------------------------------------------------- all-critical-subexpressions [47] 100.0% [62] 334(0.0%) 0(0.0%) for-loop .../alt-testing/src/core/regimes.rkt:62:2 f137 [68] 100.0% ------------------------------------------------------------------------------------------- simplify! [48] 99.2% [63] 817650(52.5%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [74] 100.0% debug-print [143] 0.0% ------------------------------------------------------------------------------------------- loop [53] 19.7% argmin [50] 80.3% [64] 195186(12.5%) 4894(0.3%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [133] 70.2% ...sting/src/common.rkt:47:2 [136] 25.3% ??? [135] 2.0% ------------------------------------------------------------------------------------------- for-loop [82] 3.8% merge-egraph-nodes! [65] 4.1% for-loop [49] 92.1% [65] 157224(10.1%) 5726(0.4%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [77] 58.7% for-loop [81] 12.6% loop! [148] 7.7% for-loop [82] 7.1% enode-merge! [84] 5.0% merge-egraph-nodes! [65] 4.1% for-loop [22] 0.9% make-sequence [157] 0.6% ------------------------------------------------------------------------------------------- substitute-e [66] 4.0% for-loop [49] 96.0% [66] 143612(9.2%) 3934(0.3%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [75] 91.8% substitute-e [66] 4.0% ??? [76] 1.7% variable? [8] 0.5% ------------------------------------------------------------------------------------------- match-e [51] 100.0% [67] 95028(6.1%) 33326(2.1%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [78] 52.4% list-cartesian-product [83] 10.3% loop [134] 4.1% curried [232] 1.2% curry* [88] 1.0% foldl [159] 0.7% ------------------------------------------------------------------------------------------- for-loop [62] 0.1% approximate9 [129] 0.2% map [85] 0.4% rewriter [95] 0.7% hash-ref! [197] 0.8% parse-loop12 [229] 1.1% eval-prog [183] 5.9% eval-const-expr [23] 6.5% f137 [68] 22.5% split-table [37] 61.6% [68] 88974(5.7%) 1322(0.1%) f137 .../collects/racket/match/compiler.rkt:507:40 loop [134] 48.7% f137 [68] 22.5% option-on-expr [150] 12.8% ??? [109] 5.8% ??? [87] 2.3% map [85] 1.8% ...sting/src/common.rkt:47:2 [136] 1.5% ??? [135] 1.5% ??? [133] 1.5% ??? [76] 0.4% exprs-to-branch-on [15] 0.1% ------------------------------------------------------------------------------------------- gen-rewrites! [54] 100.0% [69] 25158(1.6%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:138:11 ??? [79] 100.0% ------------------------------------------------------------------------------------------- loop [53] 16.9% argmin [50] 83.1% [70] 23582(1.5%) 344(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [80] 98.5% ------------------------------------------------------------------------------------------- unpack245 [60] 100.0% [71] 2374(0.2%) 0(0.0%) maybe-cons-kwd ...ate/arrow-higher-order.rkt:498:0 successfully-got-the-right-kind-of-function [175] 73.1% arrow-higher-order:lnp [194] 26.9% ------------------------------------------------------------------------------------------- gen-series! [61] 100.0% [72] 2306(0.1%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [86] 100.0% ------------------------------------------------------------------------------------------- reduce-to-single! [59] 100.0% [73] 1670(0.1%) 1670(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 ------------------------------------------------------------------------------------------- for-loop [63] 19.0% run [16] 31.1% [74] 1460726(93.9%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [133] 37.0% profile-thunk16 [1] 31.1% run-improve50 [2] 26.2% loop [90] 3.2% prepare-points [93] 2.4% ------------------------------------------------------------------------------------------- mk-egraph [155] 0.2% mk-enode-rec! [172] 2.4% substitute-e [66] 40.0% for-loop [49] 57.4% [75] 329328(21.2%) 21400(1.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [89] 92.3% hash-has-key? [94] 0.9% mutable-set [113] 0.3% ------------------------------------------------------------------------------------------- f137 [68] 0.2% expression->type [115] 0.2% debug7 [144] 0.2% run-improve50 [2] 0.2% for-loop [112] 0.3% substitute-e [66] 3.1% ??? [254] 4.0% choose-best-alt! [55] 8.5% variable? [8] 8.7% match-e [51] 9.4% get-sigs [120] 21.4% finalize-iter! [52] 44.0% [76] 196088(12.6%) 32786(2.1%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [92] 43.1% hash-has-key? [94] 30.3% atab-pick-alt8 [96] 8.5% atab-add-altns [104] 1.0% ??? [254] 0.3% ------------------------------------------------------------------------------------------- for-loop [34] 12.0% merge-egraph-nodes! [65] 88.0% [77] 113434(7.3%) 7908(0.5%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [91] 86.9% custom-set-union! [101] 2.2% update-en-expr [168] 1.5% make-sequence [157] 0.9% mutable-set [113] 0.9% hash-ref! [197] 0.6% ------------------------------------------------------------------------------------------- match-e [51] 35.9% for-loop [67] 64.1% [78] 81980(5.3%) 7814(0.5%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [51] 87.0% ??? [97] 4.5% ------------------------------------------------------------------------------------------- for-loop [69] 100.0% [79] 25158(1.6%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [95] 100.0% ------------------------------------------------------------------------------------------- expression-cost [70] 100.0% [80] 23238(1.5%) 348(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [197] 98.5% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [65] 100.0% [81] 20102(1.3%) 15628(1.0%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [168] 22.3% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [65] 100.0% [82] 17922(1.2%) 318(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [65] 70.2% loop! [148] 28.0% ------------------------------------------------------------------------------------------- list-cartesian-product [83] 19.2% match-e [51] 22.1% for-loop [67] 58.7% [83] 15392(1.0%) 12400(0.8%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [83] 19.2% for-loop [100] 14.3% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [65] 100.0% [84] 8228(0.5%) 1346(0.1%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [98] 55.7% custom-set-intersect! [103] 28.0% ------------------------------------------------------------------------------------------- ??? [99] 24.5% parse-loop12 [229] 26.0% f137 [68] 49.5% [85] 3464(0.2%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 ??? [99] 30.4% ??? [109] 24.5% loop [242] 14.1% f137 [68] 13.1% parse-loop12 [229] 9.8% loop [134] 4.8% taylor-quotient [13] 3.4% ------------------------------------------------------------------------------------------- for-loop [72] 100.0% [86] 2306(0.1%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [102] 100.0% ------------------------------------------------------------------------------------------- f137 [68] 100.0% [87] 2060(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:336:46 ??? [254] 100.0% ------------------------------------------------------------------------------------------- for-loop [22] 21.1% match-e [51] 21.2% for-loop [67] 57.8% [88] 1710(0.1%) 716(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [220] 58.1% ------------------------------------------------------------------------------------------- mk-enode! [75] 100.0% [89] 303890(19.5%) 1320(0.1%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [105] 98.6% set [170] 0.9% mutable-set [113] 0.1% ------------------------------------------------------------------------------------------- run-improve50 [2] 10.7% ??? [74] 89.3% [90] 104552(6.7%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 loop [108] 43.1% make-exacts* [121] 33.8% loop [124] 22.8% for-loop [119] 0.3% ------------------------------------------------------------------------------------------- update-leader! [77] 100.0% [91] 98622(6.3%) 3404(0.2%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [106] 96.5% ------------------------------------------------------------------------------------------- ??? [76] 100.0% [92] 86734(5.6%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:52:2 atab-add-altn [107] 100.0% ------------------------------------------------------------------------------------------- run-improve50 [2] 5.0% ??? [74] 95.0% [93] 74674(4.8%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [108] 40.4% make-exacts* [121] 30.4% loop [124] 29.2% ------------------------------------------------------------------------------------------- mk-enode! [75] 4.6% ??? [76] 95.4% [94] 65442(4.2%) 17392(1.1%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [146] 70.0% ??? [158] 3.5% ------------------------------------------------------------------------------------------- ??? [79] 20.9% matcher [125] 79.1% [95] 25158(1.6%) 2776(0.2%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [110] 80.4% *rules* [7] 15.5% f137 [68] 1.1% expression->type [115] 0.5% ------------------------------------------------------------------------------------------- ??? [76] 100.0% [96] 17476(1.1%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:61:0 point-best-alt [111] 66.5% ??? [109] 29.8% for-loop [116] 3.7% ------------------------------------------------------------------------------------------- for-loop [36] 24.1% for-loop [78] 75.9% [97] 5294(0.3%) 2022(0.1%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [112] 61.8% ------------------------------------------------------------------------------------------- enode-merge! [84] 100.0% [98] 4582(0.3%) 686(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [167] 85.0% ------------------------------------------------------------------------------------------- map [85] 16.5% loop [134] 83.5% [99] 4518(0.3%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [197] 89.3% taylor-invert [118] 7.3% map [85] 3.4% ------------------------------------------------------------------------------------------- list-cartesian-product [83] 100.0% [100] 2992(0.2%) 2992(0.2%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------------------- update-leader! [77] 100.0% [101] 2482(0.2%) 1054(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [114] 57.5% ------------------------------------------------------------------------------------------- taylor-alt [86] 100.0% [102] 2306(0.1%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [109] 100.0% ------------------------------------------------------------------------------------------- enode-merge! [84] 100.0% [103] 2300(0.1%) 1960(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 for-loop [117] 14.8% ------------------------------------------------------------------------------------------- ??? [76] 100.0% [104] 2004(0.1%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:51:0 atab-add-altn [107] 100.0% ------------------------------------------------------------------------------------------- new-enode [89] 100.0% [105] 299540(19.2%) 5440(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [120] 98.2% ------------------------------------------------------------------------------------------- for-loop [91] 100.0% [106] 95218(6.1%) 2016(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [122] 97.9% ------------------------------------------------------------------------------------------- atab-add-altns [104] 2.3% for-loop [92] 97.7% [107] 88738(5.7%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:243:0 best-and-tied-at-points [123] 94.6% override-at-pnts [127] 5.4% ------------------------------------------------------------------------------------------- prepare-points [93] 40.1% loop [90] 59.9% [108] 75260(4.8%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [121] 70.4% loop [124] 29.6% ------------------------------------------------------------------------------------------- eval-prog [183] 0.8% ??? [132] 0.8% jloop [9] 0.8% ??? [12] 0.9% loop [140] 1.3% ??? [133] 1.3% loop [242] 1.6% for-loop [102] 2.1% map [85] 2.4% for-loop [182] 4.6% loop [134] 6.0% ??? [196] 7.1% atab-pick-alt8 [96] 11.5% f137 [68] 58.1% [109] 42362(2.7%) 1636(0.1%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [133] 45.8% ??? [254] 19.9% best-alt [126] 11.5% ...sting/src/common.rkt:47:2 [136] 7.1% ??? [135] 6.7% approximate9 [129] 2.1% hash-ref! [197] 1.3% ??? [217] 1.0% ------------------------------------------------------------------------------------------- rewriter [95] 100.0% [110] 25158(1.6%) 328(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [125] 99.7% ------------------------------------------------------------------------------------------- atab-pick-alt8 [96] 100.0% [111] 11614(0.7%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:55:0 loop [134] 100.0% ------------------------------------------------------------------------------------------- ??? [97] 100.0% [112] 3272(0.2%) 2628(0.2%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ??? [76] 19.7% ------------------------------------------------------------------------------------------- new-enode [89] 15.4% update-leader! [77] 41.5% mk-enode! [75] 43.1% [113] 2398(0.2%) 2074(0.1%) mutable-set .../racket/private/set-types.rkt:999:0 for-loop [131] 13.5% ------------------------------------------------------------------------------------------- custom-set-union! [101] 100.0% [114] 1428(0.1%) 1428(0.1%) for-loop ...cts/racket/private/set-types.rkt:253:4 ------------------------------------------------------------------------------------------- for-loop [130] 38.3% rewriter [95] 61.7% [115] 650(0.0%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [130] 87.2% ??? [76] 12.8% ------------------------------------------------------------------------------------------- atab-pick-alt8 [96] 100.0% [116] 648(0.0%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:88:2 debug7 [144] 50.3% debug-print [143] 49.7% ------------------------------------------------------------------------------------------- custom-set-intersect! [103] 100.0% [117] 340(0.0%) 340(0.0%) for-loop ...cts/racket/private/set-types.rkt:272:4 ------------------------------------------------------------------------------------------- ??? [99] 100.0% [118] 332(0.0%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [128] 100.0% ------------------------------------------------------------------------------------------- loop [90] 100.0% [119] 322(0.0%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [132] 100.0% ------------------------------------------------------------------------------------------- type-of-enode-expr [105] 100.0% [120] 294100(18.9%) 4712(0.3%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [135] 39.4% ??? [133] 31.3% ??? [76] 14.3% ...sting/src/common.rkt:47:2 [136] 13.5% ------------------------------------------------------------------------------------------- prepare-points [93] 20.4% loop [90] 31.9% loop [108] 47.7% [121] 111022(7.1%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [134] 52.0% eval-prog [183] 48.0% ------------------------------------------------------------------------------------------- for-loop [106] 100.0% [122] 93202(6.0%) 322(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [137] 99.7% ------------------------------------------------------------------------------------------- atab-add-altn [107] 100.0% [123] 83960(5.4%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:157:0 errors [164] 100.0% ------------------------------------------------------------------------------------------- prepare-points [93] 32.1% loop [108] 32.9% loop [90] 35.0% [124] 67882(4.4%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [134] 99.5% ??? [196] 0.5% ------------------------------------------------------------------------------------------- matcher [125] 24.1% for-loop [138] 25.9% for-loop [110] 50.0% [125] 25158(1.6%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [95] 49.5% for-loop [138] 25.9% matcher [125] 24.1% for-loop [141] 0.5% ------------------------------------------------------------------------------------------- ??? [109] 100.0% [126] 5214(0.3%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 loop [139] 80.4% argmins [142] 19.6% ------------------------------------------------------------------------------------------- atab-add-altn [107] 100.0% [127] 4778(0.3%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:180:0 errors [164] 100.0% ------------------------------------------------------------------------------------------- taylor-invert [118] 14.4% for-loop [26] 15.2% hash-ref! [197] 70.4% [128] 2306(0.1%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 parse-loop12 [229] 70.7% debug7 [144] 15.2% debug-print [143] 14.1% ------------------------------------------------------------------------------------------- ??? [109] 100.0% [129] 2306(0.1%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [140] 70.4% f137 [68] 29.6% ------------------------------------------------------------------------------------------- expression->type [115] 100.0% [130] 650(0.0%) 318(0.0%) for-loop ...ie/alt-testing/src/type-check.rkt:52:5 expression->type [115] 51.1% ------------------------------------------------------------------------------------------- mutable-set [113] 100.0% [131] 324(0.0%) 324(0.0%) for-loop ...cts/racket/private/set-types.rkt:943:2 ------------------------------------------------------------------------------------------- for-loop [119] 100.0% [132] 322(0.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [109] 100.0% ------------------------------------------------------------------------------------------- f137 [68] 0.1% simplify-alt [42] 0.1% ??? [109] 1.7% get-sigs [120] 2.8% for-loop [64] 4.1% ??? [133] 4.9% for-loop [145] 40.8% ??? [74] 45.3% [133] 1108906(71.3%) 61772(4.0%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [145] 40.8% iterate-egraph!13 [3] 36.6% loop [4] 8.6% ??? [146] 5.2% ??? [133] 4.9% return/no-unsupplied [239] 0.4% mk-egraph [155] 0.4% ??? [238] 0.2% ??? [236] 0.2% ...sting/src/common.rkt:47:2 [136] 0.1% dict? [258] 0.1% ??? [109] 0.0% list-member? [154] 0.0% ??? [135] 0.0% loop [163] 0.0% ??? [158] 0.0% ------------------------------------------------------------------------------------------- map [85] 0.0% errors-score [28] 0.0% match-e [51] 0.3% make-exacts* [121] 0.4% loop [124] 0.6% parse-loop12 [229] 0.7% map-enodes [21] 0.9% for-loop [67] 1.2% point-best-alt [111] 2.1% option-on-expr [150] 2.8% loop! [148] 4.1% f137 [68] 11.1% ??? [5] 14.5% loop [134] 61.2% [134] 318410(20.5%) 7430(0.5%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [134] 61.2% hash-ref! [197] 14.5% option-on-expr [150] 11.1% errors [164] 4.8% loop! [148] 4.0% ??? [196] 1.1% for-loop [6] 0.9% ??? [99] 0.7% foldl [159] 0.4% curried [232] 0.2% ??? [203] 0.1% ??? [237] 0.0% ??? [109] 0.0% ------------------------------------------------------------------------------------------- ??? [133] 0.3% f137 [68] 1.1% ??? [109] 2.3% for-loop [64] 3.2% get-sigs [120] 93.1% [135] 124276(8.0%) 8778(0.6%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [151] 46.6% for-loop [149] 37.3% get/build-late-neg-projection [214] 4.9% ??? [188] 1.6% ??? [160] 0.8% ??? [184] 0.6% ------------------------------------------------------------------------------------------- ??? [133] 0.7% f137 [68] 1.4% ??? [109] 3.2% get-sigs [120] 42.0% for-loop [64] 52.3% [136] 94218(6.1%) 22868(1.5%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [152] 40.8% ??? [153] 33.8% ------------------------------------------------------------------------------------------- hash-update! [122] 100.0% [137] 92880(6.0%) 1332(0.1%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [147] 98.2% make-sequence [157] 0.4% ------------------------------------------------------------------------------------------- matcher [125] 100.0% [138] 23186(1.5%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [125] 100.0% ------------------------------------------------------------------------------------------- extract-alt [43] 25.6% best-alt [126] 74.4% [139] 5634(0.4%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [156] 100.0% ------------------------------------------------------------------------------------------- approximate9 [129] 100.0% [140] 1624(0.1%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 ??? [109] 100.0% ------------------------------------------------------------------------------------------- matcher [125] 100.0% [141] 1030(0.1%) 672(0.0%) for-loop ...alt-testing/src/core/matcher.rkt:159:6 pattern-substitute [162] 34.8% ------------------------------------------------------------------------------------------- best-alt [126] 100.0% [142] 1020(0.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [156] 100.0% ------------------------------------------------------------------------------------------- for-loop [116] 31.9% simplify [128] 32.3% for-loop [63] 35.7% [143] 1008(0.1%) 322(0.0%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 for-loop [161] 68.1% ------------------------------------------------------------------------------------------- for-loop [116] 48.2% simplify [128] 51.8% [144] 676(0.0%) 326(0.0%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 ??? [76] 51.8% ------------------------------------------------------------------------------------------- ??? [133] 100.0% [145] 967904(62.2%) 322(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [133] 100.0% ------------------------------------------------------------------------------------------- hash-has-key? [94] 21.9% ??? [133] 78.1% [146] 209300(13.4%) 91986(5.9%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [165] 41.6% ??? [184] 12.4% ??? [236] 1.7% arrow-higher-order:lnp [194] 0.2% successfully-got-the-right-kind-of-function [175] 0.2% ------------------------------------------------------------------------------------------- ??? [137] 100.0% [147] 91202(5.9%) 74902(4.8%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [168] 17.9% ------------------------------------------------------------------------------------------- for-loop [82] 4.2% merge-egraph-nodes! [65] 14.7% loop [134] 27.8% for-loop [49] 53.3% [148] 83408(5.4%) 15474(1.0%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [167] 39.0% loop [134] 32.0% set [170] 11.4% update-en-expr [168] 6.2% ------------------------------------------------------------------------------------------- for-loop [165] 26.8% ??? [135] 73.2% [149] 63384(4.1%) 13102(0.8%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [236] 78.3% ??? [256] 1.0% ------------------------------------------------------------------------------------------- f137 [68] 20.6% loop [134] 79.4% [150] 57914(3.7%) 326(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [169] 40.9% loop [134] 38.6% errors [164] 9.1% pick-errors [174] 5.2% err-lsts->split-indices [177] 3.4% eval-prog [183] 1.2% point->alt [195] 1.1% ------------------------------------------------------------------------------------------- ??? [135] 100.0% [151] 57872(3.7%) 4364(0.3%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [166] 92.5% ------------------------------------------------------------------------------------------- for-loop [247] 5.8% ??? [236] 15.4% ...sting/src/common.rkt:47:2 [136] 78.8% [152] 38476(2.5%) 6696(0.4%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [236] 71.3% ??? [254] 13.8% ??? [188] 5.0% ------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [136] 100.0% [153] 31860(2.0%) 7616(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [238] 44.2% return/no-unsupplied [239] 25.4% assoc-ref [176] 6.5% ------------------------------------------------------------------------------------------- ??? [133] 1.4% for-loop [49] 98.6% [154] 24188(1.6%) 1420(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [171] 77.3% member [173] 16.8% ------------------------------------------------------------------------------------------- ??? [133] 100.0% [155] 8472(0.5%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [172] 91.8% mk-enode! [75] 8.2% ------------------------------------------------------------------------------------------- for-loop [6] 4.4% argmins [142] 14.7% loop [139] 80.9% [156] 6962(0.4%) 308(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [164] 95.6% ------------------------------------------------------------------------------------------- reduce-to-single! [59] 7.5% ??? [137] 8.0% merge-egraph-nodes! [65] 22.9% update-leader! [77] 23.5% for-loop [35] 38.2% [157] 4344(0.3%) 3316(0.2%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [178] 23.7% ------------------------------------------------------------------------------------------- ??? [133] 29.9% hash-has-key? [94] 70.1% [158] 3232(0.2%) 3232(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------------------- for-loop [67] 31.2% loop [134] 68.8% [159] 2014(0.1%) 1386(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [179] 31.2% ------------------------------------------------------------------------------------------- ??? [135] 100.0% [160] 1016(0.1%) 660(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:69:2 get-blame-party-info [180] 35.0% ------------------------------------------------------------------------------------------- debug-print [143] 100.0% [161] 686(0.0%) 686(0.0%) for-loop ...herbie/alt-testing/src/debug.rkt:113:2 ------------------------------------------------------------------------------------------- pattern-substitute [162] 50.0% for-loop [141] 50.0% [162] 358(0.0%) 0(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [162] 50.0% variable? [8] 50.0% ------------------------------------------------------------------------------------------- ??? [133] 100.0% [163] 322(0.0%) 0(0.0%) loop ...ies/herbie/alt-testing/src/points.rkt:66:6 random-exp [181] 100.0% ------------------------------------------------------------------------------------------- override-at-pnts [127] 3.6% option-on-expr [150] 4.0% composed [156] 5.0% loop [134] 23.8% best-and-tied-at-points [123] 63.6% [164] 132034(8.5%) 334(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [182] 79.6% eval-prog [183] 19.9% ------------------------------------------------------------------------------------------- ??? [146] 100.0% [165] 87170(5.6%) 41944(2.7%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [184] 30.6% for-loop [149] 19.5% ??? [254] 0.7% ??? [188] 0.7% arrow-higher-order:lnp [194] 0.3% ------------------------------------------------------------------------------------------- ??? [151] 100.0% [166] 53508(3.4%) 4132(0.3%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [185] 92.3% ------------------------------------------------------------------------------------------- adopt-enode! [98] 10.0% loop! [148] 90.0% [167] 38964(2.5%) 12940(0.8%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [187] 59.2% for-loop [190] 7.6% ------------------------------------------------------------------------------------------- update-leader! [77] 5.3% for-loop [81] 13.6% loop! [148] 31.8% for-loop [147] 49.4% [168] 33018(2.1%) 33018(2.1%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------------------------- option-on-expr [150] 100.0% [169] 23682(1.5%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [186] 100.0% ------------------------------------------------------------------------------------------- new-enode [89] 12.5% loop! [148] 87.5% [170] 21336(1.4%) 21336(1.4%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------------------- list-member? [154] 100.0% [171] 18694(1.2%) 18694(1.2%) loop (unknown source) ------------------------------------------------------------------------------------------- mk-egraph [155] 40.1% mk-enode-rec! [172] 59.9% [172] 7778(0.5%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [172] 59.9% mk-enode! [75] 40.1% ------------------------------------------------------------------------------------------- list-member? [154] 100.0% [173] 4074(0.3%) 4074(0.3%) member (unknown source) ------------------------------------------------------------------------------------------- option-on-expr [150] 100.0% [174] 2988(0.2%) 306(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [191] 78.5% point->alt [195] 11.2% ------------------------------------------------------------------------------------------- ??? [146] 15.9% maybe-cons-kwd [71] 84.1% [175] 2064(0.1%) 654(0.0%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [193] 68.3% ------------------------------------------------------------------------------------------- ??? [153] 100.0% [176] 2056(0.1%) 2056(0.1%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------------------- option-on-expr [150] 100.0% [177] 1956(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [192] 100.0% ------------------------------------------------------------------------------------------- make-sequence [157] 100.0% [178] 1028(0.1%) 346(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [189] 66.3% ------------------------------------------------------------------------------------------- foldl [159] 100.0% [179] 628(0.0%) 628(0.0%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------------------- ??? [160] 100.0% [180] 356(0.0%) 356(0.0%) get-blame-party-info ...ate/arrow-common.rkt:136:0 ------------------------------------------------------------------------------------------- loop [163] 100.0% [181] 322(0.0%) 322(0.0%) random-exp ...bie/alt-testing/src/common.rkt:253:0 ------------------------------------------------------------------------------------------- errors [164] 100.0% [182] 105108(6.8%) 2316(0.1%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [196] 95.3% ??? [109] 1.9% ulp-difference [208] 0.6% ------------------------------------------------------------------------------------------- option-on-expr [150] 0.8% point->alt [195] 1.2% errors [164] 32.3% make-exacts* [121] 65.6% [183] 81216(5.2%) 2336(0.2%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 hash-ref! [197] 61.7% f137 [68] 31.6% ??? [205] 1.8% go [209] 1.2% parse-lambda [210] 0.4% ??? [109] 0.4% ------------------------------------------------------------------------------------------- ??? [135] 1.4% ??? [146] 48.6% for-loop [165] 50.0% [184] 53272(3.4%) 25328(1.6%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [199] 52.5% ------------------------------------------------------------------------------------------- ??? [166] 100.0% [185] 49376(3.2%) 2684(0.2%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [198] 94.6% ------------------------------------------------------------------------------------------- localize-error [58] 2.8% sort-context-on-expr [169] 97.2% [186] 24358(1.6%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [200] 93.0% loop [225] 7.0% ------------------------------------------------------------------------------------------- custom-set-union [167] 100.0% [187] 23074(1.5%) 6064(0.4%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [201] 73.7% ------------------------------------------------------------------------------------------- for-loop [165] 14.1% ??? [152] 42.3% ??? [135] 43.7% [188] 4590(0.3%) 1002(0.1%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [202] 78.2% ------------------------------------------------------------------------------------------- ??? [178] 22.7% match-e [51] 77.3% [189] 3008(0.2%) 3008(0.2%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------------------- custom-set-union [167] 100.0% [190] 2950(0.2%) 2950(0.2%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------------------- pick-errors [174] 100.0% [191] 2346(0.2%) 332(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [203] 85.8% ------------------------------------------------------------------------------------------- err-lsts->split-indices [177] 100.0% [192] 1956(0.1%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [204] 100.0% ------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [175]100.0% [193] 1410(0.1%) 364(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [207] 74.2% ------------------------------------------------------------------------------------------- for-loop [165] 23.4% ??? [146] 26.4% maybe-cons-kwd [71] 50.2% [194] 1272(0.1%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [206] 100.0% ------------------------------------------------------------------------------------------- pick-errors [174] 33.7% option-on-expr [150] 66.3% [195] 998(0.1%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [183] 100.0% ------------------------------------------------------------------------------------------- loop [124] 0.1% ??? [203] 1.3% jloop [9] 3.3% loop [225] 5.8% for-loop [182] 39.8% loop [134] 49.6% [196] 251842(16.2%) 2358(0.2%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [211] 97.3% ??? [109] 1.2% ??? [217] 0.6% ------------------------------------------------------------------------------------------- for-loop [46] 0.1% for-loop [27] 0.4% first-nonzero-exp [30] 0.4% for-loop [26] 0.5% ??? [109] 0.5% update-leader! [77] 0.8% localize-error [58] 1.1% ??? [99] 4.1% compile [80] 13.6% ??? [5] 15.1% eval-prog [183] 16.7% loop [134] 46.1% [197] 79816(5.1%) 24188(1.6%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [5] 61.6% bigfloat-hash [212] 15.1% parse-loop12 [229] 5.0% ??? [10] 1.0% simplify [128] 0.5% ??? [11] 0.4% f137 [68] 0.2% ??? [14] 0.1% ------------------------------------------------------------------------------------------- ??? [185] 100.0% [198] 46692(3.0%) 12448(0.8%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [213] 44.1% get/build-late-neg-projection [214] 29.2% ------------------------------------------------------------------------------------------- ??? [184] 100.0% [199] 27944(1.8%) 27944(1.8%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------------------- ??? [186] 100.0% [200] 22662(1.5%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [215] 79.3% loop [225] 20.7% ------------------------------------------------------------------------------------------- for-loop [187] 100.0% [201] 17010(1.1%) 17010(1.1%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------------------- ??? [188] 100.0% [202] 3588(0.2%) 1996(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [218] 44.4% ------------------------------------------------------------------------------------------- loop [134] 39.8% for-loop [191] 60.2% [203] 3344(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [196] 100.0% ------------------------------------------------------------------------------------------- add-splitpoint [192] 100.0% [204] 1956(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [216] 100.0% ------------------------------------------------------------------------------------------- eval-prog [183] 100.0% [205] 1442(0.1%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [219] 100.0% ------------------------------------------------------------------------------------------- arrow-higher-order:lnp [194] 100.0% [206] 1272(0.1%) 936(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 procedure-arity [220] 26.4% ------------------------------------------------------------------------------------------- arity-checking-wrapper [193] 100.0% [207] 1046(0.1%) 1046(0.1%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ------------------------------------------------------------------------------------------- ??? [12] 35.6% for-loop [182] 64.4% [208] 1044(0.1%) 672(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 ??? [238] 35.6% ------------------------------------------------------------------------------------------- eval-prog [183] 100.0% [209] 1012(0.1%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [221] 100.0% ------------------------------------------------------------------------------------------- eval-prog [183] 100.0% [210] 334(0.0%) 0(0.0%) parse-lambda ...llects/racket/private/kw.rkt:437:2 simple-args? [222] 100.0% ------------------------------------------------------------------------------------------- ??? [196] 100.0% [211] 245040(15.7%) 125584(8.1%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [237] 29.8% ??? [224] 6.7% ??? [227] 5.3% bf* [228] 4.2% parse-loop12 [229] 0.9% ??? [256] 0.5% ------------------------------------------------------------------------------------------- hash-ref! [197] 100.0% [212] 48108(3.1%) 1326(0.1%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [223] 83.2% sig+exp->bigfloat [230] 10.5% bigfloat->sig+exp [241] 3.6% ------------------------------------------------------------------------------------------- for-loop [198] 100.0% [213] 20612(1.3%) 20612(1.3%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------------------- unconstrained-domain->-projection [234] 2.7% ??? [231] 9.1% ??? [135] 18.6% for-loop [198] 69.1% [214] 19732(1.3%) 4684(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [226] 65.0% ??? [231] 12.6% unconstrained-domain->-projection [234] 2.7% ------------------------------------------------------------------------------------------- generic-sort/key [200] 42.6% copying-mergesort [215] 57.4% [215] 17970(1.2%) 344(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [215] 57.4% loop [225] 27.1% jloop [9] 15.0% ------------------------------------------------------------------------------------------- for-loop [204] 100.0% [216] 1956(0.1%) 1624(0.1%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [232] 17.0% ------------------------------------------------------------------------------------------- ??? [109] 22.0% ??? [196] 78.0% [217] 1854(0.1%) 358(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [233] 58.7% integer->bigfloat [235] 22.0% ------------------------------------------------------------------------------------------- check-hash/c [202] 100.0% [218] 1592(0.1%) 1592(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------------------- ??? [205] 100.0% [219] 1442(0.1%) 1442(0.1%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------------------- ??? [206] 25.3% curry* [88] 74.7% [220] 1330(0.1%) 1330(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ------------------------------------------------------------------------------------------- go [209] 7.9% loop [221] 92.1% [221] 1012(0.1%) 1012(0.1%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [221] 92.1% ------------------------------------------------------------------------------------------- parse-lambda [210] 100.0% [222] 334(0.0%) 334(0.0%) simple-args? ...llects/racket/private/kw.rkt:350:2 ------------------------------------------------------------------------------------------- bigfloat-hash [212] 100.0% [223] 40008(2.6%) 36742(2.4%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 bigfloat->sig+exp [241] 8.2% ------------------------------------------------------------------------------------------- ??? [211] 100.0% [224] 16490(1.1%) 8048(0.5%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [238] 30.7% return/no-unsupplied [239] 20.4% ------------------------------------------------------------------------------------------- ??? [186] 11.6% generic-sort/key [200] 32.1% copying-mergesort [215] 56.3% [225] 14610(0.9%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [196] 100.0% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [214] 100.0% [226] 14350(0.9%) 4124(0.3%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [240] 71.3% ------------------------------------------------------------------------------------------- ??? [211] 100.0% [227] 12962(0.8%) 12962(0.8%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------- ??? [211] 100.0% [228] 10408(0.7%) 360(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [237] 96.5% ------------------------------------------------------------------------------------------- map [85] 1.7% parse-loop12 [229] 7.4% simplify [128] 11.4% ??? [211] 26.6% hash-ref! [197] 52.8% [229] 7922(0.5%) 3080(0.2%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [134] 43.0% parse-loop12 [229] 7.4% f137 [68] 7.2% loop [242] 5.1% map [85] 4.7% ------------------------------------------------------------------------------------------- bigfloat-hash [212] 100.0% [230] 5062(0.3%) 2738(0.2%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 integer->mpz [243] 27.5% ??? [255] 18.4% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [214] 100.0% [231] 4388(0.3%) 698(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [214] 84.1% ------------------------------------------------------------------------------------------- loop [38] 7.9% for-loop [216] 7.9% ormap [40] 8.1% for-loop [6] 16.3% loop [134] 25.3% for-loop [67] 34.5% [232] 4198(0.3%) 4198(0.3%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------------------- ??? [217] 100.0% [233] 1088(0.1%) 426(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [255] 60.8% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [214] 100.0% [234] 1060(0.1%) 0(0.0%) unconstrained-domain->-projection ...rrow.rkt:60:0 get/build-late-neg-projection [214] 100.0% ------------------------------------------------------------------------------------------- ??? [217] 100.0% [235] 408(0.0%) 408(0.0%) integer->bigfloat ...ivate/bigfloat/mpfr.rkt:399:0 ------------------------------------------------------------------------------------------- ??? [146] 3.8% ??? [133] 4.2% ??? [152] 37.8% for-loop [149] 52.7% [236] 94210(6.1%) 21982(1.4%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [245] 50.5% ??? [152] 12.6% for-loop [247] 10.0% ??? [256] 2.8% ??? [254] 0.8% ------------------------------------------------------------------------------------------- loop [134] 1.2% bf* [228] 11.9% ??? [211] 86.8% [237] 84144(5.4%) 23002(1.5%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [244] 67.0% bfsqrt [250] 5.7% ------------------------------------------------------------------------------------------- ulp-difference [208] 1.4% flag-set? [56] 7.8% ??? [133] 18.4% ??? [224] 19.2% ??? [153] 53.2% [238] 26466(1.7%) 7970(0.5%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [246] 49.2% ??? [254] 20.7% ------------------------------------------------------------------------------------------- ??? [224] 15.0% flag-set? [56] 19.7% ??? [133] 28.0% ??? [153] 36.0% [239] 22518(1.4%) 14626(0.9%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [248] 35.0% ------------------------------------------------------------------------------------------- contract-struct-name [249] 18.0% ??? [226] 82.0% [240] 10226(0.7%) 7534(0.5%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [249] 42.9% ------------------------------------------------------------------------------------------- bigfloat-hash [212] 34.4% bfcanonicalize [223] 65.6% [241] 4978(0.3%) 2036(0.1%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:370:0 new-mpz [251] 32.7% mpz->integer [252] 19.9% size+limbs->integer [253] 6.5% ------------------------------------------------------------------------------------------- map [85] 0.6% parse-loop12 [229] 1.4% loop [242] 98.0% [242] 2140(0.1%) 724(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [242] 98.0% ??? [12] 0.6% ??? [109] 0.6% ------------------------------------------------------------------------------------------- sig+exp->bigfloat [230] 100.0% [243] 1392(0.1%) 1392(0.1%) integer->mpz ...math/private/bigfloat/gmp.rkt:87:0 ------------------------------------------------------------------------------------------- ??? [237] 100.0% [244] 56340(3.6%) 40050(2.6%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [255] 28.9% ------------------------------------------------------------------------------------------- ??? [236] 100.0% [245] 47596(3.1%) 3656(0.2%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [254] 84.0% ??? [256] 8.3% ------------------------------------------------------------------------------------------- ??? [238] 100.0% [246] 13018(0.8%) 13018(0.8%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ------------------------------------------------------------------------------------------- ??? [236] 100.0% [247] 9456(0.6%) 4984(0.3%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [152] 47.3% ------------------------------------------------------------------------------------------- match-e [51] 4.0% return/no-unsupplied [239] 96.0% [248] 8218(0.5%) 8218(0.5%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------------------- build-compound-type-name [240] 100.0% [249] 6080(0.4%) 2692(0.2%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [240] 58.2% ------------------------------------------------------------------------------------------- ??? [237] 100.0% [250] 4802(0.3%) 4100(0.3%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [255] 14.6% ------------------------------------------------------------------------------------------- bigfloat->sig+exp [241] 100.0% [251] 1628(0.1%) 1628(0.1%) new-mpz ...-lib/math/private/bigfloat/gmp.rkt:73:0 ------------------------------------------------------------------------------------------- bigfloat->sig+exp [241] 100.0% [252] 990(0.1%) 990(0.1%) mpz->integer ...ath/private/bigfloat/gmp.rkt:115:0 ------------------------------------------------------------------------------------------- bigfloat->sig+exp [241] 100.0% [253] 324(0.0%) 324(0.0%) size+limbs->integer ...vate/bigfloat/gmp.rkt:103:0 ------------------------------------------------------------------------------------------- for-loop [165] 0.9% ??? [76] 1.0% ??? [236] 1.0% ??? [87] 3.0% ??? [238] 7.9% ??? [109] 12.6% ??? [152] 15.3% ??? [245] 57.8% [254] 69184(4.4%) 46986(3.0%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [76] 15.6% contract? [257] 11.3% dict? [258] 5.1% ------------------------------------------------------------------------------------------- real->bigfloat [233] 3.6% bfsqrt [250] 3.8% sig+exp->bigfloat [230] 5.0% bfdiv [244] 87.6% [255] 18586(1.2%) 18586(1.2%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------------------- for-loop [149] 7.4% ??? [211] 15.6% ??? [236] 30.5% ??? [245] 46.5% [256] 8530(0.5%) 3826(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [259] 55.1% ------------------------------------------------------------------------------------------- ??? [254] 100.0% [257] 7832(0.5%) 7508(0.5%) contract? ...acket/contract/private/guts.rkt:109:0 coerce-contract/f4 [261] 4.1% ------------------------------------------------------------------------------------------- ??? [133] 33.2% ??? [254] 66.8% [258] 5326(0.3%) 5326(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------------------- ??? [256] 100.0% [259] 4704(0.3%) 2048(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [260] 56.5% ------------------------------------------------------------------------------------------- ??? [259] 100.0% [260] 2656(0.2%) 2656(0.2%) ??? ...ects/racket/contract/private/list.rkt:141:5 ------------------------------------------------------------------------------------------- contract? [257] 100.0% [261] 324(0.0%) 324(0.0%) coerce-contract/f4 ...tract/private/guts.rkt:299:0 -------------------------------------------------------------------------------------------