Profiling results ----------------- Total cpu time observed: 134400ms (out of 135192ms) Number of samples taken: 394 (once every 341ms) (Hiding functions with self<1.0% and local<2.0%: 7 of 163 hidden) =========================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================== ??? [28] 100.0% [1] 116386(86.6%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [6] 100.0% --------------------------------------------------------------------------- ??? [28] 100.0% [2] 95182(70.8%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [7] 97.0% get-final-combination [10] 2.3% loop [32] 0.3% prepare-points [31] 0.3% --------------------------------------------------------------------------- ??? [116] 1.6% jloop [131] 3.1% for-loop [143] 6.5% loop [65] 88.8% [3] 19830(14.8%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [8] 90.1% ??? [42] 5.2% ??? [39] 4.7% --------------------------------------------------------------------------- location-do [41] 100.0% [4] 9424(7.0%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [9] 100.0% --------------------------------------------------------------------------- ??? [39] 100.0% [5] 680(0.5%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [11] 100.0% --------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [6] 116386(86.6%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [28] 100.0% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [7] 92370(68.7%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [12] 100.0% --------------------------------------------------------------------------- ??? [3] 100.0% [8] 17870(13.3%) 2596(1.9%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [78] 77.9% ...higher-order.rkt:346:33 [15] 3.9% ??? [16] 2.0% parse-loop12 [56] 1.7% --------------------------------------------------------------------------- loop [4] 100.0% [9] 9424(7.0%) 0(0.0%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [13] 96.5% for-loop [17] 3.5% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [10] 2188(1.6%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [14] 100.0% --------------------------------------------------------------------------- approximate9 [5] 100.0% [11] 680(0.5%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 ??? [39] 100.0% --------------------------------------------------------------------------- for-loop [7] 100.0% [12] 92370(68.7%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [18] 95.8% finalize-iter! [21] 2.8% gen-series! [22] 0.7% localize-error [23] 0.7% --------------------------------------------------------------------------- pass [9] 100.0% [13] 9090(6.8%) 360(0.3%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [19] 57.6% loop [20] 38.4% --------------------------------------------------------------------------- get-final-combination [10] 100.0% [14] 2188(1.6%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f6 [38] 100.0% --------------------------------------------------------------------------- ??? [8] 100.0% [15] 690(0.5%) 0(0.0%) ...higher-order.rkt:346:33 (unknown source) ??? [142] 100.0% --------------------------------------------------------------------------- ??? [8] 100.0% [16] 362(0.3%) 362(0.3%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 --------------------------------------------------------------------------- pass [9] 100.0% [17] 334(0.2%) 334(0.2%) for-loop ...lt-testing/src/core/simplify.rkt:210:2 --------------------------------------------------------------------------- run-iter! [12] 100.0% [18] 88460(65.8%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [24] 100.0% --------------------------------------------------------------------------- for-loop [13] 100.0% [19] 5238(3.9%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [25] 93.1% expression-cost [27] 6.9% --------------------------------------------------------------------------- for-loop [13] 100.0% [20] 3492(2.6%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [25] 100.0% --------------------------------------------------------------------------- run-iter! [12] 100.0% [21] 2574(1.9%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [109] 100.0% --------------------------------------------------------------------------- run-iter! [12] 100.0% [22] 680(0.5%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [26] 100.0% --------------------------------------------------------------------------- run-iter! [12] 100.0% [23] 656(0.5%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [46] 100.0% --------------------------------------------------------------------------- simplify! [18] 100.0% [24] 88460(65.8%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [28] 100.0% --------------------------------------------------------------------------- loop [20] 41.7% argmin [19] 58.3% [25] 8368(6.2%) 0(0.0%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 location-do [41] 92.8% ...sting/src/common.rkt:47:2 [113] 7.2% --------------------------------------------------------------------------- gen-series! [22] 100.0% [26] 680(0.5%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [29] 100.0% --------------------------------------------------------------------------- argmin [19] 100.0% [27] 362(0.3%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [30] 100.0% --------------------------------------------------------------------------- for-loop [24] 22.0% run [6] 32.4% [28] 134100(99.8%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 location-do [41] 35.2% profile-thunk16 [1] 32.4% run-improve50 [2] 24.5% prepare-points [31] 5.2% loop [32] 2.7% --------------------------------------------------------------------------- for-loop [26] 100.0% [29] 680(0.5%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [33] 100.0% --------------------------------------------------------------------------- expression-cost [27] 100.0% [30] 362(0.3%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [46] 100.0% --------------------------------------------------------------------------- run-improve50 [2] 2.0% pred [130] 4.2% ??? [28] 93.9% [31] 14968(11.1%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [35] 36.8% loop [34] 33.6% make-exacts* [36] 29.7% --------------------------------------------------------------------------- run-improve50 [2] 4.4% ??? [28] 95.6% [32] 7484(5.6%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 loop [34] 39.6% loop [35] 37.5% make-exacts* [36] 22.8% --------------------------------------------------------------------------- taylor-alt [29] 100.0% [33] 680(0.5%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [39] 100.0% --------------------------------------------------------------------------- loop [32] 37.1% prepare-points [31] 62.9% [34] 7992(5.9%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [36] 62.2% loop [35] 37.8% --------------------------------------------------------------------------- loop [32] 24.8% loop [34] 26.6% prepare-points [31] 48.6% [35] 11328(8.4%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [65] 100.0% --------------------------------------------------------------------------- loop [32] 15.4% prepare-points [31] 39.9% loop [34] 44.7% [36] 11124(8.3%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [65] 84.4% eval-prog [37] 15.6% --------------------------------------------------------------------------- errors [139] 15.6% make-exacts* [36] 84.4% [37] 2058(1.5%) 322(0.2%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f6 [38] 84.4% --------------------------------------------------------------------------- hash-ref! [46] 7.7% eval-const-expr [98] 7.9% f6 [38] 14.8% eval-prog [37] 22.5% split-table [14] 47.1% [38] 4650(3.5%) 0(0.0%) f6 ...et/collects/racket/match/compiler.rkt:507:40 option-on-expr [80] 27.2% ??? [39] 22.5% loop [65] 19.9% f6 [38] 14.8% location-do [41] 7.9% map [40] 7.7% --------------------------------------------------------------------------- loop [11] 3.2% location-do [41] 3.2% for-loop [33] 3.2% for-loop [143] 8.9% ??? [3] 13.2% f6 [38] 24.5% loop [65] 43.8% [39] 7084(5.3%) 310(0.2%) ??? ...tract/private/arrow-higher-order.rkt:342:33 location-do [41] 69.8% ??? [42] 19.5% approximate9 [5] 3.2% hash-ref! [46] 3.2% --------------------------------------------------------------------------- f6 [38] 100.0% [40] 358(0.3%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 ??? [43] 100.0% --------------------------------------------------------------------------- f6 [38] 0.1% get-sigs [101] 1.8% for-loop [25] 2.3% ??? [39] 4.7% location-do [41] 13.8% for-loop [45] 31.8% ??? [28] 45.3% [41] 111870(83.2%) 5132(3.8%) location-do ...acket/private/norm-define.rkt:53:83 iterate-egraph!13 [44] 42.3% for-loop [45] 31.8% location-do [41] 13.8% ??? [125] 3.5% loop [4] 3.1% ??? [129] 1.6% ??? [39] 0.5% ??? [49] 0.3% --------------------------------------------------------------------------- ??? [3] 42.7% ??? [39] 57.3% [42] 2404(1.8%) 334(0.2%) ??? ...contract/private/../../private/kw.rkt:761:9 integer->bigfloat [47] 57.3% real->bigfloat [48] 28.8% --------------------------------------------------------------------------- map [40] 100.0% [43] 358(0.3%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [46] 100.0% --------------------------------------------------------------------------- location-do [41] 100.0% [44] 96694(71.9%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [50] 99.6% --------------------------------------------------------------------------- location-do [41] 100.0% [45] 74728(55.6%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 location-do [41] 100.0% --------------------------------------------------------------------------- ??? [43] 10.5% ??? [53] 10.7% compile [30] 10.7% ??? [51] 20.0% ??? [39] 20.0% localize-error [23] 28.1% [46] 1698(1.3%) 362(0.3%) hash-ref! ...racket/private/more-scheme.rkt:373:13 parse-loop12 [56] 28.1% ??? [51] 20.0% simplify [52] 20.0% ??? [53] 10.7% f6 [38] 10.5% --------------------------------------------------------------------------- ??? [42] 100.0% [47] 1378(1.0%) 1378(1.0%) integer->bigfloat ...ivate/bigfloat/mpfr.rkt:399:0 --------------------------------------------------------------------------- ??? [42] 100.0% [48] 692(0.5%) 394(0.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [104] 43.1% --------------------------------------------------------------------------- location-do [41] 100.0% [49] 320(0.2%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:60:15 ??? [104] 100.0% --------------------------------------------------------------------------- iterate-egraph!13 [44] 100.0% [50] 96326(71.7%) 916(0.7%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [54] 71.4% for-loop [55] 27.7% --------------------------------------------------------------------------- hash-ref! [46] 100.0% [51] 680(0.5%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [46] 100.0% --------------------------------------------------------------------------- hash-ref! [46] 100.0% [52] 680(0.5%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 parse-loop12 [56] 100.0% --------------------------------------------------------------------------- hash-ref! [46] 100.0% [53] 362(0.3%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 hash-ref! [46] 100.0% --------------------------------------------------------------------------- one-iter [50] 100.0% [54] 68748(51.2%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [57] 86.2% match-e [58] 11.0% update-leader! [68] 2.3% reduce-to-single! [59] 0.5% --------------------------------------------------------------------------- for-loop [55] 49.4% one-iter [50] 50.6% [55] 26662(19.8%) 5018(3.7%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [55] 49.4% match-e [58] 40.6% --------------------------------------------------------------------------- ??? [8] 18.2% hash-ref! [46] 40.1% simplify [52] 41.6% [56] 1634(1.2%) 978(0.7%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [65] 40.1% --------------------------------------------------------------------------- for-loop [54] 100.0% [57] 59262(44.1%) 0(0.0%) for-loop ...t-testing/src/core/simplify.rkt:148:10 merge-egraph-nodes! [61] 29.5% loop! [77] 26.4% mk-enode! [66] 21.5% substitute-e [62] 19.9% list-member? [63] 2.8% --------------------------------------------------------------------------- for-loop [54] 14.7% for-loop [67] 29.5% for-loop [55] 55.7% [58] 29198(21.7%) 5550(4.1%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [60] 59.5% for-loop [67] 8.7% ??? [109] 7.6% variable? [69] 4.0% loop [65] 1.1% list-cartesian-product [70] 1.1% curry* [75] 1.1% --------------------------------------------------------------------------- for-loop [54] 100.0% [59] 348(0.3%) 0(0.0%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 make-sequence [64] 100.0% --------------------------------------------------------------------------- match-e [58] 100.0% [60] 22038(16.4%) 7924(5.9%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [67] 51.1% list-cartesian-product [70] 11.0% loop [65] 3.0% curry* [75] 2.2% foldl [86] 1.4% --------------------------------------------------------------------------- for-loop [72] 4.4% merge-egraph-nodes! [61] 5.3% for-loop [57] 90.3% [61] 17476(13.0%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [68] 65.2% loop! [77] 11.8% for-loop [73] 7.5% enode-merge! [74] 5.8% merge-egraph-nodes! [61] 5.3% for-loop [72] 4.4% --------------------------------------------------------------------------- substitute-e [62] 9.6% for-loop [57] 90.4% [62] 11764(8.8%) 332(0.2%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [66] 80.7% substitute-e [62] 9.6% ??? [109] 3.6% variable? [69] 3.3% --------------------------------------------------------------------------- for-loop [57] 100.0% [63] 1642(1.2%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [71] 100.0% --------------------------------------------------------------------------- reduce-to-single! [59] 100.0% [64] 348(0.3%) 348(0.3%) make-sequence ...ects/racket/private/for.rkt:509:2 --------------------------------------------------------------------------- parse-loop12 [56] 0.1% make-exacts* [36] 0.7% match-e [58] 1.0% for-loop [60] 1.1% loop [35] 1.5% f6 [38] 1.6% loop! [77] 7.5% loop [65] 85.3% [65] 34256(25.5%) 632(0.5%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [65] 85.3% loop! [77] 7.5% ??? [3] 2.1% option-on-expr [80] 1.6% for-loop [87] 1.1% foldl [86] 0.3% ??? [39] 0.1% ??? [78] 0.0% --------------------------------------------------------------------------- substitute-e [62] 42.0% for-loop [57] 56.4% [66] 22578(16.8%) 1992(1.5%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [76] 85.2% hash-has-key? [118] 5.9% --------------------------------------------------------------------------- match-e [58] 25.7% for-loop [60] 74.3% [67] 16342(12.2%) 632(0.5%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [58] 93.0% ??? [85] 4.0% --------------------------------------------------------------------------- for-loop [54] 11.3% merge-egraph-nodes! [61] 88.7% [68] 14014(10.4%) 1332(1.0%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [79] 80.9% custom-set-union! [81] 7.2% update-en-expr [127] 2.4% --------------------------------------------------------------------------- substitute-e [62] 26.8% match-e [58] 73.2% [69] 3644(2.7%) 330(0.2%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [109] 90.9% --------------------------------------------------------------------------- match-e [58] 15.3% list-cartesian-product [70] 30.0% for-loop [60] 54.6% [70] 3238(2.4%) 2234(1.7%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [70] 30.0% for-loop [82] 25.8% --------------------------------------------------------------------------- list-member? [63] 100.0% [71] 1642(1.2%) 1642(1.2%) loop (unknown source) --------------------------------------------------------------------------- merge-egraph-nodes! [61] 100.0% [72] 1640(1.2%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [61] 100.0% --------------------------------------------------------------------------- merge-egraph-nodes! [61] 100.0% [73] 1302(1.0%) 1302(1.0%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 --------------------------------------------------------------------------- merge-egraph-nodes! [61] 100.0% [74] 1020(0.8%) 360(0.3%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [84] 64.7% --------------------------------------------------------------------------- match-e [58] 34.5% for-loop [60] 65.5% [75] 952(0.7%) 0(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [83] 100.0% --------------------------------------------------------------------------- mk-enode! [66] 100.0% [76] 19246(14.3%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [88] 100.0% --------------------------------------------------------------------------- merge-egraph-nodes! [61] 10.2% loop [65] 31.3% for-loop [57] 58.5% [77] 18376(13.7%) 2998(2.2%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [90] 40.6% loop [65] 31.3% set [91] 15.0% update-en-expr [127] 5.3% --------------------------------------------------------------------------- loop [65] 2.1% ??? [8] 97.9% [78] 14222(10.6%) 11194(8.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [92] 13.8% bflog [93] 7.5% --------------------------------------------------------------------------- update-leader! [68] 100.0% [79] 11338(8.4%) 320(0.2%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [89] 97.2% --------------------------------------------------------------------------- loop [65] 42.2% f6 [38] 57.8% [80] 2188(1.6%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [94] 43.2% sort-context-on-expr [97] 27.9% pick-errors [100] 14.5% errors [139] 14.4% --------------------------------------------------------------------------- update-leader! [68] 100.0% [81] 1010(0.8%) 324(0.2%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [95] 67.9% --------------------------------------------------------------------------- list-cartesian-product [70] 100.0% [82] 1004(0.7%) 1004(0.7%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 --------------------------------------------------------------------------- curry* [75] 100.0% [83] 952(0.7%) 952(0.7%) procedure-arity ...ket/private/norm-arity.rkt:7:27 --------------------------------------------------------------------------- enode-merge! [74] 100.0% [84] 660(0.5%) 0(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [90] 100.0% --------------------------------------------------------------------------- for-loop [67] 100.0% [85] 658(0.5%) 310(0.2%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [99] 52.9% --------------------------------------------------------------------------- for-loop [60] 45.7% loop [65] 54.3% [86] 656(0.5%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [96] 100.0% --------------------------------------------------------------------------- loop [65] 100.0% [87] 368(0.3%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 eval-const-expr [98] 100.0% --------------------------------------------------------------------------- new-enode [76] 100.0% [88] 19246(14.3%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [101] 100.0% --------------------------------------------------------------------------- for-loop [79] 100.0% [89] 11018(8.2%) 666(0.5%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [102] 94.0% --------------------------------------------------------------------------- adopt-enode! [84] 7.5% loop! [77] 92.5% [90] 8820(6.6%) 3304(2.5%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [103] 51.2% for-loop [105] 11.3% --------------------------------------------------------------------------- loop! [77] 100.0% [91] 5134(3.8%) 5134(3.8%) set ...collects/racket/private/set-types.rkt:981:0 --------------------------------------------------------------------------- ??? [78] 100.0% [92] 1966(1.5%) 1028(0.8%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [104] 47.7% --------------------------------------------------------------------------- ??? [78] 100.0% [93] 1062(0.8%) 1062(0.8%) bflog ...-lib/math/private/bigfloat/mpfr.rkt:616:4 --------------------------------------------------------------------------- option-on-expr [80] 100.0% [94] 946(0.7%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [106] 100.0% --------------------------------------------------------------------------- custom-set-union! [81] 100.0% [95] 686(0.5%) 686(0.5%) for-loop ...cts/racket/private/set-types.rkt:253:4 --------------------------------------------------------------------------- foldl [86] 100.0% [96] 656(0.5%) 656(0.5%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 --------------------------------------------------------------------------- option-on-expr [80] 100.0% [97] 610(0.5%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [107] 100.0% --------------------------------------------------------------------------- for-loop [87] 100.0% [98] 368(0.3%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f6 [38] 100.0% --------------------------------------------------------------------------- ??? [85] 100.0% [99] 348(0.3%) 348(0.3%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 --------------------------------------------------------------------------- option-on-expr [80] 100.0% [100] 318(0.2%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [108] 100.0% --------------------------------------------------------------------------- type-of-enode-expr [88] 100.0% [101] 19246(14.3%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [111] 37.2% location-do [41] 32.0% ??? [109] 20.3% ...sting/src/common.rkt:47:2 [113] 10.4% --------------------------------------------------------------------------- for-loop [89] 100.0% [102] 10352(7.7%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [110] 100.0% --------------------------------------------------------------------------- custom-set-union [90] 100.0% [103] 4518(3.4%) 976(0.7%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [112] 78.4% --------------------------------------------------------------------------- real->bigfloat [48] 19.2% ??? [49] 20.6% bfsub [92] 60.3% [104] 1556(1.2%) 1556(1.2%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 --------------------------------------------------------------------------- custom-set-union [90] 100.0% [105] 998(0.7%) 998(0.7%) for-loop ...cts/racket/private/set-types.rkt:152:2 --------------------------------------------------------------------------- sindices->spoints [94] 100.0% [106] 946(0.7%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 sidx->spoint [114] 100.0% --------------------------------------------------------------------------- sort-context-on-expr [97] 100.0% [107] 610(0.5%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [115] 100.0% --------------------------------------------------------------------------- pick-errors [100] 100.0% [108] 318(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [116] 100.0% --------------------------------------------------------------------------- substitute-e [62] 6.0% finalize-iter! [21] 16.1% variable? [69] 20.7% get-sigs [101] 24.4% match-e [58] 32.8% [109] 16028(11.9%) 6584(4.9%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [118] 38.7% for-loop [120] 16.1% ??? [153] 4.1% --------------------------------------------------------------------------- hash-update! [102] 100.0% [110] 10352(7.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [117] 100.0% --------------------------------------------------------------------------- get-sigs [101] 100.0% [111] 7162(5.3%) 638(0.5%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [119] 59.4% for-loop [140] 27.0% get/build-late-neg-projection [146] 4.7% --------------------------------------------------------------------------- for-loop [103] 100.0% [112] 3542(2.6%) 3542(2.6%) for-loop ...cts/racket/private/set-types.rkt:178:5 --------------------------------------------------------------------------- for-loop [25] 23.2% get-sigs [101] 76.8% [113] 2614(1.9%) 330(0.2%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [121] 50.2% ??? [122] 37.2% --------------------------------------------------------------------------- loop [106] 100.0% [114] 946(0.7%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [123] 100.0% --------------------------------------------------------------------------- ??? [107] 100.0% [115] 610(0.5%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [124] 100.0% --------------------------------------------------------------------------- for-loop [108] 100.0% [116] 318(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [3] 100.0% --------------------------------------------------------------------------- ??? [110] 100.0% [117] 10352(7.7%) 9348(7.0%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [127] 9.7% --------------------------------------------------------------------------- mk-enode! [66] 17.7% ??? [109] 82.3% [118] 7550(5.6%) 3246(2.4%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [125] 52.9% ??? [132] 4.1% --------------------------------------------------------------------------- ??? [111] 100.0% [119] 4256(3.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [126] 100.0% --------------------------------------------------------------------------- ??? [109] 100.0% [120] 2574(1.9%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:53:2 atab-add-altn [128] 100.0% --------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [113] 100.0% [121] 1312(1.0%) 714(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [129] 45.6% --------------------------------------------------------------------------- ??? [142] 32.7% ...sting/src/common.rkt:47:2 [113] 67.3% [122] 972(0.7%) 310(0.2%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [142] 67.3% ??? [153] 16.8% --------------------------------------------------------------------------- sidx->spoint [114] 100.0% [123] 946(0.7%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [130] 100.0% --------------------------------------------------------------------------- generic-sort/key [115] 25.0% copying-mergesort [124] 75.0% [124] 610(0.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [124] 75.0% jloop [131] 25.0% --------------------------------------------------------------------------- hash-has-key? [118] 26.5% location-do [41] 73.5% [125] 15098(11.2%) 5330(4.0%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [133] 47.4% ??? [137] 17.3% --------------------------------------------------------------------------- ??? [119] 100.0% [126] 4256(3.2%) 360(0.3%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [134] 91.5% --------------------------------------------------------------------------- update-leader! [68] 9.8% for-loop [117] 29.3% loop! [77] 60.9% [127] 3422(2.5%) 3422(2.5%) update-en-expr ...esting/src/core/egraph.rkt:212:0 --------------------------------------------------------------------------- for-loop [120] 100.0% [128] 2574(1.9%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [135] 100.0% --------------------------------------------------------------------------- ??? [121] 25.2% location-do [41] 74.8% [129] 2376(1.8%) 598(0.4%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [136] 58.6% ??? [153] 16.2% --------------------------------------------------------------------------- binary-search-floats [123] 100.0% [130] 946(0.7%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [31] 66.0% errors [139] 34.0% --------------------------------------------------------------------------- copying-mergesort [124] 100.0% [131] 610(0.5%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [3] 100.0% --------------------------------------------------------------------------- hash-has-key? [118] 100.0% [132] 310(0.2%) 310(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 --------------------------------------------------------------------------- ??? [125] 100.0% [133] 7154(5.3%) 4516(3.4%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [137] 27.5% for-loop [140] 9.4% --------------------------------------------------------------------------- ??? [126] 100.0% [134] 3896(2.9%) 340(0.3%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [138] 91.3% --------------------------------------------------------------------------- atab-add-altn [128] 100.0% [135] 2574(1.9%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [139] 87.6% for-loop [141] 12.4% --------------------------------------------------------------------------- ??? [129] 100.0% [136] 1392(1.0%) 1392(1.0%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 --------------------------------------------------------------------------- for-loop [133] 43.0% ??? [125] 57.0% [137] 4582(3.4%) 2308(1.7%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [144] 49.6% --------------------------------------------------------------------------- ??? [134] 100.0% [138] 3556(2.6%) 1344(1.0%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [145] 44.0% get/build-late-neg-projection [146] 18.2% --------------------------------------------------------------------------- option-on-expr [80] 10.9% pred [130] 11.1% best-and-tied-at-points [135] 78.0% [139] 2890(2.2%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [143] 88.9% eval-prog [37] 11.1% --------------------------------------------------------------------------- for-loop [133] 25.7% ??? [111] 74.3% [140] 2604(1.9%) 1010(0.8%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [142] 36.3% ??? [147] 24.9% --------------------------------------------------------------------------- best-and-tied-at-points [135] 100.0% [141] 320(0.2%) 320(0.2%) for-loop ...-testing/src/core/alt-table.rkt:155:16 --------------------------------------------------------------------------- ...higher-order.rkt:346:33 [15] 26.5% for-loop [140] 36.3% ??? [122] 37.3% [142] 2608(1.9%) 690(0.5%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [148] 36.3% ??? [122] 24.4% for-loop [150] 12.9% --------------------------------------------------------------------------- errors [139] 100.0% [143] 2568(1.9%) 334(0.2%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [3] 50.2% ??? [39] 24.5% ulp-difference [152] 12.2% --------------------------------------------------------------------------- ??? [137] 100.0% [144] 2274(1.7%) 2274(1.7%) make-keyword-procedure ...ket/private/kw.rkt:260:4 --------------------------------------------------------------------------- for-loop [138] 100.0% [145] 1566(1.2%) 1566(1.2%) add-list-context ...ontract/private/list.rkt:752:0 --------------------------------------------------------------------------- ??? [151] 17.0% ??? [111] 17.0% for-loop [138] 65.9% [146] 980(0.7%) 334(0.2%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [149] 65.9% ??? [151] 17.0% --------------------------------------------------------------------------- for-loop [140] 100.0% [147] 648(0.5%) 648(0.5%) ??? ...ects/racket/contract/private/prop.rkt:493:4 --------------------------------------------------------------------------- ??? [142] 100.0% [148] 946(0.7%) 310(0.2%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [153] 67.2% --------------------------------------------------------------------------- get/build-late-neg-projection [146]100.0% [149] 646(0.5%) 320(0.2%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [154] 50.5% --------------------------------------------------------------------------- ??? [142] 100.0% [150] 336(0.2%) 336(0.2%) for-loop ...acket/contract/private/list.rkt:190:15 --------------------------------------------------------------------------- get/build-late-neg-projection [146]100.0% [151] 334(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [146]100.0% --------------------------------------------------------------------------- for-loop [143] 100.0% [152] 314(0.2%) 314(0.2%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 --------------------------------------------------------------------------- ??? [122] 16.2% ??? [129] 19.2% ??? [148] 31.7% ??? [109] 32.9% [153] 2008(1.5%) 1682(1.3%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [155] 16.2% --------------------------------------------------------------------------- ??? [149] 100.0% [154] 326(0.2%) 0(0.0%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [156] 100.0% --------------------------------------------------------------------------- ??? [153] 100.0% [155] 326(0.2%) 326(0.2%) contract? ...acket/contract/private/guts.rkt:109:0 --------------------------------------------------------------------------- build-compound-type-name [154] 100.0% [156] 326(0.2%) 326(0.2%) contract-struct-name ...ract/private/prop.rkt:89:0 ---------------------------------------------------------------------------