Profiling results ----------------- Total cpu time observed: 458006ms (out of 459860ms) Number of samples taken: 1358 (once every 337ms) (Hiding functions with self<1.0% and local<2.0%: 11 of 265 hidden) ========================================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================= ??? [67] 100.0% [1] 399796(87.3%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [15] 100.0% ----------------------------------------------------------------------------------------- ??? [67] 100.0% [2] 388280(84.8%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [16] 89.0% get-final-combination [18] 10.7% setup-alt-simplified [25] 0.2% prepare-points [93] 0.1% ----------------------------------------------------------------------------------------- ??? [157] 100.0% [3] 334414(73.0%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [17] 98.9% debug7 [84] 0.1% ----------------------------------------------------------------------------------------- ??? [157] 100.0% [4] 25932(5.7%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [19] 100.0% ----------------------------------------------------------------------------------------- substitute-e [57] 12.9% match-e [41] 87.1% [5] 9982(2.2%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [54] 100.0% ----------------------------------------------------------------------------------------- copying-mergesort [237] 100.0% [6] 4678(1.0%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [145] 92.3% ??? [154] 7.7% ----------------------------------------------------------------------------------------- hash-ref! [199] 100.0% [7] 3700(0.8%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [199] 90.9% ??? [36] 9.1% ----------------------------------------------------------------------------------------- hash-ref! [199] 100.0% [8] 3390(0.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [20] 100.0% ----------------------------------------------------------------------------------------- loop [152] 100.0% [9] 2654(0.6%) 310(0.1%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [22] 76.8% eval-const-expr [28] 11.5% ----------------------------------------------------------------------------------------- hash-ref! [199] 100.0% [10] 2396(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [21] 100.0% ----------------------------------------------------------------------------------------- f45 [42] 100.0% [11] 1648(0.4%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 hash-ref! [199] 41.5% simplify [34] 38.8% first-nonzero-exp [27] 19.7% ----------------------------------------------------------------------------------------- hash-ref! [199] 100.0% [12] 1370(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 for-loop [24] 51.5% hash-ref! [199] 48.5% ----------------------------------------------------------------------------------------- hash-ref! [199] 100.0% [13] 1044(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 for-loop [23] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [199] 100.0% [14] 340(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [26] 100.0% ----------------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [15] 399796(87.3%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [67] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [16] 345532(75.4%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [29] 100.0% ----------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [17] 330700(72.2%) 7930(1.7%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [30] 61.8% for-loop [31] 35.7% loop [133] 0.1% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [18] 41714(9.1%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [32] 98.5% extract-alt [37] 1.5% ----------------------------------------------------------------------------------------- loop [4] 100.0% [19] 25932(5.7%) 308(0.1%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [33] 98.8% ----------------------------------------------------------------------------------------- ??? [8] 100.0% [20] 3390(0.7%) 344(0.1%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [199] 89.9% ----------------------------------------------------------------------------------------- ??? [10] 100.0% [21] 2396(0.5%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 hash-ref! [199] 86.3% ??? [36] 13.7% ----------------------------------------------------------------------------------------- for-loop [9] 100.0% [22] 2038(0.4%) 1704(0.4%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 ??? [54] 16.4% ----------------------------------------------------------------------------------------- ??? [13] 100.0% [23] 1044(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:324:46 simplify [34] 67.4% hash-ref! [199] 32.6% ----------------------------------------------------------------------------------------- ??? [12] 100.0% [24] 706(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [199] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [25] 678(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [35] 100.0% ----------------------------------------------------------------------------------------- ??? [14] 100.0% [26] 340(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [38] 100.0% ----------------------------------------------------------------------------------------- taylor-sqrt [11] 100.0% [27] 324(0.1%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [199] 100.0% ----------------------------------------------------------------------------------------- for-loop [9] 100.0% [28] 306(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f45 [42] 100.0% ----------------------------------------------------------------------------------------- for-loop [16] 100.0% [29] 345532(75.4%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [39] 89.2% finalize-iter! [43] 7.2% gen-series! [46] 1.8% choose-best-alt! [47] 1.2% gen-rewrites! [48] 0.4% localize-error [52] 0.1% ----------------------------------------------------------------------------------------- one-iter [17] 100.0% [30] 204320(44.6%) 2394(0.5%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [40] 88.7% match-e [41] 9.3% update-leader! [72] 0.7% reduce-to-single! [50] 0.2% ----------------------------------------------------------------------------------------- for-loop [31] 49.0% one-iter [17] 51.0% [31] 118108(25.8%) 31358(6.8%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [31] 49.0% match-e [41] 36.3% ??? [96] 0.4% ----------------------------------------------------------------------------------------- get-final-combination [18] 100.0% [32] 41068(9.0%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f45 [42] 99.2% ??? [54] 0.8% ----------------------------------------------------------------------------------------- pass [19] 100.0% [33] 25624(5.6%) 0(0.0%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [44] 64.9% loop [45] 32.7% for-loop [49] 2.4% ----------------------------------------------------------------------------------------- taylor-sqrt [11] 12.8% for-loop [23] 14.1% hash-ref! [199] 73.1% [34] 5004(1.1%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f45 [42] 79.3% debug7 [84] 7.2% make-multiplication-node [51] 6.8% parse-loop12 [228] 6.7% ----------------------------------------------------------------------------------------- setup-alt-simplified [25] 100.0% [35] 678(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [157] 100.0% ----------------------------------------------------------------------------------------- for-loop [21] 49.4% ??? [7] 50.6% [36] 664(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [199] 100.0% ----------------------------------------------------------------------------------------- get-final-combination [18] 100.0% [37] 646(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 loop [186] 100.0% ----------------------------------------------------------------------------------------- for-loop [26] 100.0% [38] 340(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [199] 100.0% ----------------------------------------------------------------------------------------- run-iter! [29] 100.0% [39] 308376(67.3%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [53] 100.0% ----------------------------------------------------------------------------------------- for-loop [30] 100.0% [40] 181152(39.6%) 1018(0.2%) for-loop ...t-testing/src/core/simplify.rkt:148:10 mk-enode! [68] 32.3% merge-egraph-nodes! [56] 24.5% loop! [158] 22.5% substitute-e [57] 17.9% list-member? [60] 2.2% ----------------------------------------------------------------------------------------- for-loop [30] 10.9% for-loop [69] 23.6% for-loop [31] 65.5% [41] 104790(22.9%) 38486(8.4%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [55] 42.9% ??? [54] 9.0% for-loop [69] 7.2% variable? [5] 3.1% list-cartesian-product [73] 2.3% custom-in-set [225] 2.3% loop [152] 1.2% curry* [81] 0.8% ----------------------------------------------------------------------------------------- hash-ref! [199] 0.1% simplify-node [86] 0.1% for-loop [134] 0.2% for-loop [192] 0.2% rewriter [103] 0.3% eval-const-expr [28] 0.6% approximate9 [163] 0.7% map [62] 2.5% eval-prog [196] 4.2% simplify [34] 4.6% f45 [42] 6.0% split-table [32] 80.4% [42] 49580(10.8%) 1030(0.2%) f45 ...t/collects/racket/match/compiler.rkt:507:40 loop [152] 74.6% f45 [42] 6.0% option-on-expr [159] 5.8% map [62] 4.6% ??? [154] 3.9% taylor-sqrt [11] 0.9% ...sting/src/common.rkt:47:2 [160] 0.6% ??? [139] 0.5% ??? [54] 0.3% taylor [64] 0.1% ----------------------------------------------------------------------------------------- run-iter! [29] 100.0% [43] 24998(5.5%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [54] 100.0% ----------------------------------------------------------------------------------------- for-loop [33] 100.0% [44] 16640(3.6%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [58] 84.2% expression-cost [61] 15.8% ----------------------------------------------------------------------------------------- for-loop [33] 100.0% [45] 8368(1.8%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [58] 88.6% expression-cost [61] 11.4% ----------------------------------------------------------------------------------------- run-iter! [29] 100.0% [46] 6326(1.4%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [59] 100.0% ----------------------------------------------------------------------------------------- run-iter! [29] 100.0% [47] 4266(0.9%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [54] 100.0% ----------------------------------------------------------------------------------------- run-iter! [29] 100.0% [48] 1254(0.3%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 for-loop [63] 100.0% ----------------------------------------------------------------------------------------- for-loop [33] 100.0% [49] 616(0.1%) 616(0.1%) for-loop ...t-testing/src/core/simplify.rkt:217:13 ----------------------------------------------------------------------------------------- for-loop [30] 100.0% [50] 344(0.1%) 0(0.0%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [65] 100.0% ----------------------------------------------------------------------------------------- simplify [34] 100.0% [51] 342(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [66] 100.0% ----------------------------------------------------------------------------------------- run-iter! [29] 100.0% [52] 312(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [199] 100.0% ----------------------------------------------------------------------------------------- simplify! [39] 100.0% [53] 308376(67.3%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [67] 100.0% ----------------------------------------------------------------------------------------- f45 [42] 0.4% expression->type [119] 0.4% setfindf [22] 0.5% split-table [32] 0.5% debug7 [84] 0.5% for-loop [115] 0.9% ??? [236] 1.3% substitute-e [57] 1.8% choose-best-alt! [47] 5.5% variable? [5] 13.5% get-sigs [126] 18.2% match-e [41] 23.4% finalize-iter! [43] 32.7% [54] 73962(16.1%) 19938(4.4%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [70] 33.0% for-loop [71] 31.6% atab-pick-alt8 [77] 5.5% ??? [236] 1.3% atab-add-altns [85] 1.1% split-atab [87] 0.5% ----------------------------------------------------------------------------------------- match-e [41] 100.0% [55] 58566(12.8%) 17326(3.8%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [69] 58.2% list-cartesian-product [73] 11.0% loop [152] 3.2% curry* [81] 1.1% curried [250] 0.6% filter [226] 0.5% ----------------------------------------------------------------------------------------- for-loop [75] 4.0% merge-egraph-nodes! [56] 7.4% for-loop [40] 88.6% [56] 44462(9.7%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [72] 39.6% for-loop [74] 22.6% loop! [158] 14.6% for-loop [75] 11.2% merge-egraph-nodes! [56] 7.4% enode-merge! [80] 4.6% ----------------------------------------------------------------------------------------- substitute-e [57] 5.7% for-loop [40] 94.3% [57] 32490(7.1%) 662(0.1%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [68] 89.9% substitute-e [57] 5.7% variable? [5] 1.8% ??? [54] 1.5% ----------------------------------------------------------------------------------------- loop [45] 34.6% argmin [44] 65.4% [58] 21432(4.7%) 610(0.1%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [157] 63.0% ...sting/src/common.rkt:47:2 [160] 29.5% ??? [139] 4.7% ----------------------------------------------------------------------------------------- gen-series! [46] 100.0% [59] 6326(1.4%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [76] 100.0% ----------------------------------------------------------------------------------------- for-loop [40] 100.0% [60] 3986(0.9%) 310(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [79] 58.0% member [82] 34.3% ----------------------------------------------------------------------------------------- loop [45] 26.7% argmin [44] 73.3% [61] 3576(0.8%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [78] 100.0% ----------------------------------------------------------------------------------------- f45 [42] 100.0% [62] 2954(0.6%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 f45 [42] 62.8% parse-loop12 [228] 19.8% simplify-node [86] 14.1% simplify* [90] 2.1% ??? [89] 1.2% ----------------------------------------------------------------------------------------- gen-rewrites! [48] 100.0% [63] 1254(0.3%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:138:11 ??? [83] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [199] 49.5% f45 [42] 50.5% [64] 630(0.1%) 312(0.1%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 debug7 [84] 50.5% ----------------------------------------------------------------------------------------- reduce-to-single! [50] 100.0% [65] 344(0.1%) 344(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 ----------------------------------------------------------------------------------------- make-multiplication-node [51] 100.0% [66] 342(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [88] 100.0% ----------------------------------------------------------------------------------------- for-loop [53] 22.6% run [15] 32.7% [67] 454074(99.1%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [157] 34.1% profile-thunk16 [1] 32.7% run-improve50 [2] 31.7% prepare-points [93] 1.4% loop [99] 0.1% ----------------------------------------------------------------------------------------- mk-egraph [185] 0.4% mk-enode-rec! [207] 2.6% substitute-e [57] 32.3% for-loop [40] 64.7% [68] 90346(19.7%) 6460(1.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [91] 91.8% hash-has-key? [70] 1.1% ----------------------------------------------------------------------------------------- match-e [41] 26.9% for-loop [55] 73.1% [69] 47222(10.3%) 1652(0.4%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [41] 92.3% ??? [96] 4.9% ----------------------------------------------------------------------------------------- mk-enode! [68] 3.7% ??? [54] 96.3% [70] 26398(5.8%) 6942(1.5%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [172] 65.1% ??? [98] 8.6% ----------------------------------------------------------------------------------------- ??? [54] 100.0% [71] 24018(5.2%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:53:2 atab-add-altn [92] 100.0% ----------------------------------------------------------------------------------------- for-loop [30] 6.8% merge-egraph-nodes! [56] 93.2% [72] 20966(4.6%) 1574(0.3%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [94] 83.2% custom-set-union! [102] 6.2% update-en-expr [177] 1.6% make-sequence [187] 1.5% ----------------------------------------------------------------------------------------- match-e [41] 20.5% list-cartesian-product [73] 29.5% for-loop [55] 49.9% [73] 10428(2.3%) 8756(1.9%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [73] 29.5% for-loop [100] 12.7% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [56] 100.0% [74] 10200(2.2%) 8140(1.8%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [177] 20.2% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [56] 100.0% [75] 7294(1.6%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [56] 53.8% loop! [158] 46.2% ----------------------------------------------------------------------------------------- for-loop [59] 100.0% [76] 6326(1.4%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [95] 100.0% ----------------------------------------------------------------------------------------- ??? [54] 100.0% [77] 4266(0.9%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:64:0 point-best-alt [97] 61.0% ??? [154] 30.8% write-json* [107] 8.1% ----------------------------------------------------------------------------------------- expression-cost [61] 100.0% [78] 3576(0.8%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [199] 100.0% ----------------------------------------------------------------------------------------- list-member? [60] 100.0% [79] 2310(0.5%) 2310(0.5%) loop (unknown source) ----------------------------------------------------------------------------------------- merge-egraph-nodes! [56] 100.0% [80] 2048(0.4%) 372(0.1%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [104] 51.0% custom-set-intersect! [105] 30.9% ----------------------------------------------------------------------------------------- for-loop [55] 39.3% match-e [41] 60.7% [81] 1608(0.4%) 310(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [101] 80.7% ----------------------------------------------------------------------------------------- list-member? [60] 100.0% [82] 1366(0.3%) 1366(0.3%) member (unknown source) ----------------------------------------------------------------------------------------- for-loop [63] 100.0% [83] 1254(0.3%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [103] 100.0% ----------------------------------------------------------------------------------------- taylor [64] 30.5% simplify [34] 34.3% iterate-egraph!13 [3] 35.2% [84] 1044(0.2%) 0(0.0%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 return/no-unsupplied [198] 64.8% ??? [54] 35.2% ----------------------------------------------------------------------------------------- ??? [54] 100.0% [85] 980(0.2%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [92] 100.0% ----------------------------------------------------------------------------------------- map [62] 100.0% [86] 662(0.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 combine-aterms [109] 50.5% f45 [42] 49.5% ----------------------------------------------------------------------------------------- ??? [54] 100.0% [87] 346(0.1%) 0(0.0%) split-atab ...testing/src/core/alt-table.rkt:105:0 for-loop [106] 100.0% ----------------------------------------------------------------------------------------- make-multiplication-subnode [66] 100.0% [88] 342(0.1%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:242:3 mterm->expr [108] 100.0% ----------------------------------------------------------------------------------------- map [62] 100.0% [89] 316(0.1%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 for-loop [110] 100.0% ----------------------------------------------------------------------------------------- map [62] 100.0% [90] 308(0.1%) 308(0.1%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 ----------------------------------------------------------------------------------------- mk-enode! [68] 100.0% [91] 82906(18.1%) 1002(0.2%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [111] 98.0% set [175] 0.4% ----------------------------------------------------------------------------------------- atab-add-altns [85] 3.9% for-loop [71] 96.1% [92] 24998(5.5%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [112] 96.3% override-at-pnts [118] 3.7% ----------------------------------------------------------------------------------------- run-improve50 [2] 1.9% pred [246] 26.8% ??? [67] 71.3% [93] 18260(4.0%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [130] 38.2% make-exacts* [129] 34.2% loop [114] 20.2% for-loop [116] 7.4% ----------------------------------------------------------------------------------------- update-leader! [72] 100.0% [94] 17446(3.8%) 718(0.2%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [113] 95.9% ----------------------------------------------------------------------------------------- taylor-alt [76] 100.0% [95] 6326(1.4%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [154] 100.0% ----------------------------------------------------------------------------------------- for-loop [31] 26.6% for-loop [69] 73.4% [96] 3604(0.8%) 1016(0.2%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [115] 63.2% custom-in-set [225] 8.7% ----------------------------------------------------------------------------------------- atab-pick-alt8 [77] 100.0% [97] 2604(0.6%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [152] 100.0% ----------------------------------------------------------------------------------------- hash-has-key? [70] 100.0% [98] 2276(0.5%) 2276(0.5%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ----------------------------------------------------------------------------------------- ??? [67] 43.0% pred [246] 57.0% [99] 1726(0.4%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 make-exacts* [129] 77.3% loop [130] 22.7% ----------------------------------------------------------------------------------------- list-cartesian-product [73] 100.0% [100] 1672(0.4%) 1672(0.4%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 ----------------------------------------------------------------------------------------- curry* [81] 100.0% [101] 1298(0.3%) 1298(0.3%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ----------------------------------------------------------------------------------------- update-leader! [72] 100.0% [102] 1290(0.3%) 978(0.2%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [124] 24.2% ----------------------------------------------------------------------------------------- ??? [83] 39.3% matcher [132] 60.7% [103] 1254(0.3%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [117] 60.7% *rules* [120] 20.5% f45 [42] 12.4% expression->type [119] 6.4% ----------------------------------------------------------------------------------------- enode-merge! [80] 100.0% [104] 1044(0.2%) 356(0.1%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [173] 65.9% ----------------------------------------------------------------------------------------- enode-merge! [80] 100.0% [105] 632(0.1%) 332(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 for-loop [125] 47.5% ----------------------------------------------------------------------------------------- split-atab [87] 100.0% [106] 346(0.1%) 0(0.0%) for-loop ...t-testing/src/core/alt-table.rkt:106:2 for-loop [122] 100.0% ----------------------------------------------------------------------------------------- atab-pick-alt8 [77] 100.0% [107] 346(0.1%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:69:0 loop [121] 100.0% ----------------------------------------------------------------------------------------- for-loop [88] 100.0% [108] 342(0.1%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 expression->type [119] 100.0% ----------------------------------------------------------------------------------------- simplify-node [86] 100.0% [109] 334(0.1%) 334(0.1%) combine-aterms ...esting/src/core/reduce.rkt:183:0 ----------------------------------------------------------------------------------------- ??? [89] 100.0% [110] 316(0.1%) 0(0.0%) for-loop ...e/alt-testing/src/core/reduce.rkt:62:7 pattern-match [123] 100.0% ----------------------------------------------------------------------------------------- new-enode [91] 100.0% [111] 81262(17.7%) 1600(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [126] 97.6% parse-loop12 [228] 0.4% ----------------------------------------------------------------------------------------- atab-add-altn [92] 100.0% [112] 24068(5.3%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [127] 98.7% ----------------------------------------------------------------------------------------- for-loop [94] 100.0% [113] 16728(3.7%) 0(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [128] 100.0% ----------------------------------------------------------------------------------------- prepare-points [93] 100.0% [114] 3686(0.8%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 loop [130] 50.2% make-exacts* [129] 49.8% ----------------------------------------------------------------------------------------- ??? [96] 100.0% [115] 2276(0.5%) 1598(0.3%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ??? [54] 29.8% ----------------------------------------------------------------------------------------- prepare-points [93] 100.0% [116] 1348(0.3%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [131] 100.0% ----------------------------------------------------------------------------------------- rewriter [103] 100.0% [117] 1254(0.3%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [132] 100.0% ----------------------------------------------------------------------------------------- atab-add-altn [92] 100.0% [118] 930(0.2%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [127] 100.0% ----------------------------------------------------------------------------------------- rewriter [103] 24.2% mterm->expr [108] 25.8% for-loop [134] 50.0% [119] 664(0.1%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [134] 75.8% ??? [54] 24.2% ----------------------------------------------------------------------------------------- rewriter [103] 100.0% [120] 622(0.1%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [135] 100.0% ----------------------------------------------------------------------------------------- loop [121] 25.0% for-loop [136] 25.0% for-loop [137] 25.0% write-json* [107] 25.0% [121] 346(0.1%) 346(0.1%) loop .../share/racket/collects/json/main.rkt:103:2 for-loop [137] 25.0% for-loop [136] 25.0% loop [121] 25.0% ----------------------------------------------------------------------------------------- for-loop [106] 100.0% [122] 346(0.1%) 0(0.0%) for-loop ...-testing/src/core/alt-table.rkt:111:53 loop [133] 100.0% ----------------------------------------------------------------------------------------- for-loop [110] 100.0% [123] 316(0.1%) 316(0.1%) pattern-match ...testing/src/core/matcher.rkt:48:0 ----------------------------------------------------------------------------------------- custom-set-union! [102] 100.0% [124] 312(0.1%) 312(0.1%) for-loop ...cts/racket/private/set-types.rkt:253:4 ----------------------------------------------------------------------------------------- custom-set-intersect! [105] 100.0% [125] 300(0.1%) 300(0.1%) for-loop ...cts/racket/private/set-types.rkt:272:4 ----------------------------------------------------------------------------------------- type-of-enode-expr [111] 100.0% [126] 79322(17.3%) 716(0.2%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [139] 42.8% ??? [157] 29.4% ??? [54] 16.9% ...sting/src/common.rkt:47:2 [160] 10.0% ----------------------------------------------------------------------------------------- override-at-pnts [118] 1.9% pred [246] 4.1% composed [208] 4.8% option-on-expr [159] 7.0% loop [152] 33.3% best-and-tied-at-points [112] 49.0% [127] 48490(10.6%) 300(0.1%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [138] 83.1% eval-prog [196] 16.3% ----------------------------------------------------------------------------------------- for-loop [113] 100.0% [128] 16728(3.7%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [140] 100.0% ----------------------------------------------------------------------------------------- loop [99] 14.2% loop [114] 19.5% prepare-points [93] 66.4% [129] 9422(2.1%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [152] 83.2% eval-prog [196] 16.8% ----------------------------------------------------------------------------------------- loop [99] 4.3% loop [114] 20.1% prepare-points [93] 75.7% [130] 9216(2.0%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [152] 96.1% ??? [145] 3.9% ----------------------------------------------------------------------------------------- for-loop [116] 100.0% [131] 1348(0.3%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 for-loop [142] 75.2% ??? [154] 24.8% ----------------------------------------------------------------------------------------- matcher [132] 15.0% for-loop [141] 35.0% for-loop [117] 50.0% [132] 1254(0.3%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [103] 50.0% for-loop [141] 35.0% matcher [132] 15.0% ----------------------------------------------------------------------------------------- one-iter [17] 49.7% for-loop [122] 50.3% [133] 688(0.2%) 342(0.1%) loop ...ket/collects/racket/private/list.rkt:264:4 ??? [143] 50.3% ----------------------------------------------------------------------------------------- expression->type [119] 100.0% [134] 664(0.1%) 0(0.0%) for-loop ...ie/alt-testing/src/type-check.rkt:52:5 expression->type [119] 74.2% f45 [42] 25.8% ----------------------------------------------------------------------------------------- *rules* [120] 100.0% [135] 622(0.1%) 300(0.1%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 loop [144] 51.8% ----------------------------------------------------------------------------------------- loop [121] 100.0% [136] 346(0.1%) 0(0.0%) for-loop ...e/racket/collects/json/main.rkt:113:13 loop [121] 100.0% ----------------------------------------------------------------------------------------- loop [121] 100.0% [137] 346(0.1%) 0(0.0%) for-loop ...e/racket/collects/json/main.rkt:118:11 loop [121] 100.0% ----------------------------------------------------------------------------------------- errors [127] 100.0% [138] 40294(8.8%) 1994(0.4%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [145] 76.6% ??? [154] 12.0% ulp-difference [149] 5.6% ----------------------------------------------------------------------------------------- f45 [42] 1.8% for-loop [58] 2.8% get-sigs [126] 95.3% [139] 35572(7.8%) 2728(0.6%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [146] 46.3% for-loop [148] 35.6% get/build-late-neg-projection [204] 8.6% ??? [150] 1.8% ----------------------------------------------------------------------------------------- hash-update! [128] 100.0% [140] 16728(3.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [147] 98.1% make-sequence [187] 1.9% ----------------------------------------------------------------------------------------- matcher [132] 100.0% [141] 1254(0.3%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [132] 100.0% ----------------------------------------------------------------------------------------- ??? [131] 100.0% [142] 1014(0.2%) 0(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:231:9 ??? [154] 100.0% ----------------------------------------------------------------------------------------- loop [133] 100.0% [143] 346(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:302:4 ??? [229] 100.0% ----------------------------------------------------------------------------------------- for-loop [135] 100.0% [144] 322(0.1%) 0(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [151] 100.0% ----------------------------------------------------------------------------------------- loop [130] 0.6% ??? [229] 2.3% jloop [6] 7.5% loop [247] 8.0% loop [152] 28.3% for-loop [138] 53.3% [145] 57874(12.6%) 2758(0.6%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [153] 63.5% ??? [154] 15.3% loop [152] 10.5% ??? [164] 6.0% ----------------------------------------------------------------------------------------- ??? [139] 100.0% [146] 16482(3.6%) 984(0.2%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [155] 94.0% ----------------------------------------------------------------------------------------- ??? [140] 100.0% [147] 16418(3.6%) 14772(3.2%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [177] 10.0% ----------------------------------------------------------------------------------------- for-loop [194] 20.2% ??? [139] 79.8% [148] 15886(3.5%) 3334(0.7%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [193] 79.0% ----------------------------------------------------------------------------------------- for-loop [138] 100.0% [149] 2274(0.5%) 1030(0.2%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [198] 28.2% ??? [203] 26.5% ----------------------------------------------------------------------------------------- ??? [139] 100.0% [150] 646(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [156] 100.0% ----------------------------------------------------------------------------------------- loop [144] 100.0% [151] 322(0.1%) 0(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [198] 100.0% ----------------------------------------------------------------------------------------- parse-loop12 [228] 0.0% loop [130] 0.3% make-exacts* [129] 0.5% point-best-alt [97] 1.5% for-loop [55] 1.6% match-e [41] 1.7% ??? [145] 2.3% option-on-expr [159] 4.0% loop! [158] 6.6% f45 [42] 16.5% loop [152] 64.1% [152] 95990(21.0%) 5870(1.3%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [152] 64.1% option-on-expr [159] 16.5% loop! [158] 6.4% errors [127] 5.4% ??? [154] 1.7% for-loop [9] 0.8% ??? [145] 0.7% foldl [169] 0.7% ??? [164] 0.1% curried [250] 0.1% ??? [229] 0.0% ??? [165] 0.0% set-precompute! [170] 0.0% ----------------------------------------------------------------------------------------- ??? [145] 100.0% [153] 36730(8.0%) 17228(3.8%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [162] 17.4% ??? [178] 12.9% ??? [165] 11.9% bf* [166] 8.9% ...higher-order.rkt:346:33 [168] 2.1% ----------------------------------------------------------------------------------------- loop [182] 0.7% loop [247] 1.0% ??? [131] 1.0% ??? [229] 1.0% jloop [6] 1.1% atab-pick-alt8 [77] 3.1% for-loop [142] 3.2% ??? [221] 3.8% ??? [157] 7.6% for-loop [95] 7.6% f45 [42] 13.3% loop [152] 13.7% for-loop [138] 14.5% ??? [145] 27.2% [154] 32056(7.0%) 3560(0.8%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [157] 63.5% approximate9 [163] 7.6% ??? [236] 6.2% hash-ref! [199] 4.5% best-alt [167] 4.1% ...sting/src/common.rkt:47:2 [160] 3.0% ----------------------------------------------------------------------------------------- ??? [146] 100.0% [155] 15498(3.4%) 698(0.2%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [161] 95.5% ----------------------------------------------------------------------------------------- ??? [150] 100.0% [156] 646(0.1%) 646(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 ----------------------------------------------------------------------------------------- simplify-alt [35] 0.1% for-loop [58] 1.2% get-sigs [126] 2.0% ??? [157] 4.7% ??? [154] 5.7% for-loop [171] 41.2% ??? [67] 44.9% [157] 387588(84.6%) 17930(3.9%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [3] 42.1% for-loop [171] 41.2% ??? [157] 4.7% loop [4] 2.8% ??? [172] 2.3% return/no-unsupplied [198] 1.5% ??? [154] 1.0% ??? [203] 0.8% mk-egraph [185] 0.3% ??? [193] 0.1% dict? [251] 0.0% ----------------------------------------------------------------------------------------- for-loop [75] 5.0% merge-egraph-nodes! [56] 11.5% loop [152] 30.8% for-loop [40] 52.7% [158] 53416(11.7%) 14680(3.2%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [173] 38.1% loop [152] 34.7% set [175] 8.9% update-en-expr [177] 3.8% ----------------------------------------------------------------------------------------- f45 [42] 8.6% loop [152] 91.4% [159] 40722(8.9%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [152] 38.1% sort-context-on-expr [176] 23.7% sindices->spoints [179] 19.3% errors [127] 8.3% err-lsts->split-indices [184] 7.9% pick-errors [188] 1.7% point->alt [190] 1.0% ----------------------------------------------------------------------------------------- f45 [42] 2.0% ??? [154] 6.1% for-loop [58] 40.7% get-sigs [126] 51.2% [160] 15520(3.4%) 5978(1.3%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [180] 34.9% ??? [183] 26.6% ----------------------------------------------------------------------------------------- ??? [155] 100.0% [161] 14800(3.2%) 332(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [174] 97.8% ----------------------------------------------------------------------------------------- ??? [153] 100.0% [162] 6386(1.4%) 4042(0.9%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [203] 20.6% return/no-unsupplied [198] 16.1% ----------------------------------------------------------------------------------------- ??? [154] 100.0% [163] 6326(1.4%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [182] 74.3% f45 [42] 20.3% for-loop [192] 5.4% ----------------------------------------------------------------------------------------- loop [152] 29.0% ??? [145] 71.0% [164] 4856(1.1%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [181] 100.0% ----------------------------------------------------------------------------------------- loop [152] 6.7% ??? [153] 93.3% [165] 4666(1.0%) 4666(1.0%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ----------------------------------------------------------------------------------------- ??? [153] 100.0% [166] 3262(0.7%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [178] 100.0% ----------------------------------------------------------------------------------------- ??? [154] 100.0% [167] 1660(0.4%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 loop [186] 79.0% argmins [191] 21.0% ----------------------------------------------------------------------------------------- ??? [153] 100.0% [168] 754(0.2%) 324(0.1%) ...higher-order.rkt:346:33 (unknown source) ??? [193] 57.0% ----------------------------------------------------------------------------------------- loop [152] 100.0% [169] 634(0.1%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [189] 100.0% ----------------------------------------------------------------------------------------- loop [152] 100.0% [170] 338(0.1%) 0(0.0%) set-precompute! ...ing/src/core/simplify.rkt:193:0 make-sequence [187] 100.0% ----------------------------------------------------------------------------------------- ??? [157] 100.0% [171] 330466(72.2%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [157] 100.0% ----------------------------------------------------------------------------------------- hash-has-key? [70] 40.2% ??? [157] 59.8% [172] 42784(9.3%) 17604(3.8%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [194] 39.1% ??? [216] 12.4% ??? [193] 3.7% successfully-got-the-right-kind-of-function [231] 2.3% arrow-higher-order:lnp [232] 1.4% ----------------------------------------------------------------------------------------- adopt-enode! [104] 3.0% loop! [158] 97.0% [173] 23218(5.1%) 8346(1.8%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [195] 51.4% for-loop [206] 12.6% ----------------------------------------------------------------------------------------- ??? [161] 100.0% [174] 14468(3.2%) 2998(0.7%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [200] 60.2% get/build-late-neg-projection [204] 19.0% ----------------------------------------------------------------------------------------- new-enode [91] 3.0% loop! [158] 97.0% [175] 10230(2.2%) 10230(2.2%) set ...collects/racket/private/set-types.rkt:981:0 ----------------------------------------------------------------------------------------- option-on-expr [159] 100.0% [176] 9632(2.1%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [197] 100.0% ----------------------------------------------------------------------------------------- update-leader! [72] 4.1% for-loop [147] 20.4% for-loop [74] 25.6% loop! [158] 49.8% [177] 8050(1.8%) 8050(1.8%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ----------------------------------------------------------------------------------------- bf* [166] 40.7% ??? [153] 59.3% [178] 8008(1.7%) 392(0.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [202] 95.1% ----------------------------------------------------------------------------------------- option-on-expr [159] 100.0% [179] 7866(1.7%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [201] 100.0% ----------------------------------------------------------------------------------------- ??? [193] 9.4% for-loop [227] 12.2% ...sting/src/common.rkt:47:2 [160] 78.4% [180] 5410(1.2%) 1350(0.3%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [193] 72.0% ??? [236] 12.3% ----------------------------------------------------------------------------------------- ??? [164] 100.0% [181] 4856(1.1%) 2830(0.6%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [219] 41.7% ----------------------------------------------------------------------------------------- approximate9 [163] 100.0% [182] 4700(1.0%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 hash-ref! [199] 78.5% ??? [154] 14.1% get-coeffs [212] 7.4% ----------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [160] 100.0% [183] 4132(0.9%) 1252(0.3%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 assoc-ref [209] 32.3% ??? [203] 29.7% return/no-unsupplied [198] 7.7% ----------------------------------------------------------------------------------------- option-on-expr [159] 100.0% [184] 3236(0.7%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [205] 100.0% ----------------------------------------------------------------------------------------- ??? [157] 100.0% [185] 2666(0.6%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [207] 87.0% mk-enode! [68] 13.0% ----------------------------------------------------------------------------------------- extract-alt [37] 33.0% best-alt [167] 67.0% [186] 1958(0.4%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [208] 100.0% ----------------------------------------------------------------------------------------- ??? [140] 32.0% update-leader! [72] 33.2% set-precompute! [170] 34.8% [187] 970(0.2%) 322(0.1%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [211] 66.8% ----------------------------------------------------------------------------------------- option-on-expr [159] 100.0% [188] 696(0.2%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [210] 100.0% ----------------------------------------------------------------------------------------- foldl [169] 100.0% [189] 634(0.1%) 634(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 ----------------------------------------------------------------------------------------- option-on-expr [159] 100.0% [190] 392(0.1%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [196] 100.0% ----------------------------------------------------------------------------------------- best-alt [167] 100.0% [191] 348(0.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [208] 100.0% ----------------------------------------------------------------------------------------- approximate9 [163] 100.0% [192] 344(0.1%) 0(0.0%) for-loop .../alt-testing/src/core/taylor.rkt:29:18 f45 [42] 100.0% ----------------------------------------------------------------------------------------- ...higher-order.rkt:346:33 [168] 2.1% ??? [157] 3.2% ??? [172] 7.9% ??? [180] 24.9% for-loop [148] 61.8% [193] 20302(4.4%) 3748(0.8%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [213] 60.4% for-loop [227] 11.4% ??? [180] 5.0% ??? [242] 4.8% ----------------------------------------------------------------------------------------- ??? [172] 100.0% [194] 16708(3.6%) 9248(2.0%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [216] 19.7% for-loop [148] 19.2% arrow-higher-order:lnp [232] 1.9% ??? [236] 1.9% successfully-got-the-right-kind-of-function [231] 1.9% ----------------------------------------------------------------------------------------- custom-set-union [173] 100.0% [195] 11936(2.6%) 1618(0.4%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [214] 86.4% ----------------------------------------------------------------------------------------- point->alt [190] 4.0% make-exacts* [129] 16.0% errors [127] 80.0% [196] 9872(2.2%) 4998(1.1%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f45 [42] 46.1% parse-lambda [234] 3.3% ----------------------------------------------------------------------------------------- sort-context-on-expr [176] 100.0% [197] 9632(2.1%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [215] 89.4% loop [247] 10.6% ----------------------------------------------------------------------------------------- ??? [183] 3.4% flag-set? [151] 3.5% ulp-difference [149] 6.9% debug7 [84] 7.3% ??? [162] 11.1% ??? [157] 67.9% [198] 9306(2.0%) 6684(1.5%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [226] 28.2% ----------------------------------------------------------------------------------------- for-loop [38] 0.5% for-loop [23] 0.5% for-loop [24] 0.8% ??? [12] 0.9% ??? [36] 1.4% first-nonzero-exp [27] 1.8% ??? [230] 2.4% taylor-sqrt [11] 2.5% localize-error [52] 3.5% for-loop [20] 5.6% for-loop [21] 5.6% loop [182] 7.1% ??? [7] 7.5% ??? [221] 9.7% ??? [154] 9.9% compile [78] 16.5% ??? [222] 23.6% [199] 8908(1.9%) 2930(0.6%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [222] 26.1% ??? [221] 16.8% simplify [34] 9.8% ??? [7] 8.5% ??? [8] 7.5% ??? [10] 6.1% parse-loop12 [228] 3.5% ??? [230] 2.4% ??? [12] 1.8% ??? [13] 1.6% taylor [64] 0.9% f45 [42] 0.5% ??? [14] 0.5% ----------------------------------------------------------------------------------------- for-loop [174] 100.0% [200] 8714(1.9%) 8714(1.9%) add-list-context ...ontract/private/list.rkt:752:0 ----------------------------------------------------------------------------------------- sindices->spoints [179] 100.0% [201] 7866(1.7%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 sidx->spoint [217] 100.0% ----------------------------------------------------------------------------------------- ??? [178] 100.0% [202] 7616(1.7%) 5620(1.2%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [219] 26.2% ----------------------------------------------------------------------------------------- ulp-difference [149] 8.5% ??? [183] 17.4% ??? [162] 18.6% ??? [157] 55.5% [203] 7062(1.5%) 1944(0.4%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [218] 58.9% ??? [236] 13.6% ----------------------------------------------------------------------------------------- ??? [224] 17.1% ??? [139] 35.4% for-loop [174] 47.5% [204] 5802(1.3%) 690(0.2%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [220] 50.0% ??? [224] 35.4% listof-late-neg-projection [235] 2.8% ----------------------------------------------------------------------------------------- err-lsts->split-indices [184] 100.0% [205] 3236(0.7%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [223] 100.0% ----------------------------------------------------------------------------------------- custom-set-union [173] 100.0% [206] 2936(0.6%) 2936(0.6%) for-loop ...cts/racket/private/set-types.rkt:152:2 ----------------------------------------------------------------------------------------- mk-enode-rec! [207] 42.1% mk-egraph [185] 57.9% [207] 2320(0.5%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode! [68] 57.9% mk-enode-rec! [207] 42.1% ----------------------------------------------------------------------------------------- argmins [191] 15.1% loop [186] 84.9% [208] 2306(0.5%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [127] 100.0% ----------------------------------------------------------------------------------------- ??? [183] 100.0% [209] 1334(0.3%) 1334(0.3%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ----------------------------------------------------------------------------------------- pick-errors [188] 100.0% [210] 696(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [229] 100.0% ----------------------------------------------------------------------------------------- make-sequence [187] 100.0% [211] 648(0.1%) 338(0.1%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [225] 47.8% ----------------------------------------------------------------------------------------- loop [182] 100.0% [212] 348(0.1%) 0(0.0%) get-coeffs ...alt-testing/src/core/taylor.rkt:64:2 listof [233] 100.0% ----------------------------------------------------------------------------------------- ??? [193] 100.0% [213] 12256(2.7%) 638(0.1%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [236] 89.4% ??? [242] 5.4% ----------------------------------------------------------------------------------------- for-loop [195] 100.0% [214] 10318(2.3%) 10318(2.3%) for-loop ...cts/racket/private/set-types.rkt:178:5 ----------------------------------------------------------------------------------------- ??? [197] 100.0% [215] 8614(1.9%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [237] 88.1% loop [247] 11.9% ----------------------------------------------------------------------------------------- for-loop [194] 38.3% ??? [172] 61.7% [216] 8586(1.9%) 4324(0.9%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [239] 49.6% ----------------------------------------------------------------------------------------- loop [201] 100.0% [217] 7866(1.7%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [238] 71.2% pred [246] 28.8% ----------------------------------------------------------------------------------------- ??? [203] 100.0% [218] 4160(0.9%) 3848(0.8%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [245] 7.5% ----------------------------------------------------------------------------------------- bfmul [202] 49.6% real->bigfloat [181] 50.4% [219] 4022(0.9%) 4022(0.9%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ----------------------------------------------------------------------------------------- get/build-late-neg-projection [204] 100.0% [220] 3732(0.8%) 2074(0.5%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [241] 44.4% ----------------------------------------------------------------------------------------- hash-ref! [199] 100.0% [221] 3688(0.8%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 hash-ref! [199] 55.9% ??? [154] 44.1% ----------------------------------------------------------------------------------------- hash-ref! [199] 100.0% [222] 3270(0.7%) 646(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 hash-ref! [199] 93.4% ----------------------------------------------------------------------------------------- add-splitpoint [205] 100.0% [223] 3236(0.7%) 356(0.1%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [240] 89.0% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [204] 100.0% [224] 3046(0.7%) 1058(0.2%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [204] 65.3% ----------------------------------------------------------------------------------------- ??? [211] 10.4% ??? [96] 10.4% match-e [41] 79.2% [225] 2988(0.7%) 2988(0.7%) custom-in-set ...acket/private/set-types.rkt:577:0 ----------------------------------------------------------------------------------------- for-loop [55] 10.9% return/no-unsupplied [198] 89.1% [226] 2944(0.6%) 2944(0.6%) filter ...t/collects/racket/private/list.rkt:256:2 ----------------------------------------------------------------------------------------- ??? [193] 100.0% [227] 2308(0.5%) 990(0.2%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [180] 57.1% ----------------------------------------------------------------------------------------- hash-ref! [199] 15.5% simplify [34] 16.7% type-of-enode-expr [111] 16.9% map [62] 50.9% [228] 2014(0.4%) 1702(0.4%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [152] 15.5% ----------------------------------------------------------------------------------------- ??? [143] 20.6% loop [152] 38.0% for-loop [210] 41.4% [229] 1680(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [145] 80.0% ??? [154] 20.0% ----------------------------------------------------------------------------------------- hash-ref! [199] 100.0% [230] 1376(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:357:30 hash-ref! [199] 100.0% ----------------------------------------------------------------------------------------- for-loop [194] 24.5% ??? [172] 75.5% [231] 1276(0.3%) 634(0.1%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [244] 50.3% ----------------------------------------------------------------------------------------- for-loop [194] 34.6% ??? [172] 65.4% [232] 930(0.2%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [243] 100.0% ----------------------------------------------------------------------------------------- get-coeffs [212] 100.0% [233] 348(0.1%) 348(0.1%) listof .../racket/contract/private/guts.rkt:411:15 ----------------------------------------------------------------------------------------- eval-prog [196] 100.0% [234] 326(0.1%) 326(0.1%) parse-lambda ...llects/racket/private/kw.rkt:437:2 ----------------------------------------------------------------------------------------- get/build-late-neg-projection [204] 100.0% [235] 322(0.1%) 322(0.1%) listof-late-neg-projection ...ivate/list.rkt:162:0 ----------------------------------------------------------------------------------------- for-loop [194] 1.9% ??? [203] 5.8% ??? [54] 5.9% ??? [180] 8.1% ??? [154] 12.0% ??? [213] 66.4% [236] 16518(3.6%) 13224(2.9%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [54] 12.0% contract? [252] 4.2% dict? [251] 3.8% ----------------------------------------------------------------------------------------- generic-sort/key [215] 36.0% copying-mergesort [237] 64.0% [237] 7588(1.7%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [237] 64.0% loop [247] 20.6% jloop [6] 15.4% ----------------------------------------------------------------------------------------- sidx->spoint [217] 100.0% [238] 5600(1.2%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [246] 100.0% ----------------------------------------------------------------------------------------- ??? [216] 100.0% [239] 4262(0.9%) 4262(0.9%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ----------------------------------------------------------------------------------------- for-loop [223] 100.0% [240] 2880(0.6%) 2566(0.6%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [250] 10.9% ----------------------------------------------------------------------------------------- contract-struct-name [249] 30.6% ??? [220] 69.4% [241] 1658(0.4%) 1348(0.3%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [249] 49.3% ----------------------------------------------------------------------------------------- ??? [213] 40.3% ??? [193] 59.7% [242] 1632(0.4%) 296(0.1%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [248] 81.9% ----------------------------------------------------------------------------------------- arrow-higher-order:lnp [232] 100.0% [243] 930(0.2%) 930(0.2%) ??? ...et/contract/private/arity-checking.rkt:19:2 ----------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [231]100.0% [244] 642(0.1%) 300(0.1%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [253] 53.3% ----------------------------------------------------------------------------------------- ??? [218] 100.0% [245] 312(0.1%) 312(0.1%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ----------------------------------------------------------------------------------------- sidx->spoint [217] 28.8% binary-search-floats [238] 71.2% [246] 7866(1.7%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [93] 62.1% errors [127] 25.4% loop [99] 12.5% ----------------------------------------------------------------------------------------- ??? [197] 20.5% generic-sort/key [215] 20.7% copying-mergesort [237] 58.7% [247] 4954(1.1%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [145] 93.3% ??? [154] 6.7% ----------------------------------------------------------------------------------------- ??? [242] 100.0% [248] 1336(0.3%) 678(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [254] 49.3% ----------------------------------------------------------------------------------------- build-compound-type-name [241] 100.0% [249] 1326(0.3%) 310(0.1%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [241] 76.6% ----------------------------------------------------------------------------------------- for-loop [240] 31.4% for-loop [55] 32.4% loop [152] 36.2% [250] 1000(0.2%) 1000(0.2%) curried ...cket/collects/racket/function.rkt:71:18 ----------------------------------------------------------------------------------------- ??? [157] 33.2% ??? [236] 66.8% [251] 934(0.2%) 934(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 ----------------------------------------------------------------------------------------- ??? [236] 100.0% [252] 694(0.2%) 694(0.2%) contract? ...acket/contract/private/guts.rkt:109:0 ----------------------------------------------------------------------------------------- arity-checking-wrapper [244] 100.0% [253] 342(0.1%) 342(0.1%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ----------------------------------------------------------------------------------------- ??? [248] 100.0% [254] 658(0.1%) 658(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 -----------------------------------------------------------------------------------------