Profiling results ----------------- Total cpu time observed: 957436ms (out of 960580ms) Number of samples taken: 2902 (once every 330ms) (Hiding functions with self<1.0% and local<2.0%: 14 of 276 hidden) =========================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================== ??? [76] 100.0% [1] 789760(82.5%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [21] 100.0% --------------------------------------------------------------------------- ??? [76] 100.0% [2] 758184(79.2%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [23] 96.3% get-final-combination [25] 3.3% setup-alt-simplified [32] 0.2% prepare-points [90] 0.1% ??? [114] 0.0% --------------------------------------------------------------------------- ??? [172] 100.0% [3] 743994(77.7%) 296(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [22] 98.6% map-enodes [26] 1.3% debug7 [65] 0.0% --------------------------------------------------------------------------- ??? [172] 100.0% [4] 84886(8.9%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [24] 100.0% --------------------------------------------------------------------------- free-variables [252] 1.3% simplify* [168] 2.2% substitute-e [68] 12.3% match-e [53] 84.3% [5] 16440(1.7%) 692(0.1%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [114] 95.8% --------------------------------------------------------------------------- ??? [162] 100.0% [6] 13816(1.4%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [27] 58.1% for-loop [31] 24.2% f172 [151] 10.0% taylor-quotient [45] 7.6% --------------------------------------------------------------------------- map-enodes [26] 3.4% loop [195] 96.6% [7] 9276(1.0%) 2670(0.3%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [29] 53.3% compose [34] 10.5% eval-const-expr [36] 3.9% curried [259] 3.5% --------------------------------------------------------------------------- hash-ref! [173] 100.0% [8] 7378(0.8%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [173] 90.7% ??? [46] 9.3% --------------------------------------------------------------------------- hash-ref! [173] 100.0% [9] 6406(0.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [28] 100.0% --------------------------------------------------------------------------- hash-ref! [173] 100.0% [10] 3376(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [30] 100.0% --------------------------------------------------------------------------- generic-sort/key [248] 16.1% copying-mergesort [254] 83.9% [11] 2156(0.2%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [150] 83.9% errors-score [37] 16.1% --------------------------------------------------------------------------- map [159] 16.5% f172 [151] 83.5% [12] 2004(0.2%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [44] 100.0% --------------------------------------------------------------------------- hash-ref! [173] 100.0% [13] 1974(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [173] 67.4% for-loop [35] 32.6% --------------------------------------------------------------------------- hash-ref! [173] 19.2% map [159] 38.7% f172 [151] 42.1% [14] 1730(0.2%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 loop [195] 59.9% debug-print [60] 40.1% --------------------------------------------------------------------------- for-loop [242] 33.7% loop [195] 66.3% [15] 1618(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [150] 100.0% --------------------------------------------------------------------------- hash-ref! [173] 100.0% [16] 1374(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 for-loop [33] 100.0% --------------------------------------------------------------------------- rewriter [96] 100.0% [17] 986(0.1%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [198] 100.0% --------------------------------------------------------------------------- loop [195] 100.0% [18] 682(0.1%) 0(0.0%) bffma ...e/alt-testing/src/syntax/syntax.rkt:308:0 ...higher-order.rkt:346:33 [170] 52.2% bf* [165] 47.8% --------------------------------------------------------------------------- loop [171] 100.0% [19] 364(0.0%) 0(0.0%) ??? ...bie/alt-testing/src/core/localize.rkt:43:32 ulp-difference [154] 100.0% --------------------------------------------------------------------------- hash-ref! [173] 100.0% [20] 324(0.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [38] 100.0% --------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [21] 789760(82.5%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [76] 100.0% --------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [22] 733500(76.6%) 9488(1.0%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [40] 77.0% for-loop [41] 21.5% filter [235] 0.0% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [23] 730368(76.3%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [39] 100.0% --------------------------------------------------------------------------- loop [4] 100.0% [24] 84886(8.9%) 664(0.1%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [42] 99.2% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [25] 24814(2.6%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [43] 98.2% extract-alt [49] 1.8% --------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [26] 9892(1.0%) 0(0.0%) map-enodes ...lt-testing/src/core/egraph.rkt:140:0 loop [195] 96.8% for-loop [7] 3.2% --------------------------------------------------------------------------- approximate9 [6] 100.0% [27] 8034(0.8%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 hash-ref! [173] 100.0% --------------------------------------------------------------------------- ??? [9] 100.0% [28] 6406(0.7%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 hash-ref! [173] 90.9% simplify [44] 4.7% ??? [46] 4.4% --------------------------------------------------------------------------- for-loop [7] 100.0% [29] 4948(0.5%) 3340(0.3%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 for-loop [48] 25.5% ??? [114] 7.0% --------------------------------------------------------------------------- ??? [10] 100.0% [30] 3376(0.4%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [173] 100.0% --------------------------------------------------------------------------- approximate9 [6] 100.0% [31] 3344(0.3%) 0(0.0%) for-loop .../alt-testing/src/core/taylor.rkt:29:18 f172 [151] 69.3% taylor-quotient [45] 30.7% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [32] 1682(0.2%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [47] 100.0% --------------------------------------------------------------------------- ??? [16] 100.0% [33] 1374(0.1%) 688(0.1%) for-loop ...alt-testing/src/core/taylor.rkt:324:46 hash-ref! [173] 26.3% simplify [44] 23.6% --------------------------------------------------------------------------- for-loop [7] 100.0% [34] 976(0.1%) 976(0.1%) compose ...collects/racket/private/list.rkt:385:12 --------------------------------------------------------------------------- ??? [13] 100.0% [35] 644(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [173] 51.9% ??? [46] 48.1% --------------------------------------------------------------------------- for-loop [7] 100.0% [36] 358(0.0%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f172 [151] 100.0% --------------------------------------------------------------------------- jloop [11] 100.0% [37] 348(0.0%) 0(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 loop [195] 100.0% --------------------------------------------------------------------------- ??? [20] 100.0% [38] 324(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [50] 100.0% --------------------------------------------------------------------------- for-loop [23] 100.0% [39] 730368(76.3%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [51] 92.3% finalize-iter! [55] 4.2% gen-series! [57] 1.9% choose-best-alt! [58] 1.1% localize-error [62] 0.2% gen-rewrites! [64] 0.2% --------------------------------------------------------------------------- one-iter [22] 100.0% [40] 564552(59.0%) 5194(0.5%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [52] 90.2% match-e [53] 7.4% update-leader! [78] 1.2% reduce-to-single! [63] 0.3% --------------------------------------------------------------------------- for-loop [41] 48.9% one-iter [22] 51.1% [41] 157510(16.5%) 35516(3.7%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [41] 48.9% match-e [53] 38.7% --------------------------------------------------------------------------- pass [24] 100.0% [42] 84222(8.8%) 700(0.1%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [54] 74.8% loop [56] 17.8% for-loop [59] 6.2% make-sequence [128] 0.4% --------------------------------------------------------------------------- get-final-combination [25] 100.0% [43] 24374(2.5%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f172 [151] 100.0% --------------------------------------------------------------------------- for-loop [28] 2.5% for-loop [33] 2.7% ??? [162] 2.9% loop [195] 5.8% taylor-invert [12] 16.5% hash-ref! [173] 69.7% [44] 12120(1.3%) 368(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f172 [151] 66.7% debug-print [60] 22.3% debug7 [65] 5.4% simplify-node [166] 2.5% --------------------------------------------------------------------------- f172 [151] 12.6% for-loop [31] 43.2% approximate9 [6] 44.2% [45] 2380(0.2%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [61] 100.0% --------------------------------------------------------------------------- for-loop [35] 15.2% ??? [8] 33.5% for-loop [28] 51.3% [46] 2042(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [173] 100.0% --------------------------------------------------------------------------- setup-alt-simplified [32] 100.0% [47] 1682(0.2%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [172] 100.0% --------------------------------------------------------------------------- setfindf [29] 100.0% [48] 1262(0.1%) 1262(0.1%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 --------------------------------------------------------------------------- get-final-combination [25] 100.0% [49] 440(0.0%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 loop [188] 100.0% --------------------------------------------------------------------------- for-loop [38] 100.0% [50] 324(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [173] 100.0% --------------------------------------------------------------------------- run-iter! [39] 100.0% [51] 673994(70.4%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [66] 100.0% --------------------------------------------------------------------------- for-loop [40] 100.0% [52] 509060(53.2%) 964(0.1%) for-loop ...t-testing/src/core/simplify.rkt:148:10 merge-egraph-nodes! [67] 34.0% mk-enode! [77] 31.1% substitute-e [68] 20.5% loop! [205] 13.1% list-member? [175] 1.1% --------------------------------------------------------------------------- for-loop [40] 15.3% for-loop [79] 26.9% for-loop [41] 57.8% [53] 163686(17.1%) 54586(5.7%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [69] 47.1% for-loop [79] 8.0% ??? [114] 7.0% list-cartesian-product [81] 3.3% variable? [5] 3.3% loop [195] 2.0% custom-in-set [139] 0.4% curry* [86] 0.4% --------------------------------------------------------------------------- for-loop [42] 100.0% [54] 63028(6.6%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [70] 90.0% expression-cost [72] 10.0% --------------------------------------------------------------------------- run-iter! [39] 100.0% [55] 30500(3.2%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [114] 100.0% --------------------------------------------------------------------------- for-loop [42] 100.0% [56] 14964(1.6%) 322(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [70] 93.6% expression-cost [72] 4.2% --------------------------------------------------------------------------- run-iter! [39] 100.0% [57] 14162(1.5%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [71] 100.0% --------------------------------------------------------------------------- run-iter! [39] 100.0% [58] 8384(0.9%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [114] 100.0% --------------------------------------------------------------------------- for-loop [42] 100.0% [59] 5228(0.5%) 5228(0.5%) for-loop ...t-testing/src/core/simplify.rkt:217:13 --------------------------------------------------------------------------- taylor [14] 20.4% simplify [44] 79.6% [60] 3402(0.4%) 1726(0.2%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 for-loop [73] 49.3% --------------------------------------------------------------------------- taylor-quotient [45] 100.0% [61] 2380(0.2%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [173] 100.0% --------------------------------------------------------------------------- run-iter! [39] 100.0% [62] 1716(0.2%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [173] 79.7% ??? [233] 20.3% --------------------------------------------------------------------------- for-loop [40] 100.0% [63] 1650(0.2%) 1318(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [75] 20.1% --------------------------------------------------------------------------- run-iter! [39] 100.0% [64] 1612(0.2%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 for-loop [74] 100.0% --------------------------------------------------------------------------- iterate-egraph!13 [3] 31.7% simplify [44] 68.3% [65] 964(0.1%) 658(0.1%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 ??? [114] 31.7% --------------------------------------------------------------------------- simplify! [51] 98.8% [66] 682132(71.2%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [76] 100.0% --------------------------------------------------------------------------- merge-egraph-nodes! [67] 2.2% for-loop [80] 4.8% for-loop [52] 92.9% [67] 172896(18.1%) 1298(0.1%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [78] 64.4% loop! [205] 10.8% for-loop [82] 8.5% for-loop [80] 8.5% enode-merge! [85] 2.7% merge-egraph-nodes! [67] 2.2% for-loop [198] 1.6% make-sequence [128] 0.6% --------------------------------------------------------------------------- substitute-e [68] 5.8% for-loop [52] 94.2% [68] 104570(10.9%) 2394(0.3%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [77] 88.3% substitute-e [68] 5.8% ??? [114] 3.1% variable? [5] 0.8% --------------------------------------------------------------------------- match-e [53] 100.0% [69] 101384(10.6%) 34316(3.6%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [79] 58.3% list-cartesian-product [81] 9.0% loop [195] 2.3% curry* [86] 0.7% filter [235] 0.6% foldl [212] 0.5% curried [259] 0.3% --------------------------------------------------------------------------- loop [56] 19.8% argmin [54] 80.2% [70] 70750(7.4%) 4204(0.4%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [172] 70.9% ...sting/src/common.rkt:47:2 [117] 20.9% ??? [116] 2.3% --------------------------------------------------------------------------- gen-series! [57] 100.0% [71] 14162(1.5%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [83] 100.0% --------------------------------------------------------------------------- loop [56] 9.1% argmin [54] 90.9% [72] 6920(0.7%) 314(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [84] 95.5% --------------------------------------------------------------------------- debug-print [60] 100.0% [73] 1676(0.2%) 1676(0.2%) for-loop ...herbie/alt-testing/src/debug.rkt:113:2 --------------------------------------------------------------------------- gen-rewrites! [64] 100.0% [74] 1612(0.2%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:138:11 ??? [87] 100.0% --------------------------------------------------------------------------- reduce-to-single! [63] 100.0% [75] 332(0.0%) 332(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 --------------------------------------------------------------------------- for-loop [66] 24.7% run [21] 29.9% [76] 944062(98.6%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [172] 39.9% profile-thunk16 [1] 29.9% run-improve50 [2] 28.3% prepare-points [90] 1.7% loop [97] 0.1% --------------------------------------------------------------------------- mk-egraph [187] 0.1% mk-enode-rec! [199] 1.1% substitute-e [68] 36.4% for-loop [52] 62.4% [77] 253800(26.5%) 16824(1.8%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [88] 90.5% hash-has-key? [121] 1.9% --------------------------------------------------------------------------- for-loop [40] 5.6% merge-egraph-nodes! [67] 94.4% [78] 123346(12.9%) 6904(0.7%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [89] 90.7% custom-set-union! [95] 1.6% update-en-expr [218] 1.3% make-sequence [128] 0.3% hash-ref! [173] 0.3% --------------------------------------------------------------------------- match-e [53] 25.4% for-loop [69] 74.6% [79] 85366(8.9%) 4038(0.4%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [53] 92.4% ??? [94] 4.0% --------------------------------------------------------------------------- merge-egraph-nodes! [67] 100.0% [80] 22994(2.4%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [67] 71.8% loop! [205] 28.2% --------------------------------------------------------------------------- match-e [53] 26.0% list-cartesian-product [81] 27.9% for-loop [69] 46.1% [81] 18258(1.9%) 14580(1.5%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [81] 27.9% for-loop [93] 14.7% --------------------------------------------------------------------------- merge-egraph-nodes! [67] 100.0% [82] 14918(1.6%) 11778(1.2%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [218] 21.0% --------------------------------------------------------------------------- for-loop [71] 100.0% [83] 14162(1.5%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [91] 100.0% --------------------------------------------------------------------------- expression-cost [72] 100.0% [84] 6606(0.7%) 358(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [173] 94.6% --------------------------------------------------------------------------- merge-egraph-nodes! [67] 100.0% [85] 4866(0.5%) 360(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [92] 79.0% custom-set-intersect! [99] 13.6% --------------------------------------------------------------------------- match-e [53] 39.7% for-loop [69] 60.3% [86] 1632(0.2%) 656(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [98] 59.8% --------------------------------------------------------------------------- for-loop [74] 100.0% [87] 1612(0.2%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [96] 100.0% --------------------------------------------------------------------------- mk-enode! [77] 100.0% [88] 229782(24.0%) 1332(0.1%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [100] 98.3% set [219] 0.7% --------------------------------------------------------------------------- update-leader! [78] 100.0% [89] 111886(11.7%) 2900(0.3%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [101] 96.8% update-en-expr [218] 0.6% --------------------------------------------------------------------------- run-improve50 [2] 2.9% ??? [76] 97.1% [90] 33096(3.5%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [110] 58.3% make-exacts* [111] 22.1% loop [102] 17.5% for-loop [105] 2.1% --------------------------------------------------------------------------- taylor-alt [83] 100.0% [91] 14162(1.5%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [162] 100.0% --------------------------------------------------------------------------- enode-merge! [85] 100.0% [92] 3842(0.4%) 1626(0.2%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [217] 57.7% --------------------------------------------------------------------------- list-cartesian-product [81] 100.0% [93] 3678(0.4%) 3678(0.4%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 --------------------------------------------------------------------------- for-loop [79] 100.0% [94] 3398(0.4%) 1700(0.2%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [103] 50.0% --------------------------------------------------------------------------- update-leader! [78] 100.0% [95] 1942(0.2%) 1588(0.2%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [106] 18.2% --------------------------------------------------------------------------- ??? [87] 31.0% matcher [112] 69.0% [96] 1612(0.2%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [104] 69.0% f172 [151] 16.2% *rules* [17] 14.8% --------------------------------------------------------------------------- ??? [76] 100.0% [97] 1508(0.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 loop [102] 50.0% make-exacts* [111] 26.8% loop [110] 23.2% --------------------------------------------------------------------------- curry* [86] 100.0% [98] 976(0.1%) 976(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 --------------------------------------------------------------------------- enode-merge! [85] 100.0% [99] 664(0.1%) 344(0.0%) custom-set-intersect! ...ivate/set-types.rkt:269:0 for-loop [107] 48.2% --------------------------------------------------------------------------- new-enode [88] 100.0% [100] 225842(23.6%) 3914(0.4%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [108] 98.1% parse-loop12 [185] 0.2% --------------------------------------------------------------------------- for-loop [89] 100.0% [101] 108314(11.3%) 1028(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [109] 99.1% --------------------------------------------------------------------------- loop [97] 11.5% prepare-points [90] 88.5% [102] 6552(0.7%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [111] 61.2% loop [110] 38.8% --------------------------------------------------------------------------- ??? [94] 100.0% [103] 1698(0.2%) 672(0.1%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ??? [114] 60.4% --------------------------------------------------------------------------- rewriter [96] 100.0% [104] 1612(0.2%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [112] 100.0% --------------------------------------------------------------------------- prepare-points [90] 100.0% [105] 682(0.1%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [113] 100.0% --------------------------------------------------------------------------- custom-set-union! [95] 100.0% [106] 354(0.0%) 354(0.0%) for-loop ...cts/racket/private/set-types.rkt:253:4 --------------------------------------------------------------------------- custom-set-intersect! [99] 100.0% [107] 320(0.0%) 320(0.0%) for-loop ...cts/racket/private/set-types.rkt:272:4 --------------------------------------------------------------------------- type-of-enode-expr [100] 100.0% [108] 221582(23.1%) 3896(0.4%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [116] 38.9% ??? [172] 33.6% ??? [114] 14.1% ...sting/src/common.rkt:47:2 [117] 11.6% --------------------------------------------------------------------------- for-loop [101] 100.0% [109] 107286(11.2%) 960(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [115] 99.1% --------------------------------------------------------------------------- loop [97] 1.6% loop [102] 11.5% prepare-points [90] 87.0% [110] 22194(2.3%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [195] 98.4% ??? [150] 1.6% --------------------------------------------------------------------------- loop [97] 3.4% loop [102] 34.2% prepare-points [90] 62.4% [111] 11728(1.2%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [195] 96.6% eval-prog [149] 3.4% --------------------------------------------------------------------------- for-loop [118] 23.1% matcher [112] 26.9% for-loop [104] 50.0% [112] 1612(0.2%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [96] 50.0% matcher [112] 26.9% for-loop [118] 23.1% --------------------------------------------------------------------------- for-loop [105] 100.0% [113] 682(0.1%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 for-loop [119] 100.0% --------------------------------------------------------------------------- debug7 [65] 0.3% setfindf [29] 0.3% run-improve50 [2] 0.3% ??? [256] 0.7% for-loop [103] 0.9% substitute-e [68] 6.6% choose-best-alt! [58] 7.0% variable? [5] 13.3% match-e [53] 19.1% finalize-iter! [55] 25.2% get-sigs [108] 26.4% [114] 118420(12.4%) 36824(3.8%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [121] 36.0% for-loop [124] 24.2% atab-pick-alt8 [127] 7.0% atab-add-altns [129] 1.3% ??? [256] 0.5% --------------------------------------------------------------------------- hash-update! [109] 100.0% [115] 106326(11.1%) 1306(0.1%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [120] 97.8% make-sequence [128] 1.0% --------------------------------------------------------------------------- ??? [162] 1.0% for-loop [70] 1.8% get-sigs [108] 97.2% [116] 88752(9.3%) 2770(0.3%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [123] 45.6% for-loop [122] 41.9% get/build-late-neg-projection [147] 9.0% coerce-contract [130] 0.4% --------------------------------------------------------------------------- ??? [162] 1.2% f172 [151] 1.6% for-loop [70] 35.4% get-sigs [108] 61.8% [117] 41762(4.4%) 15078(1.6%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [125] 31.3% ??? [126] 30.1% coerce-contract [130] 2.5% --------------------------------------------------------------------------- matcher [112] 100.0% [118] 1286(0.1%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [112] 100.0% --------------------------------------------------------------------------- ??? [113] 100.0% [119] 682(0.1%) 0(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:231:9 ??? [162] 100.0% --------------------------------------------------------------------------- ??? [115] 100.0% [120] 103980(10.9%) 91976(9.6%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [218] 11.5% --------------------------------------------------------------------------- mk-enode! [77] 10.1% ??? [114] 89.9% [121] 48186(5.0%) 15106(1.6%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [181] 65.3% ??? [189] 3.3% --------------------------------------------------------------------------- for-loop [196] 19.9% ??? [116] 80.1% [122] 46476(4.9%) 7930(0.8%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [197] 79.6% ??? [224] 3.4% --------------------------------------------------------------------------- ??? [116] 100.0% [123] 40466(4.2%) 4834(0.5%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [131] 88.1% --------------------------------------------------------------------------- ??? [114] 100.0% [124] 29314(3.1%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:53:2 atab-add-altn [132] 100.0% --------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [117] 100.0% [125] 13066(1.4%) 3120(0.3%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [253] 38.5% assoc-ref [134] 22.8% return/no-unsupplied [220] 14.8% --------------------------------------------------------------------------- for-loop [210] 8.9% ??? [197] 10.0% ...sting/src/common.rkt:47:2 [117] 81.1% [126] 12586(1.3%) 3494(0.4%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [197] 63.1% ??? [256] 10.2% ??? [211] 7.8% --------------------------------------------------------------------------- ??? [114] 100.0% [127] 8384(0.9%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:64:0 point-best-alt [133] 63.9% ??? [162] 24.2% write-json* [135] 7.6% errors [142] 4.4% --------------------------------------------------------------------------- for-loop [42] 11.2% update-leader! [78] 13.3% merge-egraph-nodes! [67] 36.8% ??? [115] 38.6% [128] 2692(0.3%) 2390(0.2%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [136] 11.2% --------------------------------------------------------------------------- ??? [114] 100.0% [129] 1554(0.2%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [132] 100.0% --------------------------------------------------------------------------- ??? [116] 24.0% ...sting/src/common.rkt:47:2 [117] 76.0% [130] 1358(0.1%) 1358(0.1%) coerce-contract ...contract/private/guts.rkt:257:0 --------------------------------------------------------------------------- ??? [123] 100.0% [131] 35632(3.7%) 1332(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [137] 96.3% --------------------------------------------------------------------------- atab-add-altns [129] 5.0% for-loop [124] 95.0% [132] 30868(3.2%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [138] 95.9% override-at-pnts [140] 4.1% --------------------------------------------------------------------------- atab-pick-alt8 [127] 100.0% [133] 5354(0.6%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [195] 100.0% --------------------------------------------------------------------------- ??? [125] 100.0% [134] 2982(0.3%) 2982(0.3%) assoc-ref ...collects/racket/private/dict.rkt:56:0 --------------------------------------------------------------------------- atab-pick-alt8 [127] 100.0% [135] 634(0.1%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:69:0 loop [141] 100.0% --------------------------------------------------------------------------- make-sequence [128] 100.0% [136] 302(0.0%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [139] 100.0% --------------------------------------------------------------------------- ??? [131] 100.0% [137] 34300(3.6%) 1004(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [143] 97.1% --------------------------------------------------------------------------- atab-add-altn [132] 100.0% [138] 29594(3.1%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [142] 98.1% --------------------------------------------------------------------------- ??? [136] 23.1% match-e [53] 76.9% [139] 1310(0.1%) 1310(0.1%) custom-in-set ...acket/private/set-types.rkt:577:0 --------------------------------------------------------------------------- atab-add-altn [132] 100.0% [140] 1274(0.1%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [142] 100.0% --------------------------------------------------------------------------- for-loop [144] 33.3% for-loop [145] 33.3% write-json* [135] 33.3% [141] 634(0.1%) 634(0.1%) loop .../share/racket/collects/json/main.rkt:103:2 for-loop [145] 33.3% for-loop [144] 33.3% --------------------------------------------------------------------------- atab-pick-alt8 [127] 0.7% override-at-pnts [140] 2.5% composed [200] 4.8% option-on-expr [208] 9.7% loop [195] 25.8% best-and-tied-at-points [138] 56.5% [142] 51400(5.4%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [146] 88.4% eval-prog [149] 11.6% --------------------------------------------------------------------------- ??? [137] 100.0% [143] 33296(3.5%) 7222(0.8%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [148] 45.0% get/build-late-neg-projection [147] 33.3% --------------------------------------------------------------------------- loop [141] 100.0% [144] 634(0.1%) 0(0.0%) for-loop ...e/racket/collects/json/main.rkt:113:13 loop [141] 100.0% --------------------------------------------------------------------------- loop [141] 100.0% [145] 634(0.1%) 0(0.0%) for-loop ...e/racket/collects/json/main.rkt:118:11 loop [141] 100.0% --------------------------------------------------------------------------- errors [142] 100.0% [146] 45446(4.7%) 2648(0.3%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [150] 87.7% ??? [162] 4.8% ulp-difference [154] 1.7% --------------------------------------------------------------------------- ??? [153] 16.4% ??? [116] 24.9% for-loop [143] 58.2% [147] 19046(2.0%) 2940(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [152] 66.3% ??? [153] 19.7% --------------------------------------------------------------------------- for-loop [143] 100.0% [148] 14998(1.6%) 14998(1.6%) add-list-context ...ontract/private/list.rkt:752:0 --------------------------------------------------------------------------- point->alt [245] 3.7% sindices->spoints [231] 4.0% make-exacts* [111] 5.9% errors [142] 86.4% [149] 6888(0.7%) 1770(0.2%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f172 [151] 53.1% hash-ref! [173] 11.1% ??? [155] 5.3% go [156] 4.8% --------------------------------------------------------------------------- loop [110] 0.4% ??? [15] 2.0% jloop [11] 2.2% loop [258] 6.1% loop [195] 40.3% for-loop [146] 48.9% [150] 81506(8.5%) 1736(0.2%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [157] 62.7% loop [195] 24.8% ??? [162] 6.3% ??? [209] 4.1% --------------------------------------------------------------------------- free-variables [252] 0.1% append-map [176] 0.3% ??? [169] 0.3% hash-ref! [173] 0.3% for-loop [201] 0.3% for-loop [243] 0.3% approximate9 [6] 0.6% simplify-node [166] 0.6% parse-loop12 [185] 0.7% rewriter [96] 0.8% eval-const-expr [36] 0.9% for-loop [31] 1.8% eval-prog [149] 3.1% map [159] 8.7% f172 [151] 10.1% simplify [44] 10.8% split-table [43] 60.3% [151] 38778(4.1%) 1934(0.2%) f172 .../collects/racket/match/compiler.rkt:507:40 loop [195] 53.3% map [159] 17.0% f172 [151] 10.1% option-on-expr [208] 7.0% ??? [162] 2.6% ...sting/src/common.rkt:47:2 [117] 1.3% append-map [176] 1.0% taylor-invert [12] 1.0% make-keyword-procedure [221] 0.8% taylor-quotient [45] 0.8% ??? [172] 0.4% taylor [14] 0.2% --------------------------------------------------------------------------- get/build-late-neg-projection [147]100.0% [152] 15164(1.6%) 1972(0.2%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [158] 87.0% --------------------------------------------------------------------------- get/build-late-neg-projection [147]100.0% [153] 6986(0.7%) 640(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [147] 90.8% --------------------------------------------------------------------------- ??? [19] 32.0% for-loop [146] 68.0% [154] 1138(0.1%) 806(0.1%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 ??? [253] 29.2% --------------------------------------------------------------------------- eval-prog [149] 100.0% [155] 362(0.0%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [160] 100.0% --------------------------------------------------------------------------- eval-prog [149] 100.0% [156] 334(0.0%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [161] 100.0% --------------------------------------------------------------------------- ??? [150] 100.0% [157] 51140(5.3%) 19608(2.0%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [174] 21.5% ??? [163] 18.5% bf* [165] 11.8% ??? [167] 5.7% ...higher-order.rkt:346:33 [170] 2.4% ??? [224] 1.7% --------------------------------------------------------------------------- contract-struct-name [164] 12.0% ??? [152] 88.0% [158] 13192(1.4%) 8584(0.9%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [164] 43.4% --------------------------------------------------------------------------- for-loop [239] 0.5% ??? [169] 3.0% parse-loop12 [185] 9.7% f172 [151] 85.3% [159] 10818(1.1%) 332(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 f172 [151] 46.4% simplify-node [166] 13.5% parse-loop12 [185] 9.4% ??? [169] 9.3% simplify* [168] 8.9% loop [171] 3.4% ??? [162] 3.0% taylor [14] 2.6% taylor-invert [12] 1.0% make-multiplication-node [214] 0.5% --------------------------------------------------------------------------- ??? [155] 100.0% [160] 362(0.0%) 362(0.0%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 --------------------------------------------------------------------------- go [156] 10.0% loop [161] 90.0% [161] 334(0.0%) 334(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [161] 90.0% --------------------------------------------------------------------------- map [159] 0.8% for-loop [119] 1.8% atab-pick-alt8 [127] 3.5% for-loop [146] 4.7% ??? [183] 6.9% f172 [151] 7.7% ??? [150] 13.3% ??? [172] 14.8% for-loop [91] 14.8% loop [195] 31.7% [162] 38736(4.0%) 3760(0.4%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [172] 57.2% approximate9 [6] 14.4% hash-ref! [173] 6.9% ??? [256] 4.2% best-alt [177] 3.5% ??? [116] 2.3% ...sting/src/common.rkt:47:2 [117] 1.3% ??? [197] 0.6% simplify [44] 0.4% --------------------------------------------------------------------------- ??? [157] 100.0% [163] 9450(1.0%) 4602(0.5%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [253] 28.8% return/no-unsupplied [220] 19.3% list-member? [175] 3.1% --------------------------------------------------------------------------- build-compound-type-name [158] 100.0% [164] 6832(0.7%) 4608(0.5%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [158] 39.5% --------------------------------------------------------------------------- bffma [18] 5.1% ??? [157] 94.9% [165] 6374(0.7%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [174] 100.0% --------------------------------------------------------------------------- simplify [44] 10.1% map [159] 89.9% [166] 2984(0.3%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 append-map [176] 65.8% f172 [151] 23.2% gather-additive-terms6 [179] 11.1% --------------------------------------------------------------------------- ??? [157] 100.0% [167] 2916(0.3%) 2916(0.3%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 --------------------------------------------------------------------------- map [159] 100.0% [168] 2028(0.2%) 626(0.1%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 ??? [178] 51.6% variable? [5] 17.6% --------------------------------------------------------------------------- map [159] 35.8% loop [195] 64.2% [169] 1692(0.2%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [173] 78.5% f172 [151] 19.1% map [159] 2.4% --------------------------------------------------------------------------- bffma [18] 22.3% ??? [157] 77.7% [170] 1594(0.2%) 0(0.0%) ...higher-order.rkt:346:33 (unknown source) ??? [197] 100.0% --------------------------------------------------------------------------- map [159] 3.8% loop [171] 96.2% [171] 364(0.0%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [171] 96.2% ??? [19] 3.8% --------------------------------------------------------------------------- f172 [151] 0.0% simplify-alt [47] 0.1% for-loop [70] 1.9% get-sigs [108] 2.9% ??? [162] 3.2% ??? [172] 5.5% for-loop [180] 40.6% ??? [76] 45.4% [172] 864744(90.3%) 37010(3.9%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [3] 41.6% for-loop [180] 40.6% ??? [172] 5.5% loop [4] 3.9% ??? [181] 3.3% ??? [162] 1.2% return/no-unsupplied [220] 0.8% ??? [253] 0.5% mk-egraph [187] 0.2% *simplify-rules* [191] 0.1% ??? [197] 0.0% extract-smallest [193] 0.0% dict? [260] 0.0% ??? [189] 0.0% --------------------------------------------------------------------------- for-loop [33] 0.1% for-loop [35] 0.1% for-loop [50] 0.2% ??? [13] 0.6% loop [195] 1.1% ??? [46] 1.1% update-leader! [78] 1.8% localize-error [62] 1.9% eval-prog [149] 2.9% for-loop [30] 3.9% ??? [8] 4.3% first-nonzero-exp [61] 4.6% ??? [169] 5.3% ??? [162] 5.4% loop [27] 5.4% for-loop [28] 9.3% compile [84] 14.5% ??? [184] 18.1% ??? [183] 19.4% [173] 19136(2.0%) 5344(0.6%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [183] 24.8% ??? [184] 22.5% ??? [9] 9.9% simplify [44] 8.7% parse-loop12 [185] 7.1% ??? [8] 4.9% ??? [10] 3.9% bigfloat-hash [192] 1.1% ??? [13] 0.9% ??? [16] 0.6% taylor [14] 0.3% f172 [151] 0.3% ??? [20] 0.2% --------------------------------------------------------------------------- bf* [165] 36.7% ??? [157] 63.3% [174] 17378(1.8%) 2812(0.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [182] 83.8% --------------------------------------------------------------------------- ??? [163] 4.9% for-loop [52] 95.1% [175] 5954(0.6%) 604(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [186] 73.7% member [190] 16.2% --------------------------------------------------------------------------- f172 [151] 17.4% append-map [176] 37.5% simplify-node [166] 45.1% [176] 2868(0.3%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 parse-loop12 [185] 55.1% append-map [176] 37.5% f172 [151] 5.0% free-variables [252] 2.5% --------------------------------------------------------------------------- ??? [162] 100.0% [177] 2028(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 loop [188] 84.6% argmins [194] 15.4% --------------------------------------------------------------------------- simplify* [168] 100.0% [178] 1046(0.1%) 704(0.1%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [257] 32.7% --------------------------------------------------------------------------- simplify-node [166] 100.0% [179] 330(0.0%) 330(0.0%) gather-additive-terms6 ...src/core/reduce.rkt:72:0 --------------------------------------------------------------------------- ??? [172] 100.0% [180] 739478(77.2%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [172] 100.0% --------------------------------------------------------------------------- hash-has-key? [121] 27.1% ??? [172] 72.9% [181] 115994(12.1%) 45490(4.8%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [196] 45.6% ??? [207] 12.7% arrow-higher-order:lnp [213] 1.4% ??? [197] 1.1% --------------------------------------------------------------------------- ??? [174] 100.0% [182] 14566(1.5%) 10184(1.1%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [234] 30.1% --------------------------------------------------------------------------- hash-ref! [173] 100.0% [183] 8034(0.8%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 hash-ref! [173] 75.4% ??? [162] 24.6% --------------------------------------------------------------------------- hash-ref! [173] 100.0% [184] 6332(0.7%) 1606(0.2%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 hash-ref! [173] 83.5% loop [195] 6.4% --------------------------------------------------------------------------- parse-loop12 [185] 2.1% type-of-enode-expr [100] 6.5% map [159] 23.3% hash-ref! [173] 25.7% append-map [176] 42.5% [185] 5332(0.6%) 976(0.1%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 for-loop [201] 30.8% loop [195] 19.7% f172 [151] 11.3% parse-app [203] 6.3% map [159] 6.0% make-multiplication-node [214] 5.6% parse-loop12 [185] 2.1% --------------------------------------------------------------------------- list-member? [175] 100.0% [186] 4386(0.5%) 4386(0.5%) loop (unknown source) --------------------------------------------------------------------------- ??? [172] 100.0% [187] 3180(0.3%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [199] 90.1% mk-enode! [77] 9.9% --------------------------------------------------------------------------- extract-alt [49] 20.4% best-alt [177] 79.6% [188] 2156(0.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [200] 100.0% --------------------------------------------------------------------------- ??? [172] 17.0% hash-has-key? [121] 83.0% [189] 1940(0.2%) 1940(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 --------------------------------------------------------------------------- list-member? [175] 100.0% [190] 964(0.1%) 964(0.1%) member (unknown source) --------------------------------------------------------------------------- ??? [172] 100.0% [191] 954(0.1%) 324(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 for-loop [198] 66.0% --------------------------------------------------------------------------- hash-ref! [173] 100.0% [192] 404(0.0%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 sig+exp->bigfloat [202] 100.0% --------------------------------------------------------------------------- ??? [172] 100.0% [193] 322(0.0%) 0(0.0%) extract-smallest ...ng/src/core/simplify.rkt:213:0 hash-keys [204] 100.0% --------------------------------------------------------------------------- best-alt [177] 100.0% [194] 312(0.0%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [200] 100.0% --------------------------------------------------------------------------- errors-score [37] 0.0% loop [110] 0.1% ??? [184] 0.3% parse-loop12 [185] 0.3% make-exacts* [111] 0.4% taylor [14] 0.7% map-enodes [26] 1.2% for-loop [69] 1.7% option-on-expr [208] 1.8% point-best-alt [133] 1.9% match-e [53] 2.8% ??? [150] 5.3% f172 [151] 6.6% loop! [205] 10.8% loop [195] 66.2% [195] 149218(15.6%) 12708(1.3%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [195] 66.2% loop! [205] 9.8% option-on-expr [208] 6.6% ??? [162] 4.1% errors [142] 3.6% for-loop [7] 1.2% foldl [212] 1.1% simplify [44] 0.5% ??? [150] 0.4% curried [259] 0.4% ??? [169] 0.3% hash-ref! [173] 0.3% ??? [209] 0.1% ??? [15] 0.0% bffma [18] 0.0% --------------------------------------------------------------------------- ??? [181] 100.0% [196] 52916(5.5%) 26482(2.8%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [207] 25.7% for-loop [122] 17.5% ??? [211] 4.2% arrow-higher-order:lnp [213] 1.2% --------------------------------------------------------------------------- ??? [162] 0.4% ??? [172] 2.4% ??? [181] 2.5% ...higher-order.rkt:346:33 [170] 3.1% ??? [126] 20.0% for-loop [122] 71.7% [197] 51612(5.4%) 8758(0.9%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [206] 68.5% for-loop [210] 6.8% ??? [126] 4.9% ??? [256] 1.6% ??? [224] 1.2% --------------------------------------------------------------------------- *simplify-rules* [191] 12.7% *rules* [17] 19.9% merge-egraph-nodes! [67] 67.3% [198] 4948(0.5%) 3320(0.3%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 update-en-expr [218] 19.9% flag-set? [215] 13.0% --------------------------------------------------------------------------- mk-egraph [187] 37.3% mk-enode-rec! [199] 62.7% [199] 2866(0.3%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [199] 62.7% mk-enode! [77] 37.3% --------------------------------------------------------------------------- argmins [194] 12.6% loop [188] 87.4% [200] 2468(0.3%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [142] 100.0% --------------------------------------------------------------------------- parse-loop12 [185] 100.0% [201] 2030(0.2%) 334(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:99:13 make-multiplication-node [214] 65.9% f172 [151] 17.6% --------------------------------------------------------------------------- bigfloat-hash [192] 100.0% [202] 404(0.0%) 404(0.0%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 --------------------------------------------------------------------------- parse-loop12 [185] 100.0% [203] 334(0.0%) 334(0.0%) parse-app .../collects/racket/private/kw.rkt:951:2 --------------------------------------------------------------------------- extract-smallest [193] 100.0% [204] 322(0.0%) 0(0.0%) hash-keys .../collects/racket/private/hash.rkt:2:2 loop [216] 100.0% --------------------------------------------------------------------------- for-loop [80] 4.8% merge-egraph-nodes! [67] 16.6% loop [195] 28.7% for-loop [52] 49.9% [205] 97744(10.2%) 20004(2.1%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [217] 35.3% loop [195] 33.6% set [219] 13.0% update-en-expr [218] 5.4% --------------------------------------------------------------------------- ??? [197] 100.0% [206] 35364(3.7%) 966(0.1%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [256] 92.6% ??? [224] 4.6% --------------------------------------------------------------------------- for-loop [196] 48.1% ??? [181] 51.9% [207] 28286(3.0%) 17344(1.8%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [221] 38.7% --------------------------------------------------------------------------- f172 [151] 12.2% loop [195] 87.8% [208] 24374(2.5%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [195] 38.9% sort-context-on-expr [223] 28.8% errors [142] 20.5% err-lsts->split-indices [228] 5.4% pick-errors [230] 3.3% sindices->spoints [231] 3.1% --------------------------------------------------------------------------- ??? [150] 37.3% loop [195] 62.7% [209] 8852(0.9%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [222] 100.0% --------------------------------------------------------------------------- ??? [197] 100.0% [210] 3530(0.4%) 1292(0.1%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [126] 63.4% --------------------------------------------------------------------------- ??? [126] 30.3% for-loop [196] 69.7% [211] 3216(0.3%) 1260(0.1%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [227] 60.8% --------------------------------------------------------------------------- for-loop [69] 24.9% loop [195] 75.1% [212] 2692(0.3%) 666(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [225] 75.3% --------------------------------------------------------------------------- for-loop [196] 28.5% ??? [181] 71.5% [213] 2260(0.2%) 1310(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [229] 42.0% --------------------------------------------------------------------------- parse-loop12 [185] 15.2% map [159] 16.9% for-loop [201] 67.9% [214] 1970(0.2%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [226] 100.0% --------------------------------------------------------------------------- for-loop [198] 100.0% [215] 642(0.1%) 0(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [220] 50.8% ??? [253] 49.2% --------------------------------------------------------------------------- hash-keys [204] 5.3% loop [216] 94.7% [216] 322(0.0%) 322(0.0%) loop ...acket/collects/racket/private/hash.rkt:3:4 loop [216] 94.7% --------------------------------------------------------------------------- adopt-enode! [92] 5.6% loop! [205] 94.4% [217] 39536(4.1%) 13324(1.4%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [232] 53.9% for-loop [236] 12.4% --------------------------------------------------------------------------- for-loop [89] 2.3% for-loop [198] 3.4% update-leader! [78] 5.5% for-loop [82] 10.8% loop! [205] 36.6% for-loop [120] 41.4% [218] 29018(3.0%) 28032(2.9%) update-en-expr ...esting/src/core/egraph.rkt:212:0 for-loop [241] 3.4% --------------------------------------------------------------------------- new-enode [88] 6.1% loop! [205] 93.9% [219] 26250(2.7%) 26250(2.7%) set ...collects/racket/private/set-types.rkt:981:0 --------------------------------------------------------------------------- flag-set? [215] 2.5% ??? [163] 14.0% ??? [125] 14.9% ??? [172] 68.6% [220] 13032(1.4%) 8690(0.9%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [235] 33.3% --------------------------------------------------------------------------- f172 [151] 2.9% ??? [207] 97.1% [221] 11266(1.2%) 11266(1.2%) make-keyword-procedure ...ket/private/kw.rkt:260:4 --------------------------------------------------------------------------- ??? [209] 100.0% [222] 8852(0.9%) 6486(0.7%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [234] 26.7% --------------------------------------------------------------------------- option-on-expr [208] 100.0% [223] 7020(0.7%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [233] 97.0% for-loop [246] 3.0% --------------------------------------------------------------------------- ??? [197] 13.0% ??? [157] 18.7% for-loop [122] 33.4% ??? [206] 35.0% [224] 4690(0.5%) 2512(0.3%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [237] 46.4% --------------------------------------------------------------------------- foldl [212] 100.0% [225] 2026(0.2%) 2026(0.2%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 --------------------------------------------------------------------------- make-multiplication-node [214] 100.0% [226] 1970(0.2%) 626(0.1%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [239] 51.3% group-by68 [244] 17.0% --------------------------------------------------------------------------- ??? [211] 100.0% [227] 1956(0.2%) 964(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [240] 50.7% --------------------------------------------------------------------------- option-on-expr [208] 100.0% [228] 1312(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [238] 100.0% --------------------------------------------------------------------------- arrow-higher-order:lnp [213] 100.0% [229] 950(0.1%) 950(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 --------------------------------------------------------------------------- option-on-expr [208] 100.0% [230] 800(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [242] 68.2% point->alt [245] 31.8% --------------------------------------------------------------------------- option-on-expr [208] 100.0% [231] 748(0.1%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 for-loop [243] 63.1% eval-prog [149] 36.9% --------------------------------------------------------------------------- custom-set-union [217] 100.0% [232] 21294(2.2%) 3298(0.3%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [247] 84.5% --------------------------------------------------------------------------- localize-error [62] 4.9% sort-context-on-expr [223] 95.1% [233] 7156(0.7%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [248] 90.2% loop [258] 9.8% --------------------------------------------------------------------------- real->bigfloat [222] 35.1% bfmul [182] 64.9% [234] 6748(0.7%) 6748(0.7%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 --------------------------------------------------------------------------- one-iter [22] 5.7% for-loop [69] 12.1% return/no-unsupplied [220] 82.1% [235] 5286(0.6%) 5286(0.6%) filter ...t/collects/racket/private/list.rkt:256:2 --------------------------------------------------------------------------- custom-set-union [217] 100.0% [236] 4918(0.5%) 4918(0.5%) for-loop ...cts/racket/private/set-types.rkt:152:2 --------------------------------------------------------------------------- ??? [224] 100.0% [237] 2178(0.2%) 1162(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [250] 46.6% --------------------------------------------------------------------------- err-lsts->split-indices [228] 100.0% [238] 1312(0.1%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [249] 100.0% --------------------------------------------------------------------------- make-multiplication-subnode [226] 100.0% [239] 1010(0.1%) 332(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:242:3 mterm->expr [251] 34.3% map [159] 32.9% --------------------------------------------------------------------------- check-hash/c [227] 100.0% [240] 992(0.1%) 992(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 --------------------------------------------------------------------------- update-en-expr [218] 100.0% [241] 986(0.1%) 986(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:214:6 --------------------------------------------------------------------------- pick-errors [230] 100.0% [242] 546(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [15] 100.0% --------------------------------------------------------------------------- sindices->spoints [231] 100.0% [243] 472(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:137:2 f172 [151] 54.7% free-variables [252] 45.3% --------------------------------------------------------------------------- make-multiplication-subnode [226] 100.0% [244] 334(0.0%) 334(0.0%) group-by68 ...acket/collects/racket/list.rkt:749:0 --------------------------------------------------------------------------- pick-errors [230] 100.0% [245] 254(0.0%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [149] 100.0% --------------------------------------------------------------------------- sort-context-on-expr [223] 100.0% [246] 212(0.0%) 212(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:116:19 --------------------------------------------------------------------------- for-loop [232] 100.0% [247] 17996(1.9%) 17996(1.9%) for-loop ...cts/racket/private/set-types.rkt:178:5 --------------------------------------------------------------------------- ??? [233] 100.0% [248] 6456(0.7%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [254] 69.6% loop [258] 25.0% jloop [11] 5.4% --------------------------------------------------------------------------- add-splitpoint [238] 100.0% [249] 1312(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [255] 100.0% --------------------------------------------------------------------------- ??? [237] 100.0% [250] 1016(0.1%) 1016(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 --------------------------------------------------------------------------- for-loop [239] 100.0% [251] 346(0.0%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 ??? [253] 100.0% --------------------------------------------------------------------------- append-map [176] 50.0% for-loop [243] 50.0% [252] 214(0.0%) 0(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 f172 [151] 50.0% variable? [5] 50.0% --------------------------------------------------------------------------- flag-set? [215] 2.2% ulp-difference [154] 2.3% mterm->expr [251] 2.4% ??? [163] 19.1% ??? [125] 35.2% ??? [172] 38.8% [253] 14284(1.5%) 3218(0.3%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [257] 60.4% ??? [256] 17.0% --------------------------------------------------------------------------- copying-mergesort [254] 45.7% generic-sort/key [248] 54.3% [254] 4492(0.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [254] 45.7% loop [258] 44.2% jloop [11] 10.1% --------------------------------------------------------------------------- for-loop [249] 100.0% [255] 1312(0.1%) 1076(0.1%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [259] 18.0% --------------------------------------------------------------------------- ??? [114] 1.6% ??? [197] 2.0% ??? [162] 4.0% ??? [253] 6.0% ??? [126] 6.3% ??? [206] 80.2% [256] 40862(4.3%) 36036(3.8%) ??? ...ects/racket/contract/private/guts.rkt:644:8 dict? [260] 4.6% ??? [114] 4.0% contract? [261] 3.3% --------------------------------------------------------------------------- ??? [178] 3.8% ??? [253] 96.2% [257] 8974(0.9%) 8706(0.9%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [262] 3.0% --------------------------------------------------------------------------- ??? [233] 14.0% generic-sort/key [248] 32.3% copying-mergesort [254] 53.7% [258] 5000(0.5%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [150] 100.0% --------------------------------------------------------------------------- for-loop [255] 15.8% for-loop [7] 21.7% for-loop [69] 21.7% loop [195] 40.9% [259] 1496(0.2%) 1496(0.2%) curried ...cket/collects/racket/function.rkt:71:18 --------------------------------------------------------------------------- ??? [172] 16.2% ??? [256] 83.8% [260] 2220(0.2%) 2220(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 --------------------------------------------------------------------------- ??? [256] 100.0% [261] 1336(0.1%) 1336(0.1%) contract? ...acket/contract/private/guts.rkt:109:0 --------------------------------------------------------------------------- ??? [257] 100.0% [262] 268(0.0%) 268(0.0%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ---------------------------------------------------------------------------