Profiling results ----------------- Total cpu time observed: 66769ms (out of 66860ms) Number of samples taken: 286 (once every 233ms) (Hiding functions with self<1.0% and local<2.0%: 7 of 174 hidden) =============================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =============================================================================== [1] 66769(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [7] 100.0% ------------------------------------------------------------------------------- loop [144] 100.0% [2] 10340(15.5%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [144] 52.6% sort-context-on-expr [8] 38.1% pick-errors [9] 7.5% point->alt [15] 1.9% ------------------------------------------------------------------------------- loop [144] 100.0% [3] 694(1.0%) 225(0.3%) set-precompute! ...ing/src/core/simplify.rkt:193:0 procedure-reduce-arity [10] 34.3% eval-const-expr [11] 33.2% ------------------------------------------------------------------------------- loop [144] 100.0% [4] 296(0.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [130] 100.0% ------------------------------------------------------------------------------- loop [144] 100.0% [5] 296(0.4%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:40:19 ...row-higher-order.rkt:375:33 [95] 100.0% ------------------------------------------------------------------------------- loop [144] 100.0% [6] 233(0.3%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [130] 100.0% ------------------------------------------------------------------------------- ??? [1] 100.0% [7] 66769(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [12] 100.0% ------------------------------------------------------------------------------- option-on-expr [2] 100.0% [8] 3934(5.9%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [13] 95.2% eval-prog [96] 4.8% ------------------------------------------------------------------------------- option-on-expr [2] 100.0% [9] 775(1.2%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [14] 74.9% point->alt [15] 25.1% ------------------------------------------------------------------------------- set-precompute! [3] 100.0% [10] 238(0.4%) 238(0.4%) procedure-reduce-arity ...t/private/kw.rkt:1823:11 ------------------------------------------------------------------------------- set-precompute! [3] 100.0% [11] 230(0.3%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f8 [142] 100.0% ------------------------------------------------------------------------------- profile-thunk [7] 100.0% [12] 66769(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [16] 100.0% ------------------------------------------------------------------------------- sort-context-on-expr [8] 100.0% [13] 3746(5.6%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [17] 100.0% ------------------------------------------------------------------------------- loop [144] 24.8% pick-errors [9] 75.2% [14] 772(1.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [94] 100.0% ------------------------------------------------------------------------------- option-on-expr [2] 49.9% pick-errors [9] 50.1% [15] 388(0.6%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [96] 100.0% ------------------------------------------------------------------------------- ??? [12] 100.0% [16] 66769(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [18] 92.3% prepare-points [25] 7.7% ------------------------------------------------------------------------------- ??? [13] 100.0% [17] 3746(5.6%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 ??? [94] 48.6% copying-mergesort [19] 46.3% ...row-higher-order.rkt:375:33 [95] 5.1% ------------------------------------------------------------------------------- ??? [16] 100.0% [18] 61624(92.3%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [20] 82.4% get-final-combination [21] 17.1% setup-prog! [22] 0.5% ------------------------------------------------------------------------------- generic-sort/key [17] 44.0% copying-mergesort [19] 56.0% [19] 1735(2.6%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [19] 56.0% ??? [94] 30.7% ...row-higher-order.rkt:375:33 [95] 13.3% ------------------------------------------------------------------------------- run-improve [18] 100.0% [20] 50781(76.1%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [23] 81.8% finalize-iter! [26] 10.2% gen-series! [27] 4.1% choose-best-alt! [28] 1.9% localize! [29] 1.5% ------------------------------------------------------------------------------- run-improve [18] 100.0% [21] 10538(15.8%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [24] 98.1% extract-alt [30] 1.9% ------------------------------------------------------------------------------- run-improve [18] 100.0% [22] 306(0.5%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [25] 100.0% ------------------------------------------------------------------------------- run-iter! [20] 100.0% [23] 41526(62.2%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [31] 100.0% ------------------------------------------------------------------------------- get-final-combination [21] 100.0% [24] 10340(15.5%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [142] 100.0% ------------------------------------------------------------------------------- setup-prog! [22] 5.6% ??? [16] 94.4% [25] 5450(8.2%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [36] 67.0% make-exacts [33] 33.0% ------------------------------------------------------------------------------- run-iter! [20] 100.0% [26] 5180(7.8%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [72] 100.0% ------------------------------------------------------------------------------- run-iter! [20] 100.0% [27] 2102(3.1%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [32] 100.0% ------------------------------------------------------------------------------- run-iter! [20] 100.0% [28] 943(1.4%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [72] 100.0% ------------------------------------------------------------------------------- run-iter! [20] 100.0% [29] 784(1.2%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [34] 100.0% ------------------------------------------------------------------------------- get-final-combination [21] 100.0% [30] 198(0.3%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [114] 100.0% ------------------------------------------------------------------------------- simplify! [23] 100.0% [31] 41526(62.2%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [35] 100.0% ------------------------------------------------------------------------------- gen-series! [27] 100.0% [32] 2102(3.1%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [95] 100.0% ------------------------------------------------------------------------------- prepare-points [25] 100.0% [33] 1798(2.7%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [36] 100.0% ------------------------------------------------------------------------------- localize! [29] 100.0% [34] 784(1.2%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [130] 100.0% ------------------------------------------------------------------------------- ??? [31] 100.0% [35] 41526(62.2%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [37] 99.4% *simplify-rules* [39] 0.6% ------------------------------------------------------------------------------- make-exacts [33] 33.0% prepare-points [25] 67.0% [36] 5450(8.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [144] 94.9% gen-andmap [38] 5.1% ------------------------------------------------------------------------------- simplify [35] 100.0% [37] 41286(61.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [40] 85.2% loop [41] 13.0% mk-egraph [42] 1.8% ------------------------------------------------------------------------------- loop [36] 100.0% [38] 276(0.4%) 276(0.4%) gen-andmap ...ollects/racket/private/map.rkt:275:2 ------------------------------------------------------------------------------- simplify [35] 100.0% [39] 240(0.4%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [43] 100.0% ------------------------------------------------------------------------------- ??? [37] 100.0% [40] 35180(52.7%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [44] 98.0% loop [144] 2.0% ------------------------------------------------------------------------------- ??? [37] 100.0% [41] 5358(8.0%) 236(0.4%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [45] 56.7% loop [46] 30.0% hash-set*+ [48] 4.5% make-sequence [74] 4.4% ------------------------------------------------------------------------------- ??? [37] 100.0% [42] 748(1.1%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [47] 69.3% mk-enode! [54] 30.7% ------------------------------------------------------------------------------- *simplify-rules* [39] 100.0% [43] 240(0.4%) 240(0.4%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ------------------------------------------------------------------------------- iterate-egraph! [40] 100.0% [44] 34486(51.6%) 700(1.0%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [49] 43.8% custom-set-member? [50] 13.6% merge-egraph-nodes! [52] 13.3% substitute-e [53] 8.8% mk-enode! [54] 8.8% loop! [147] 4.9% update-leader! [55] 3.3% list-member? [153] 0.7% ------------------------------------------------------------------------------- loop [41] 100.0% [45] 3039(4.6%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [51] 100.0% ------------------------------------------------------------------------------- loop [41] 100.0% [46] 1608(2.4%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [51] 100.0% ------------------------------------------------------------------------------- mk-egraph [42] 25.0% loop [144] 75.0% [47] 519(0.8%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [144] 100.0% ------------------------------------------------------------------------------- loop [41] 100.0% [48] 241(0.4%) 241(0.4%) hash-set*+ ...-testing/src/core/simplify.rkt:209:0 ------------------------------------------------------------------------------- match-e [49] 24.7% one-iter [44] 75.3% [49] 15102(22.6%) 4229(6.3%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [49] 24.7% ??? [57] 11.0% loop [144] 9.3% make-sequence [74] 7.0% variable? [56] 5.2% pack-leader [58] 4.7% ??? [72] 4.1% do-procedure-reduce-keyword-arity [65] 3.1% reverse [163] 3.1% ??? [61] 1.6% check-list [166] 1.5% ------------------------------------------------------------------------------- one-iter [44] 100.0% [50] 4707(7.0%) 4468(6.7%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [62] 5.1% ------------------------------------------------------------------------------- loop [46] 34.6% mk-min [45] 65.4% [51] 4647(7.0%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [98] 90.0% compile [59] 10.0% ------------------------------------------------------------------------------- merge-egraph-nodes! [52] 5.7% one-iter [44] 94.3% [52] 4574(6.9%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [55] 78.8% loop! [147] 10.2% merge-egraph-nodes! [52] 5.7% enode-merge! [60] 5.3% ------------------------------------------------------------------------------- substitute-e [53] 8.8% one-iter [44] 91.2% [53] 3046(4.6%) 459(0.7%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [54] 77.2% substitute-e [53] 8.8% variable? [56] 2.6% ------------------------------------------------------------------------------- mk-egraph [42] 3.7% loop [144] 8.5% substitute-e [53] 38.3% one-iter [44] 49.5% [54] 6138(9.2%) 460(0.7%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [63] 88.8% hash-has-key? [77] 3.7% ------------------------------------------------------------------------------- one-iter [44] 23.0% merge-egraph-nodes! [52] 77.0% [55] 5018(7.5%) 1706(2.6%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [64] 66.0% ------------------------------------------------------------------------------- substitute-e [53] 10.0% pattern-substitute [126] 10.4% match-e [49] 79.6% [56] 2358(3.5%) 238(0.4%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [72] 89.9% ------------------------------------------------------------------------------- match-e [49] 100.0% [57] 1888(2.8%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [65] 61.8% do-curry [66] 38.2% ------------------------------------------------------------------------------- match-e [49] 100.0% [58] 704(1.1%) 704(1.1%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ------------------------------------------------------------------------------- expression-cost [51] 100.0% [59] 466(0.7%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [130] 100.0% ------------------------------------------------------------------------------- merge-egraph-nodes! [52] 100.0% [60] 242(0.4%) 242(0.4%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 ------------------------------------------------------------------------------- match-e [49] 100.0% [61] 240(0.4%) 0(0.0%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 dict-iterate-value [115] 100.0% ------------------------------------------------------------------------------- custom-set-member? [50] 100.0% [62] 238(0.4%) 238(0.4%) set-check-elem ...cket/private/set-types.rkt:329:0 ------------------------------------------------------------------------------- mk-enode! [54] 100.0% [63] 5454(8.2%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [67] 100.0% ------------------------------------------------------------------------------- update-leader! [55] 100.0% [64] 3312(5.0%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [68] 100.0% ------------------------------------------------------------------------------- match-e [49] 28.7% ??? [57] 71.3% [65] 1636(2.5%) 1394(2.1%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [69] 14.8% ------------------------------------------------------------------------------- ??? [57] 100.0% [66] 720(1.1%) 241(0.4%) do-curry ...cket/collects/racket/function.rkt:71:2 make-keyword-procedure [133] 33.6% procedure-keywords [69] 33.0% ------------------------------------------------------------------------------- new-enode [63] 100.0% [67] 5454(8.2%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [70] 95.8% f8 [142] 4.2% ------------------------------------------------------------------------------- do-hash-update [64] 100.0% [68] 3312(5.0%) 2560(3.8%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [71] 14.1% reverse [163] 8.6% ------------------------------------------------------------------------------- do-curry [66] 49.5% do-procedure-reduce-keyword-arity [65] 50.5% [69] 480(0.7%) 480(0.7%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------- type-of-enode-expr [67] 100.0% [70] 5224(7.8%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [73] 45.8% ...sting/src/common.rkt:47:2 [75] 31.5% table-ref [98] 13.6% ??? [72] 9.1% ------------------------------------------------------------------------------- ??? [68] 100.0% [71] 466(0.7%) 236(0.4%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [74] 49.4% ------------------------------------------------------------------------------- ??? [150] 2.2% get-sigs [70] 4.6% choose-best-alt! [28] 9.1% match-e [49] 13.4% variable? [56] 20.5% finalize-iter! [26] 50.1% [72] 10338(15.5%) 241(0.4%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [76] 50.1% hash-has-key? [77] 36.2% atab-pick-alt [80] 9.1% ??? [150] 2.2% ------------------------------------------------------------------------------- get-sigs [70] 100.0% [73] 2391(3.6%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [78] 59.0% handle-the-hash [83] 21.5% get/build-late-neg-projection [97] 19.5% ------------------------------------------------------------------------------- update-en-expr [71] 13.1% loop [41] 13.3% match-e [49] 73.6% [74] 1758(2.6%) 944(1.4%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [81] 46.3% ------------------------------------------------------------------------------- get-sigs [70] 100.0% [75] 1647(2.5%) 0(0.0%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [79] 57.4% ??? [82] 42.6% ------------------------------------------------------------------------------- ??? [72] 100.0% [76] 5180(7.8%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [84] 100.0% ------------------------------------------------------------------------------- mk-enode! [54] 5.7% ??? [72] 94.3% [77] 3971(5.9%) 3264(4.9%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [109] 17.8% ------------------------------------------------------------------------------- ??? [73] 100.0% [78] 1410(2.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [85] 100.0% ------------------------------------------------------------------------------- ??? [86] 25.1% ...sting/src/common.rkt:47:2 [75] 74.9% [79] 946(1.4%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [86] 74.9% ??? [150] 25.1% ------------------------------------------------------------------------------- ??? [72] 100.0% [80] 943(1.4%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 ...row-higher-order.rkt:375:33 [95] 50.7% point-best-alt [87] 49.3% ------------------------------------------------------------------------------- make-sequence [74] 100.0% [81] 813(1.2%) 813(1.2%) :hash-gen ...collects/racket/private/for.rkt:781:4 ------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [75] 100.0% [82] 701(1.0%) 474(0.7%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 return/no-unsupplied [111] 32.3% ------------------------------------------------------------------------------- ??? [73] 100.0% [83] 514(0.8%) 238(0.4%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [86] 53.8% ------------------------------------------------------------------------------- atab-add-altns [76] 100.0% [84] 5180(7.8%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [88] 95.4% override-at-pnts [91] 4.6% ------------------------------------------------------------------------------- ??? [78] 100.0% [85] 1410(2.1%) 713(1.1%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [89] 49.4% ------------------------------------------------------------------------------- handle-the-hash [83] 22.6% ??? [79] 77.4% [86] 1223(1.8%) 470(0.7%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [79] 38.9% ??? [90] 22.6% ------------------------------------------------------------------------------- atab-pick-alt [80] 100.0% [87] 464(0.7%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [144] 100.0% ------------------------------------------------------------------------------- atab-add-altn [84] 100.0% [88] 4943(7.4%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [92] 100.0% ------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [85] 100.0% [89] 697(1.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [93] 100.0% ------------------------------------------------------------------------------- ??? [86] 100.0% [90] 277(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [106] 100.0% ------------------------------------------------------------------------------- atab-add-altn [84] 100.0% [91] 238(0.4%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [92] 100.0% ------------------------------------------------------------------------------- override-at-pnts [91] 2.1% composed [123] 5.8% best-and-tied-at-points [88] 42.7% loop [144] 49.4% [92] 11566(17.3%) 192(0.3%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [94] 58.4% eval-prog [96] 21.6% ulp-difference [148] 11.1% ...row-higher-order.rkt:375:33 [95] 5.6% ------------------------------------------------------------------------------- ??? [89] 100.0% [93] 697(1.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [97] 100.0% ------------------------------------------------------------------------------- ??? [14] 5.1% copying-mergesort [19] 8.9% generic-sort/key [17] 12.0% loop [144] 29.7% errors [92] 44.4% [94] 15206(22.8%) 10089(15.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [100] 15.6% loop [144] 10.7% ??? [105] 4.5% ??? [106] 1.3% ------------------------------------------------------------------------------- generic-sort/key [17] 2.8% f8 [142] 3.3% ??? [158] 3.6% loop [5] 4.3% copying-mergesort [19] 5.6% atab-pick-alt [80] 7.0% errors [92] 9.4% loop [101] 15.3% taylor-alt [32] 15.3% loop [144] 33.3% [95] 6857(10.3%) 0(0.0%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 ->flonum [99] 37.4% loop [101] 18.9% real->bigfloat [103] 18.0% approximate [102] 15.3% best-alt [107] 7.0% table-ref [98] 3.3% ------------------------------------------------------------------------------- sort-context-on-expr [8] 6.1% point->alt [15] 12.6% errors [92] 81.2% [96] 3070(4.6%) 2840(4.3%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f8 [142] 7.5% ------------------------------------------------------------------------------- ??? [108] 10.0% ??? [73] 30.1% ??? [93] 59.9% [97] 1164(1.7%) 234(0.3%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [104] 69.9% ??? [108] 10.0% ------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [95] 4.5% get-sigs [70] 13.9% expression-cost [51] 81.7% [98] 5118(7.7%) 682(1.0%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [109] 64.3% reverse [163] 9.1% return/no-unsupplied [111] 8.8% dict-iterate-value [115] 4.4% ------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [95] 100.0% [99] 2566(3.8%) 1418(2.1%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [111] 22.7% ??? [116] 22.0% ------------------------------------------------------------------------------- ??? [94] 100.0% [100] 2377(3.6%) 713(1.1%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 list-member? [153] 53.8% return/no-unsupplied [111] 8.1% dict-iterate-value [115] 8.1% ------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [95] 7.9% loop [101] 92.1% [101] 2348(3.5%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [101] 92.1% ...row-higher-order.rkt:375:33 [95] 7.1% ??? [110] 0.8% ------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [95] 100.0% [102] 2102(3.1%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [110] 66.7% taylor [113] 33.3% ------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [95] 100.0% [103] 1236(1.9%) 562(0.8%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [121] 54.5% ------------------------------------------------------------------------------- get/build-late-neg-projection [97] 100.0% [104] 930(1.4%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [112] 100.0% ------------------------------------------------------------------------------- ??? [94] 100.0% [105] 690(1.0%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [118] 68.6% bfatan [119] 31.4% ------------------------------------------------------------------------------- ??? [94] 42.5% ??? [90] 57.5% [106] 482(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [117] 100.0% ------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [95] 100.0% [107] 478(0.7%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [114] 100.0% ------------------------------------------------------------------------------- get/build-late-neg-projection [97] 100.0% [108] 233(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [97] 100.0% ------------------------------------------------------------------------------- hash-has-key? [77] 17.7% table-ref [98] 82.3% [109] 4000(6.0%) 1618(2.4%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [120] 53.9% ??? [128] 5.7% ------------------------------------------------------------------------------- loop [101] 14.9% approximate [102] 85.1% [110] 1647(2.5%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [130] 85.1% pattern-substitute [126] 14.9% ------------------------------------------------------------------------------- ??? [100] 13.2% ??? [82] 15.6% table-ref [98] 30.9% ->flonum [99] 40.2% [111] 1451(2.2%) 624(0.9%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [122] 57.0% ------------------------------------------------------------------------------- ??? [104] 100.0% [112] 930(1.4%) 470(0.7%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [124] 49.4% ------------------------------------------------------------------------------- approximate [102] 31.6% taylor [113] 68.4% [113] 700(1.0%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [113] 68.4% normalize-series [127] 16.6% loop [144] 15.0% ------------------------------------------------------------------------------- extract-alt [30] 29.3% best-alt [107] 70.7% [114] 676(1.0%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [123] 100.0% ------------------------------------------------------------------------------- ??? [100] 29.1% table-ref [98] 34.5% ??? [61] 36.4% [115] 660(1.0%) 660(1.0%) dict-iterate-value ...et/private/generic.rkt:472:9 ------------------------------------------------------------------------------- ->flonum [99] 100.0% [116] 564(0.8%) 564(0.8%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 ------------------------------------------------------------------------------- ??? [106] 100.0% [117] 482(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [125] 57.5% ^TYPE? [129] 42.5% ------------------------------------------------------------------------------- ??? [105] 100.0% [118] 473(0.7%) 273(0.4%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [121] 42.3% ------------------------------------------------------------------------------- ??? [105] 100.0% [119] 216(0.3%) 216(0.3%) bfatan ...lib/math/private/bigfloat/mpfr.rkt:635:4 ------------------------------------------------------------------------------- ??? [109] 100.0% [120] 2155(3.2%) 464(0.7%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 blame-add-missing-party [131] 35.2% loop [132] 32.5% make-keyword-procedure [133] 10.8% ------------------------------------------------------------------------------- bfsub [118] 22.9% real->bigfloat [103] 77.1% [121] 874(1.3%) 874(1.3%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------- return/no-unsupplied [111] 100.0% [122] 827(1.2%) 827(1.2%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------- argmins [114] 100.0% [123] 676(1.0%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [92] 100.0% ------------------------------------------------------------------------------- build-compound-type-name [112] 100.0% [124] 460(0.7%) 224(0.3%) contract-struct-name ...ract/private/prop.rkt:98:0 reverse [163] 51.1% ------------------------------------------------------------------------------- ??? [117] 100.0% [125] 277(0.4%) 277(0.4%) ??? ...ects/racket/contract/private/list.rkt:163:5 ------------------------------------------------------------------------------- ??? [110] 33.3% pattern-substitute [126] 66.7% [126] 245(0.4%) 0(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [126] 66.7% variable? [56] 33.3% ------------------------------------------------------------------------------- taylor [113] 100.0% [127] 233(0.3%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [130] 100.0% ------------------------------------------------------------------------------- ??? [109] 100.0% [128] 228(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [134] 100.0% ------------------------------------------------------------------------------- ??? [117] 100.0% [129] 204(0.3%) 204(0.3%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------- compile [59] 3.6% simplify* [6] 4.0% normalize-series [127] 4.0% composed [4] 5.1% ??? [137] 10.2% loop [144] 12.5% ??? [135] 12.8% ??? [136] 12.8% ??? [110] 12.8% localize-error [34] 22.0% [130] 2886(4.3%) 700(1.0%) hash-ref! .../racket/private/more-scheme.rkt:377:2 f8 [142] 27.2% ??? [135] 16.8% ??? [136] 12.8% simplify [140] 12.8% ??? [138] 12.5% ??? [137] 10.2% ------------------------------------------------------------------------------- ??? [120] 100.0% [131] 759(1.1%) 759(1.1%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------- loop [132] 41.8% ??? [120] 58.2% [132] 700(1.0%) 700(1.0%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [132] 41.8% ------------------------------------------------------------------------------- ??? [120] 49.1% do-curry [66] 50.9% [133] 475(0.7%) 475(0.7%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------- ??? [128] 100.0% [134] 228(0.3%) 0(0.0%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [139] 100.0% ------------------------------------------------------------------------------- hash-ref! [130] 100.0% [135] 1635(2.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [130] 85.7% simplify [140] 14.3% ------------------------------------------------------------------------------- hash-ref! [130] 100.0% [136] 1402(2.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [130] 100.0% ------------------------------------------------------------------------------- hash-ref! [130] 100.0% [137] 1174(1.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [130] 100.0% ------------------------------------------------------------------------------- hash-ref! [130] 100.0% [138] 466(0.7%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [144] 100.0% ------------------------------------------------------------------------------- check-hash/c [134] 100.0% [139] 228(0.3%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [141] 100.0% ------------------------------------------------------------------------------- ??? [135] 11.1% loop [144] 11.1% taylor-invert [151] 11.1% hash-ref! [130] 66.7% [140] 2102(3.1%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [142] 88.9% debug-print [143] 11.1% ------------------------------------------------------------------------------- flat-contract? [139] 100.0% [141] 228(0.3%) 228(0.3%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------- eval-prog [96] 0.3% type-of-enode-expr [67] 1.7% eval-const-expr [11] 1.7% hash-ref! [130] 5.7% simplify [140] 7.4% loop [144] 7.6% split-table [24] 75.6% [142] 13682(20.5%) 1866(2.8%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [144] 87.8% loop [145] 1.7% ??? [146] 1.7% ...row-higher-order.rkt:375:33 [95] 0.3% ------------------------------------------------------------------------------- simplify [140] 100.0% [143] 234(0.3%) 234(0.3%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ------------------------------------------------------------------------------- loop [36] 0.1% iterate-egraph! [40] 0.1% ??? [94] 0.2% loop! [147] 0.5% point-best-alt [87] 0.7% option-on-expr [2] 1.2% taylor [113] 1.3% ??? [138] 1.5% mk-enode-rec! [47] 1.9% match-e [49] 6.2% f8 [142] 6.8% loop [144] 79.0% [144] 23576(35.3%) 1161(1.7%) loop .../private/map.rkt:40:19 loop [144] 79.0% f8 [142] 3.6% option-on-expr [2] 2.9% foldl [149] 2.4% errors [92] 1.9% hash-ref! [130] 1.5% mk-enode-rec! [47] 1.4% taylor-invert [151] 1.0% loop! [147] 0.5% mk-enode! [54] 0.5% simplify [140] 0.3% simplify* [6] 0.2% ...row-higher-order.rkt:375:33 [95] 0.2% set-precompute! [3] 0.1% ??? [94] 0.1% step [152] 0.0% composed [4] 0.0% loop [5] 0.0% ??? [14] 0.0% ------------------------------------------------------------------------------- f8 [142] 0.5% loop [145] 99.5% [145] 238(0.4%) 0(0.0%) loop .../private/map.rkt:54:19 loop [145] 99.5% ulp-difference [148] 0.5% ------------------------------------------------------------------------------- f8 [142] 100.0% [146] 230(0.3%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:363:46 ??? [150] 100.0% ------------------------------------------------------------------------------- merge-egraph-nodes! [52] 16.4% loop [144] 32.4% one-iter [44] 51.2% [147] 2158(3.2%) 238(0.4%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 loop [144] 32.4% custom-set-union [155] 29.5% make-immutable-set [154] 21.6% ??? [159] 5.4% ------------------------------------------------------------------------------- loop [145] 15.6% errors [92] 84.4% [148] 1528(2.3%) 1290(1.9%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 list-member? [153] 15.6% ------------------------------------------------------------------------------- loop [144] 100.0% [149] 961(1.4%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [156] 50.4% ??? [158] 25.5% check-fold [160] 24.1% ------------------------------------------------------------------------------- ??? [72] 24.3% ??? [146] 24.7% ??? [79] 51.0% [150] 932(1.4%) 0(0.0%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [157] 51.0% ??? [72] 24.7% dict? [162] 24.3% ------------------------------------------------------------------------------- loop [144] 100.0% [151] 234(0.4%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [140] 100.0% ------------------------------------------------------------------------------- loop [144] 100.0% [152] 230(0.3%) 0(0.0%) step .../racket/collects/racket/function.rkt:145:9 sort [161] 100.0% ------------------------------------------------------------------------------- ulp-difference [148] 13.5% one-iter [44] 13.7% ??? [100] 72.8% [153] 1759(2.6%) 467(0.7%) list-member? ...llects/racket/private/set.rkt:24:0 member [164] 73.5% ------------------------------------------------------------------------------- loop! [147] 100.0% [154] 932(1.4%) 932(1.4%) make-immutable-set .../private/set-types.rkt:948:0 ------------------------------------------------------------------------------- loop! [147] 100.0% [155] 753(1.1%) 520(0.8%) custom-set-union ...et/private/set-types.rkt:168:0 check-list [166] 30.9% ------------------------------------------------------------------------------- foldl [149] 100.0% [156] 484(0.7%) 484(0.7%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------- ??? [150] 100.0% [157] 476(0.7%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [165] 100.0% ------------------------------------------------------------------------------- foldl [149] 100.0% [158] 245(0.4%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:66:9 ...row-higher-order.rkt:375:33 [95] 100.0% ------------------------------------------------------------------------------- loop! [147] 100.0% [159] 235(0.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 reverse [163] 100.0% ------------------------------------------------------------------------------- foldl [149] 100.0% [160] 232(0.3%) 232(0.3%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------- step [152] 100.0% [161] 230(0.3%) 230(0.3%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------- ??? [150] 100.0% [162] 226(0.3%) 226(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------- ??? [159] 13.9% contract-struct-name [124] 13.9% ??? [68] 16.9% match-e [49] 27.6% table-ref [98] 27.6% [163] 1689(2.5%) 1689(2.5%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------- list-member? [153] 100.0% [164] 1292(1.9%) 1292(1.9%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------- contract? [157] 100.0% [165] 476(0.7%) 234(0.3%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [167] 50.9% ------------------------------------------------------------------------------- match-e [49] 49.1% custom-set-union [155] 50.9% [166] 458(0.7%) 458(0.7%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------- coerce-contract/f [165] 100.0% [167] 242(0.4%) 242(0.4%) coerce-simple-value ...ract/private/guts.rkt:385:0 -------------------------------------------------------------------------------