Profiling results ----------------- Total cpu time observed: 89620ms (out of 89992ms) Number of samples taken: 321 (once every 279ms) (Hiding functions with self<1.0% and local<2.0%: 4 of 171 hidden) ================================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ================================================================================ [1] 89620(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [6] 100.0% -------------------------------------------------------------------------------- loop [151] 100.0% [2] 14142(15.8%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [151] 62.8% sort-context-on-expr [7] 23.6% pick-errors [8] 5.9% err-lsts->split-indices [9] 5.8% eval-prog [100] 2.0% -------------------------------------------------------------------------------- hash-ref! [129] 100.0% [3] 2746(3.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [114] 100.0% -------------------------------------------------------------------------------- loop [151] 100.0% [4] 283(0.3%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- loop [151] 100.0% [5] 279(0.3%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- ??? [1] 100.0% [6] 89620(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [10] 100.0% -------------------------------------------------------------------------------- option-on-expr [2] 100.0% [7] 3332(3.7%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [11] 100.0% -------------------------------------------------------------------------------- option-on-expr [2] 100.0% [8] 835(0.9%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [12] 67.1% loop [13] 32.9% -------------------------------------------------------------------------------- option-on-expr [2] 100.0% [9] 816(0.9%) 541(0.6%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [14] 33.7% -------------------------------------------------------------------------------- profile-thunk [6] 100.0% [10] 89620(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [15] 100.0% -------------------------------------------------------------------------------- sort-context-on-expr [7] 100.0% [11] 3332(3.7%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [16] 100.0% -------------------------------------------------------------------------------- loop [151] 33.7% pick-errors [8] 66.3% [12] 845(0.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [98] 66.3% ??? [99] 33.7% -------------------------------------------------------------------------------- pick-errors [8] 1.7% loop [13] 98.3% [13] 275(0.3%) 275(0.3%) loop ...cket/collects/racket/private/map.rkt:259:4 loop [13] 98.3% -------------------------------------------------------------------------------- err-lsts->split-indices [9] 100.0% [14] 275(0.3%) 275(0.3%) ??? ...e/racket/collects/racket/function.rkt:93:12 -------------------------------------------------------------------------------- ??? [10] 100.0% [15] 89620(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [17] 96.0% prepare-points [18] 4.0% -------------------------------------------------------------------------------- ??? [11] 100.0% [16] 3332(3.7%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [19] 83.3% ??? [98] 16.7% -------------------------------------------------------------------------------- ??? [15] 100.0% [17] 86031(96.0%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [20] 83.2% get-final-combination [21] 16.8% -------------------------------------------------------------------------------- ??? [15] 100.0% [18] 3589(4.0%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [28] 60.0% make-exacts [22] 32.1% ??? [23] 7.9% -------------------------------------------------------------------------------- copying-mergesort [19] 37.2% generic-sort/key [16] 62.8% [19] 2774(3.1%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 ??? [98] 62.8% copying-mergesort [19] 37.2% -------------------------------------------------------------------------------- run-improve [17] 100.0% [20] 71612(79.9%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [24] 77.2% finalize-iter! [26] 10.8% gen-series! [27] 7.7% choose-best-alt! [29] 3.5% gen-rewrites! [30] 0.4% localize! [31] 0.4% -------------------------------------------------------------------------------- run-improve [17] 100.0% [21] 14418(16.1%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [25] 98.1% extract-alt [32] 1.9% -------------------------------------------------------------------------------- prepare-points [18] 100.0% [22] 1150(1.3%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [28] 100.0% -------------------------------------------------------------------------------- prepare-points [18] 100.0% [23] 284(0.3%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [99] 100.0% -------------------------------------------------------------------------------- run-iter! [20] 100.0% [24] 55288(61.7%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [33] 100.0% -------------------------------------------------------------------------------- get-final-combination [21] 100.0% [25] 14142(15.8%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f53 [148] 100.0% -------------------------------------------------------------------------------- run-iter! [20] 100.0% [26] 7722(8.6%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [76] 100.0% -------------------------------------------------------------------------------- run-iter! [20] 100.0% [27] 5545(6.2%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [34] 100.0% -------------------------------------------------------------------------------- make-exacts [22] 34.8% prepare-points [18] 65.2% [28] 3304(3.7%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [151] 100.0% -------------------------------------------------------------------------------- run-iter! [20] 100.0% [29] 2493(2.8%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [76] 100.0% -------------------------------------------------------------------------------- run-iter! [20] 100.0% [30] 284(0.3%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [35] 100.0% -------------------------------------------------------------------------------- run-iter! [20] 100.0% [31] 279(0.3%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [36] 100.0% -------------------------------------------------------------------------------- get-final-combination [21] 100.0% [32] 277(0.3%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [118] 100.0% -------------------------------------------------------------------------------- simplify! [24] 100.0% [33] 55288(61.7%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [37] 100.0% -------------------------------------------------------------------------------- gen-series! [27] 100.0% [34] 5545(6.2%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [99] 100.0% -------------------------------------------------------------------------------- gen-rewrites! [30] 100.0% [35] 284(0.3%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [38] 100.0% -------------------------------------------------------------------------------- localize! [31] 100.0% [36] 279(0.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- ??? [33] 100.0% [37] 55288(61.7%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [39] 99.5% debug [41] 0.5% -------------------------------------------------------------------------------- matcher [40] 50.0% alt-rewrite-rm [35] 50.0% [38] 284(0.3%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [40] 50.0% f53 [148] 50.0% -------------------------------------------------------------------------------- simplify [37] 100.0% [39] 55008(61.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [42] 89.9% loop [43] 9.6% mk-egraph [45] 0.5% -------------------------------------------------------------------------------- matcher [40] 50.0% rewriter [38] 50.0% [40] 284(0.3%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [40] 50.0% rewriter [38] 50.0% -------------------------------------------------------------------------------- simplify [37] 100.0% [41] 281(0.3%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [44] 100.0% -------------------------------------------------------------------------------- ??? [39] 100.0% [42] 49444(55.2%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [46] 98.9% loop [151] 1.1% -------------------------------------------------------------------------------- ??? [39] 100.0% [43] 5290(5.9%) 281(0.3%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [47] 73.7% loop [48] 15.7% filter [138] 5.3% -------------------------------------------------------------------------------- debug [41] 100.0% [44] 281(0.3%) 281(0.3%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 -------------------------------------------------------------------------------- ??? [39] 100.0% [45] 274(0.3%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [49] 100.0% -------------------------------------------------------------------------------- iterate-egraph! [42] 100.0% [46] 48894(54.6%) 554(0.6%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [50] 35.3% loop! [55] 17.7% merge-egraph-nodes! [51] 13.8% mk-enode! [56] 12.1% custom-set-member? [52] 10.3% substitute-e [54] 5.1% list-member? [117] 1.7% filter [138] 1.1% reverse [137] 0.6% set-member? [116] 0.6% -------------------------------------------------------------------------------- loop [43] 100.0% [47] 3898(4.4%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [53] 100.0% -------------------------------------------------------------------------------- loop [43] 100.0% [48] 830(0.9%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [53] 100.0% -------------------------------------------------------------------------------- loop [151] 50.0% mk-egraph [45] 50.0% [49] 274(0.3%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [151] 100.0% -------------------------------------------------------------------------------- match-e [50] 26.2% one-iter [46] 73.8% [50] 17270(19.3%) 5559(6.2%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [50] 26.2% ??? [59] 6.5% loop [151] 6.4% ??? [76] 5.7% variable? [58] 4.6% make-sequence [67] 4.1% list-cartesian-product [60] 4.0% reverse [137] 4.0% do-procedure-reduce-keyword-arity [68] 3.2% set-member? [116] 3.2% make-curried [61] 1.6% -------------------------------------------------------------------------------- merge-egraph-nodes! [51] 17.7% one-iter [46] 82.3% [51] 6730(7.5%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [57] 70.8% merge-egraph-nodes! [51] 17.7% loop! [55] 11.5% -------------------------------------------------------------------------------- one-iter [46] 100.0% [52] 5030(5.6%) 5030(5.6%) custom-set-member? ...t/private/set-types.rkt:45:0 -------------------------------------------------------------------------------- loop [48] 17.6% mk-min [47] 82.4% [53] 4729(5.3%) 278(0.3%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [77] 64.5% ...sting/src/common.rkt:47:2 [115] 17.8% make-sequence [67] 5.9% second [62] 5.9% -------------------------------------------------------------------------------- substitute-e [54] 15.0% one-iter [46] 85.0% [54] 2514(2.8%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [56] 77.5% substitute-e [54] 15.0% ??? [76] 3.8% variable? [58] 3.7% -------------------------------------------------------------------------------- merge-egraph-nodes! [51] 8.4% loop [151] 27.2% one-iter [46] 64.4% [55] 10056(11.2%) 1952(2.2%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 loop [151] 35.7% custom-set-union [64] 32.1% make-immutable-set [66] 12.0% ??? [69] 5.5% set-member? [116] 0.9% -------------------------------------------------------------------------------- loop [151] 3.4% substitute-e [54] 24.0% one-iter [46] 72.6% [56] 8122(9.1%) 0(0.0%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [63] 100.0% -------------------------------------------------------------------------------- merge-egraph-nodes! [51] 100.0% [57] 5328(5.9%) 2533(2.8%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [65] 47.6% update-en-expr [75] 4.9% -------------------------------------------------------------------------------- substitute-e [54] 11.2% match-e [50] 88.8% [58] 2514(2.8%) 276(0.3%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [76] 89.0% -------------------------------------------------------------------------------- match-e [50] 100.0% [59] 1116(1.2%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [70] 75.1% do-procedure-reduce-keyword-arity [68] 24.9% -------------------------------------------------------------------------------- list-cartesian-product [60] 16.9% match-e [50] 83.1% [60] 833(0.9%) 274(0.3%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [67] 50.2% list-cartesian-product [60] 16.9% -------------------------------------------------------------------------------- match-e [50] 100.0% [61] 280(0.3%) 0(0.0%) make-curried ...collects/racket/function.rkt:130:9 make-keyword-procedure [95] 100.0% -------------------------------------------------------------------------------- expression-cost [53] 100.0% [62] 278(0.3%) 278(0.3%) second ...are/racket/collects/racket/list.rkt:85:0 -------------------------------------------------------------------------------- mk-enode! [56] 100.0% [63] 8122(9.1%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [71] 100.0% -------------------------------------------------------------------------------- loop! [55] 100.0% [64] 3370(3.8%) 3092(3.5%) custom-set-union ...et/private/set-types.rkt:168:0 check-list [160] 8.2% -------------------------------------------------------------------------------- update-leader! [57] 100.0% [65] 2534(2.8%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [72] 100.0% -------------------------------------------------------------------------------- loop! [55] 100.0% [66] 2226(2.5%) 2226(2.5%) make-immutable-set .../private/set-types.rkt:948:0 -------------------------------------------------------------------------------- expression-cost [53] 16.6% list-cartesian-product [60] 33.3% match-e [50] 50.1% [67] 1678(1.9%) 1678(1.9%) make-sequence ...ects/racket/private/for.rkt:557:2 -------------------------------------------------------------------------------- ??? [59] 24.8% match-e [50] 75.2% [68] 1118(1.2%) 838(0.9%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [73] 25.1% -------------------------------------------------------------------------------- loop! [55] 100.0% [69] 1104(1.2%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 reverse [137] 100.0% -------------------------------------------------------------------------------- ??? [59] 100.0% [70] 839(0.9%) 839(0.9%) do-curry ...cket/collects/racket/function.rkt:71:2 -------------------------------------------------------------------------------- new-enode [63] 100.0% [71] 8122(9.1%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [74] 100.0% -------------------------------------------------------------------------------- do-hash-update [65] 100.0% [72] 2534(2.8%) 1972(2.2%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 reverse [137] 11.1% update-en-expr [75] 11.1% -------------------------------------------------------------------------------- do-procedure-reduce-keyword-arity [68] 100.0% [73] 280(0.3%) 280(0.3%) procedure-keywords .../racket/private/kw.rkt:534:2 -------------------------------------------------------------------------------- f53 [148] 3.4% type-of-enode-expr [71] 96.6% [74] 8407(9.4%) 848(0.9%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [77] 36.6% ??? [78] 30.0% ??? [76] 23.3% -------------------------------------------------------------------------------- update-leader! [57] 48.2% ??? [72] 51.8% [75] 541(0.6%) 541(0.6%) update-en-expr ...esting/src/core/egraph.rkt:212:0 -------------------------------------------------------------------------------- ??? [132] 1.6% substitute-e [54] 1.6% get-sigs [74] 11.2% variable? [58] 12.8% choose-best-alt! [29] 14.3% match-e [50] 14.4% finalize-iter! [26] 44.1% [76] 17492(19.5%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [79] 44.1% hash-has-key? [80] 41.6% atab-pick-alt [81] 14.3% -------------------------------------------------------------------------------- ??? [99] 8.3% expression-cost [53] 45.7% get-sigs [74] 46.0% [77] 6682(7.5%) 1386(1.5%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [84] 70.8% return/no-unsupplied [130] 4.2% reverse [137] 4.2% -------------------------------------------------------------------------------- ??? [99] 17.9% get-sigs [74] 82.1% [78] 3077(3.4%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [82] 63.7% get/build-late-neg-projection [101] 27.2% handle-the-hash [89] 9.2% -------------------------------------------------------------------------------- ??? [76] 100.0% [79] 7722(8.6%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [83] 100.0% -------------------------------------------------------------------------------- ??? [76] 100.0% [80] 7277(8.1%) 5315(5.9%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [84] 23.0% reverse [137] 3.9% -------------------------------------------------------------------------------- ??? [76] 100.0% [81] 2493(2.8%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [86] 55.4% ??? [99] 44.6% -------------------------------------------------------------------------------- ??? [78] 100.0% [82] 1959(2.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [85] 100.0% -------------------------------------------------------------------------------- atab-add-altns [79] 100.0% [83] 7722(8.6%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [87] 92.8% override-at-pnts [91] 7.2% -------------------------------------------------------------------------------- hash-has-key? [80] 26.2% table-ref [77] 73.8% [84] 6407(7.1%) 2493(2.8%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [88] 34.8% handle-the-hash [89] 21.9% do-chaperone-procedure [92] 4.3% -------------------------------------------------------------------------------- ??? [82] 100.0% [85] 1959(2.2%) 553(0.6%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [90] 71.8% -------------------------------------------------------------------------------- atab-pick-alt [81] 100.0% [86] 1380(1.5%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [151] 100.0% -------------------------------------------------------------------------------- atab-add-altn [83] 100.0% [87] 7168(8.0%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [93] 100.0% -------------------------------------------------------------------------------- ??? [84] 100.0% [88] 2232(2.5%) 1399(1.6%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [95] 12.5% loop [96] 12.4% blame-add-missing-party [97] 12.3% -------------------------------------------------------------------------------- ??? [78] 16.7% ??? [84] 83.3% [89] 1687(1.9%) 282(0.3%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [131] 83.3% -------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [85] 100.0% [90] 1406(1.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [94] 100.0% -------------------------------------------------------------------------------- atab-add-altn [83] 100.0% [91] 554(0.6%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [93] 100.0% -------------------------------------------------------------------------------- ??? [84] 100.0% [92] 278(0.3%) 278(0.3%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 -------------------------------------------------------------------------------- override-at-pnts [91] 2.9% composed [123] 7.4% best-and-tied-at-points [87] 38.1% loop [151] 51.5% [93] 18806(21.0%) 553(0.6%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [98] 69.3% eval-prog [100] 24.8% ??? [99] 1.5% ulp-difference [103] 1.5% -------------------------------------------------------------------------------- ??? [90] 100.0% [94] 1406(1.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [101] 79.9% blame-add-context [102] 20.1% -------------------------------------------------------------------------------- ??? [88] 50.0% make-curried [61] 50.0% [95] 560(0.6%) 560(0.6%) make-keyword-procedure ...ket/private/kw.rkt:448:4 -------------------------------------------------------------------------------- ??? [88] 33.3% loop [96] 66.7% [96] 278(0.3%) 278(0.3%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [96] 66.7% -------------------------------------------------------------------------------- ??? [88] 100.0% [97] 275(0.3%) 275(0.3%) blame-add-missing-party ...private/blame.rkt:382:0 -------------------------------------------------------------------------------- generic-sort/key [16] 2.7% ??? [12] 2.7% copying-mergesort [19] 13.5% loop [151] 17.5% errors [93] 63.6% [98] 20514(22.9%) 11450(12.8%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [106] 23.1% loop [151] 9.7% ??? [109] 5.5% ??? [161] 4.5% ??? [149] 1.4% -------------------------------------------------------------------------------- errors [93] 2.4% ??? [23] 2.5% ??? [12] 2.5% atab-pick-alt [81] 9.7% f53 [148] 16.8% loop [151] 17.4% loop [104] 24.3% taylor-alt [34] 24.3% [99] 11422(12.7%) 312(0.3%) ??? ...tract/private/arrow-higher-order.rkt:375:33 loop [104] 24.3% approximate [105] 24.3% ->flonum [107] 17.1% best-alt [110] 9.7% table-ref [77] 4.9% ??? [78] 4.8% ...sting/src/common.rkt:47:2 [115] 4.7% real->bigfloat [112] 2.6% sample-multi-bounded [113] 2.5% ??? [132] 2.4% -------------------------------------------------------------------------------- option-on-expr [2] 5.6% errors [93] 94.4% [100] 4942(5.5%) 3017(3.4%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f53 [148] 38.9% -------------------------------------------------------------------------------- loop [151] 7.0% ??? [78] 35.7% ??? [94] 57.3% [101] 1958(2.2%) 284(0.3%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [108] 64.3% unconstrained-domain->-projection [111] 21.2% -------------------------------------------------------------------------------- ??? [94] 100.0% [102] 283(0.3%) 283(0.3%) blame-add-context ...tract/private/blame.rkt:170:0 -------------------------------------------------------------------------------- errors [93] 100.0% [103] 276(0.3%) 0(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 list-member? [117] 100.0% -------------------------------------------------------------------------------- ??? [99] 22.1% loop [104] 77.9% [104] 5545(6.2%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [104] 77.9% ??? [99] 22.1% -------------------------------------------------------------------------------- ??? [99] 100.0% [105] 5545(6.2%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [129] 49.5% ??? [114] 35.3% taylor [120] 15.2% -------------------------------------------------------------------------------- ??? [98] 100.0% [106] 4736(5.3%) 1407(1.6%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [130] 46.7% ...sting/src/common.rkt:47:2 [115] 11.8% list-member? [117] 6.0% set-member? [116] 5.8% -------------------------------------------------------------------------------- ??? [99] 100.0% [107] 1948(2.2%) 830(0.9%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [130] 28.4% ...sting/src/common.rkt:47:2 [115] 14.6% set-member? [116] 14.3% -------------------------------------------------------------------------------- get/build-late-neg-projection [101] 100.0% [108] 1396(1.6%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [119] 80.5% reverse [137] 19.5% -------------------------------------------------------------------------------- ??? [98] 100.0% [109] 1130(1.3%) 1130(1.3%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 -------------------------------------------------------------------------------- ??? [99] 100.0% [110] 1113(1.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [118] 100.0% -------------------------------------------------------------------------------- get/build-late-neg-projection [101] 100.0% [111] 551(0.6%) 278(0.3%) unconstrained-domain->-projection ...rrow.rkt:60:0 loop [151] 49.5% -------------------------------------------------------------------------------- ??? [99] 100.0% [112] 296(0.3%) 0(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [167] 100.0% -------------------------------------------------------------------------------- ??? [99] 100.0% [113] 284(0.3%) 0(0.0%) sample-multi-bounded ...esting/src/points.rkt:44:0 flonum->ordinal [121] 100.0% -------------------------------------------------------------------------------- approximate [105] 41.6% ??? [3] 58.4% [114] 4702(5.2%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- ->flonum [107] 12.8% ??? [99] 24.2% ??? [106] 25.2% expression-cost [53] 37.8% [115] 2229(2.5%) 846(0.9%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [125] 37.6% ??? [127] 24.5% -------------------------------------------------------------------------------- ??? [106] 14.1% one-iter [46] 14.2% ->flonum [107] 14.3% loop! [55] 14.5% match-e [50] 43.0% [116] 1950(2.2%) 1950(2.2%) set-member? ...ts/racket/private/generic.rkt:472:9 -------------------------------------------------------------------------------- ulp-difference [103] 19.7% ??? [106] 20.1% one-iter [46] 60.2% [117] 1404(1.6%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [122] 100.0% -------------------------------------------------------------------------------- extract-alt [32] 19.9% best-alt [110] 80.1% [118] 1390(1.6%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [123] 100.0% -------------------------------------------------------------------------------- ??? [108] 100.0% [119] 1123(1.3%) 0(0.0%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [124] 75.2% check-list [160] 24.8% -------------------------------------------------------------------------------- taylor [120] 39.0% approximate [105] 61.0% [120] 843(0.9%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [120] 39.0% f53 [148] 33.2% taylor-sqrt [126] 16.6% taylor-log [128] 11.2% -------------------------------------------------------------------------------- sample-multi-bounded [113] 100.0% [121] 284(0.3%) 284(0.3%) flonum->ordinal ...ate/flonum/flonum-bits.rkt:68:0 -------------------------------------------------------------------------------- list-member? [117] 100.0% [122] 1404(1.6%) 1404(1.6%) member ...collects/racket/private/member.rkt:13:21 -------------------------------------------------------------------------------- argmins [118] 100.0% [123] 1390(1.6%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [93] 100.0% -------------------------------------------------------------------------------- build-compound-type-name [119] 100.0% [124] 845(0.9%) 845(0.9%) contract-struct-name ...ract/private/prop.rkt:98:0 -------------------------------------------------------------------------------- ??? [131] 16.7% ...sting/src/common.rkt:47:2 [115] 83.3% [125] 837(0.9%) 275(0.3%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [133] 33.7% ??? [131] 16.7% ??? [132] 16.7% -------------------------------------------------------------------------------- f53 [148] 49.9% taylor [120] 50.1% [126] 560(0.6%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [115] 100.0% [127] 546(0.6%) 0(0.0%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 assoc-ref [134] 51.5% return/no-unsupplied [130] 48.5% -------------------------------------------------------------------------------- taylor [120] 100.0% [128] 283(0.3%) 0(0.0%) taylor-log ...lt-testing/src/core/taylor.rkt:476:0 simplify [135] 100.0% -------------------------------------------------------------------------------- composed [5] 2.4% localize-error [36] 2.4% ??? [143] 2.6% ??? [144] 2.8% ??? [142] 2.8% simplify* [4] 4.9% ??? [141] 6.0% ??? [139] 8.8% taylor-sqrt [126] 9.6% approximate [105] 11.5% ??? [136] 23.2% ??? [114] 23.2% [129] 5824(6.5%) 283(0.3%) hash-ref! .../racket/private/more-scheme.rkt:377:2 simplify [135] 32.8% ??? [136] 23.2% ??? [3] 11.5% ??? [139] 8.8% ??? [141] 6.0% f53 [148] 4.8% ??? [142] 2.8% ??? [144] 2.8% ??? [143] 2.6% -------------------------------------------------------------------------------- ??? [127] 8.0% table-ref [77] 8.6% ->flonum [107] 16.7% ??? [106] 66.7% [130] 3314(3.7%) 1106(1.2%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [138] 58.4% reverse [137] 8.3% -------------------------------------------------------------------------------- ??? [125] 16.6% handle-the-hash [89] 83.4% [131] 1684(1.9%) 0(0.0%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [140] 83.4% ??? [125] 16.6% -------------------------------------------------------------------------------- ??? [99] 49.8% ??? [125] 50.2% [132] 558(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [147] 50.2% ??? [76] 49.8% -------------------------------------------------------------------------------- ??? [125] 100.0% [133] 282(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [145] 100.0% -------------------------------------------------------------------------------- ??? [127] 100.0% [134] 281(0.3%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [146] 100.0% -------------------------------------------------------------------------------- taylor-log [128] 5.1% hash-ref! [129] 94.9% [135] 5545(6.2%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f53 [148] 100.0% -------------------------------------------------------------------------------- hash-ref! [129] 100.0% [136] 4702(5.2%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- ??? [108] 7.6% return/no-unsupplied [130] 7.6% one-iter [46] 7.7% ??? [72] 7.8% table-ref [77] 7.8% hash-has-key? [80] 7.9% match-e [50] 23.1% ??? [69] 30.6% [137] 3607(4.0%) 3607(4.0%) reverse ...collects/racket/private/reverse.rkt:6:4 -------------------------------------------------------------------------------- loop [43] 10.1% one-iter [46] 20.2% return/no-unsupplied [130] 69.7% [138] 2775(3.1%) 2775(3.1%) filter ...t/collects/racket/private/list.rkt:275:2 -------------------------------------------------------------------------------- hash-ref! [129] 100.0% [139] 1912(2.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- ??? [131] 100.0% [140] 1404(1.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [149] 60.1% check-list [160] 39.9% -------------------------------------------------------------------------------- hash-ref! [129] 100.0% [141] 1395(1.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- hash-ref! [129] 100.0% [142] 840(0.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- hash-ref! [129] 100.0% [143] 836(0.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:357:30 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- hash-ref! [129] 100.0% [144] 549(0.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [129] 100.0% -------------------------------------------------------------------------------- ??? [133] 100.0% [145] 282(0.3%) 0(0.0%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [150] 100.0% -------------------------------------------------------------------------------- assoc-ref [134] 100.0% [146] 281(0.3%) 281(0.3%) assoc ...t/collects/racket/private/list.rkt:196:13 -------------------------------------------------------------------------------- ??? [132] 100.0% [147] 280(0.3%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [153] 100.0% -------------------------------------------------------------------------------- taylor [120] 0.2% hash-ref! [129] 1.3% rewriter [38] 1.3% eval-prog [100] 3.5% simplify [135] 11.1% loop [151] 19.0% split-table [25] 63.5% [148] 21345(23.8%) 4702(5.2%) f53 ...t/collects/racket/match/compiler.rkt:548:40 loop [151] 85.0% ??? [99] 3.5% get-sigs [74] 1.3% taylor-sqrt [126] 0.2% -------------------------------------------------------------------------------- ??? [98] 25.3% ??? [140] 74.7% [149] 1130(1.3%) 280(0.3%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [152] 75.2% -------------------------------------------------------------------------------- check-hash/c [145] 100.0% [150] 282(0.3%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [153] 100.0% -------------------------------------------------------------------------------- loop [28] 0.0% unconstrained-domain->-projection [111] 0.1% ??? [98] 0.6% point-best-alt [86] 0.6% iterate-egraph! [42] 0.7% mk-enode-rec! [49] 0.8% loop! [55] 1.4% option-on-expr [2] 2.0% match-e [50] 3.5% f53 [148] 15.0% loop [151] 75.2% [151] 32967(36.8%) 1126(1.3%) loop .../private/map.rkt:40:19 loop [151] 75.2% f53 [148] 10.8% option-on-expr [2] 3.6% errors [93] 2.6% step [154] 1.9% loop! [55] 1.4% keyword-apply [159] 0.8% ??? [99] 0.6% mk-enode-rec! [49] 0.4% mk-enode! [56] 0.4% simplify* [4] 0.3% ??? [157] 0.1% get/build-late-neg-projection [101] 0.1% ??? [98] 0.0% composed [5] 0.0% bf* [158] 0.0% ??? [12] 0.0% -------------------------------------------------------------------------------- ??? [149] 100.0% [152] 850(0.9%) 0(0.0%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [155] 66.4% ^TYPE? [156] 33.6% -------------------------------------------------------------------------------- contract? [147] 49.8% flat-contract? [150] 50.2% [153] 562(0.6%) 562(0.6%) simple-flat-contract? ...ct/private/guts.rkt:141:0 -------------------------------------------------------------------------------- loop [151] 100.0% [154] 822(0.9%) 542(0.6%) step .../racket/collects/racket/function.rkt:145:9 sort [163] 34.0% -------------------------------------------------------------------------------- ??? [152] 100.0% [155] 564(0.6%) 284(0.3%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [160] 49.8% -------------------------------------------------------------------------------- ??? [152] 100.0% [156] 286(0.3%) 286(0.3%) ^TYPE? .../ffi/unsafe.rkt:1621:20 -------------------------------------------------------------------------------- loop [151] 100.0% [157] 282(0.3%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 pattern-match [162] 100.0% -------------------------------------------------------------------------------- loop [151] 100.0% [158] 279(0.3%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [161] 100.0% -------------------------------------------------------------------------------- loop [151] 100.0% [159] 278(0.3%) 0(0.0%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [164] 100.0% -------------------------------------------------------------------------------- custom-set-union [64] 19.8% build-compound-type-name [119] 19.9% ??? [155] 20.1% ??? [140] 40.1% [160] 1396(1.6%) 1396(1.6%) check-list ...ollects/racket/private/for.rkt:690:2 -------------------------------------------------------------------------------- bf* [158] 23.3% ??? [98] 76.7% [161] 1199(1.3%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [165] 74.3% bflog [166] 25.7% -------------------------------------------------------------------------------- ??? [157] 100.0% [162] 282(0.3%) 282(0.3%) pattern-match ...testing/src/core/matcher.rkt:48:0 -------------------------------------------------------------------------------- step [154] 100.0% [163] 279(0.3%) 279(0.3%) sort ...cket/collects/racket/private/list.rkt:43:2 -------------------------------------------------------------------------------- keyword-apply [159] 100.0% [164] 278(0.3%) 278(0.3%) loop ...cket/collects/racket/private/kw.rkt:518:13 -------------------------------------------------------------------------------- ??? [161] 100.0% [165] 890(1.0%) 325(0.4%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [167] 63.5% -------------------------------------------------------------------------------- ??? [161] 100.0% [166] 308(0.3%) 0(0.0%) bflog ...-lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [167] 100.0% -------------------------------------------------------------------------------- real->bigfloat [112] 25.3% bflog [166] 26.4% bfmul [165] 48.4% [167] 1170(1.3%) 1170(1.3%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 --------------------------------------------------------------------------------