Profiling results ----------------- Total cpu time observed: 106161ms (out of 106304ms) Number of samples taken: 365 (once every 291ms) (Hiding functions with self<1.0% and local<2.0%: 5 of 189 hidden) ======================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ======================================================================================== [1] 106161(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [7] 100.0% ---------------------------------------------------------------------------------------- loop [150] 100.0% [2] 3390(3.2%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [150] 33.2% sort-context-on-expr [9] 25.2% err-lsts->split-indices [10] 24.9% sindices->spoints [11] 8.3% pick-errors [12] 8.3% ---------------------------------------------------------------------------------------- loop [150] 100.0% [3] 1294(1.2%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [138] 77.9% f8 [141] 22.1% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [4] 1019(1.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 simplify [8] 72.4% ??? [13] 27.6% ---------------------------------------------------------------------------------------- taylor [125] 100.0% [5] 282(0.3%) 0(0.0%) taylor-exact ...-testing/src/core/taylor.rkt:252:0 loop [150] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [6] 282(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 simplify [8] 100.0% ---------------------------------------------------------------------------------------- ??? [1] 100.0% [7] 106161(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [14] 100.0% ---------------------------------------------------------------------------------------- ??? [6] 8.5% loop [150] 8.6% ??? [4] 22.4% hash-ref! [138] 60.5% [8] 3297(3.1%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [141] 91.4% debug-print [17] 8.6% ---------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [9] 856(0.8%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [15] 66.8% eval-prog [105] 33.2% ---------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [10] 845(0.8%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [157] 100.0% ---------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [11] 282(0.3%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 eval-prog [105] 100.0% ---------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [12] 282(0.3%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [16] 100.0% ---------------------------------------------------------------------------------------- ??? [4] 100.0% [13] 282(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- profile-thunk [7] 100.0% [14] 106161(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [18] 100.0% ---------------------------------------------------------------------------------------- step [155] 33.3% sort-context-on-expr [9] 66.7% [15] 856(0.8%) 285(0.3%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [19] 66.7% ---------------------------------------------------------------------------------------- loop [150] 49.7% pick-errors [12] 50.3% [16] 561(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [103] 100.0% ---------------------------------------------------------------------------------------- simplify [8] 100.0% [17] 282(0.3%) 282(0.3%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ---------------------------------------------------------------------------------------- ??? [14] 100.0% [18] 106161(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [20] 90.9% prepare-points [27] 9.1% ---------------------------------------------------------------------------------------- ??? [15] 100.0% [19] 572(0.5%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [21] 100.0% ---------------------------------------------------------------------------------------- ??? [18] 100.0% [20] 96503(90.9%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [22] 95.3% get-final-combination [23] 3.8% setup-prog! [24] 0.9% ---------------------------------------------------------------------------------------- copying-mergesort [21] 33.6% generic-sort/key [19] 66.4% [21] 572(0.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 ??? [103] 66.4% copying-mergesort [21] 33.6% ---------------------------------------------------------------------------------------- run-improve [20] 100.0% [22] 91986(86.6%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [25] 83.1% finalize-iter! [26] 11.6% gen-series! [28] 3.9% localize! [30] 1.1% ---------------------------------------------------------------------------------------- run-improve [20] 100.0% [23] 3680(3.5%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [29] 92.1% extract-alt [31] 7.9% ---------------------------------------------------------------------------------------- run-improve [20] 100.0% [24] 836(0.8%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [27] 100.0% ---------------------------------------------------------------------------------------- run-iter! [22] 100.0% [25] 76428(72.0%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [32] 100.0% ---------------------------------------------------------------------------------------- run-iter! [22] 100.0% [26] 10690(10.1%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [77] 100.0% ---------------------------------------------------------------------------------------- setup-prog! [24] 8.0% ??? [18] 92.0% [27] 10494(9.9%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [39] 56.4% make-exacts [33] 35.5% make-exacts* [40] 5.3% ??? [36] 2.9% ---------------------------------------------------------------------------------------- run-iter! [22] 100.0% [28] 3582(3.4%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [34] 100.0% ---------------------------------------------------------------------------------------- get-final-combination [23] 100.0% [29] 3390(3.2%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [141] 100.0% ---------------------------------------------------------------------------------------- run-iter! [22] 100.0% [30] 1009(1.0%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [35] 100.0% ---------------------------------------------------------------------------------------- get-final-combination [23] 100.0% [31] 290(0.3%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [37] 100.0% ---------------------------------------------------------------------------------------- simplify! [25] 100.0% [32] 76428(72.0%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [38] 100.0% ---------------------------------------------------------------------------------------- prepare-points [27] 100.0% [33] 3723(3.5%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [39] 84.7% make-exacts* [40] 7.7% loop [42] 7.6% ---------------------------------------------------------------------------------------- gen-series! [28] 100.0% [34] 3582(3.4%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [104] 100.0% ---------------------------------------------------------------------------------------- localize! [30] 100.0% [35] 1009(1.0%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- prepare-points [27] 100.0% [36] 300(0.3%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [104] 100.0% ---------------------------------------------------------------------------------------- extract-alt [31] 100.0% [37] 290(0.3%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [41] 100.0% ---------------------------------------------------------------------------------------- ??? [32] 100.0% [38] 76428(72.0%) 285(0.3%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [43] 98.5% *simplify-rules* [44] 1.1% ---------------------------------------------------------------------------------------- make-exacts [33] 34.8% prepare-points [27] 65.2% [39] 9067(8.5%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [150] 100.0% ---------------------------------------------------------------------------------------- make-exacts [33] 34.0% prepare-points [27] 66.0% [40] 844(0.8%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [105] 100.0% ---------------------------------------------------------------------------------------- argmins [37] 100.0% [41] 290(0.3%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [98] 100.0% ---------------------------------------------------------------------------------------- make-exacts [33] 0.3% loop [42] 99.7% [42] 284(0.3%) 284(0.3%) loop ...es/herbie/alt-testing/src/points.rkt:130:2 loop [42] 99.7% ---------------------------------------------------------------------------------------- simplify [38] 100.0% [43] 75286(70.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [45] 92.8% loop [46] 6.8% mk-egraph [48] 0.4% ---------------------------------------------------------------------------------------- simplify [38] 100.0% [44] 857(0.8%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [47] 100.0% ---------------------------------------------------------------------------------------- ??? [43] 100.0% [45] 69880(65.8%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [49] 97.1% loop [150] 2.9% ---------------------------------------------------------------------------------------- ??? [43] 100.0% [46] 5120(4.8%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [50] 50.2% loop [51] 33.1% partition [52] 5.7% hash-set*+ [54] 5.5% make-sequence [178] 5.5% ---------------------------------------------------------------------------------------- *simplify-rules* [44] 100.0% [47] 857(0.8%) 570(0.5%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [139] 33.4% ---------------------------------------------------------------------------------------- ??? [43] 100.0% [48] 286(0.3%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [53] 100.0% ---------------------------------------------------------------------------------------- iterate-egraph! [45] 100.0% [49] 67870(63.9%) 863(0.8%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [55] 44.5% merge-egraph-nodes! [56] 13.4% custom-set-member? [57] 13.1% loop! [153] 10.1% mk-enode! [60] 7.9% substitute-e [59] 5.5% list-member? [123] 1.3% update-leader! [61] 1.3% filter [143] 0.4% pack-leader [179] 0.4% reverse [170] 0.4% set-member? [71] 0.4% ---------------------------------------------------------------------------------------- loop [46] 100.0% [50] 2572(2.4%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [58] 100.0% ---------------------------------------------------------------------------------------- loop [46] 100.0% [51] 1694(1.6%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [58] 100.0% ---------------------------------------------------------------------------------------- loop [46] 100.0% [52] 290(0.3%) 0(0.0%) partition ...racket/collects/racket/list.rkt:556:0 reverse [170] 100.0% ---------------------------------------------------------------------------------------- mk-egraph [48] 20.0% loop [150] 80.0% [53] 286(0.3%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [150] 100.0% ---------------------------------------------------------------------------------------- loop [46] 100.0% [54] 282(0.3%) 282(0.3%) hash-set*+ ...-testing/src/core/simplify.rkt:209:0 ---------------------------------------------------------------------------------------- match-e [55] 22.0% one-iter [49] 78.0% [55] 30224(28.5%) 9412(8.9%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [55] 22.0% loop [150] 12.8% ??? [63] 8.4% ??? [77] 7.7% make-sequence [178] 5.2% variable? [62] 4.7% list-cartesian-product [64] 3.3% filter [143] 2.4% reverse [170] 1.9% check-list [140] 0.9% ??? [66] 0.9% do-procedure-reduce-keyword-arity [69] 0.9% pack-leader [179] 0.9% ---------------------------------------------------------------------------------------- merge-egraph-nodes! [56] 7.9% one-iter [49] 92.1% [56] 9114(8.6%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [61] 70.1% loop! [153] 18.9% merge-egraph-nodes! [56] 7.9% make-sequence [178] 3.2% ---------------------------------------------------------------------------------------- one-iter [49] 100.0% [57] 8863(8.3%) 8286(7.8%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [65] 6.5% ---------------------------------------------------------------------------------------- loop [51] 39.7% mk-min [50] 60.3% [58] 4266(4.0%) 287(0.3%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [78] 53.1% ...sting/src/common.rkt:47:2 [82] 20.2% compile [113] 20.0% ---------------------------------------------------------------------------------------- substitute-e [59] 23.1% one-iter [49] 76.9% [59] 3718(3.5%) 285(0.3%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [60] 53.9% substitute-e [59] 23.1% ??? [77] 10.2% variable? [62] 5.2% ---------------------------------------------------------------------------------------- loop [150] 3.7% substitute-e [59] 26.1% one-iter [49] 70.2% [60] 7684(7.2%) 1146(1.1%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [68] 77.6% hash-has-key? [81] 7.5% ---------------------------------------------------------------------------------------- one-iter [49] 11.2% merge-egraph-nodes! [56] 88.8% [61] 7676(7.2%) 572(0.5%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [67] 81.3% update-en-expr [171] 7.5% reverse [170] 3.7% ---------------------------------------------------------------------------------------- substitute-e [59] 14.4% match-e [55] 85.6% [62] 4004(3.8%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [77] 100.0% ---------------------------------------------------------------------------------------- match-e [55] 100.0% [63] 3394(3.2%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [70] 50.3% do-procedure-reduce-keyword-arity [69] 49.7% ---------------------------------------------------------------------------------------- list-cartesian-product [64] 37.4% match-e [55] 62.6% [64] 1140(1.1%) 1140(1.1%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [64] 37.4% ---------------------------------------------------------------------------------------- custom-set-member? [57] 100.0% [65] 577(0.5%) 577(0.5%) set-check-elem ...cket/private/set-types.rkt:329:0 ---------------------------------------------------------------------------------------- match-e [55] 100.0% [66] 286(0.3%) 0(0.0%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 set-member? [71] 100.0% ---------------------------------------------------------------------------------------- update-leader! [61] 100.0% [67] 6244(5.9%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [72] 100.0% ---------------------------------------------------------------------------------------- mk-enode! [60] 100.0% [68] 5964(5.6%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [73] 100.0% ---------------------------------------------------------------------------------------- match-e [55] 14.5% ??? [63] 85.5% [69] 1972(1.9%) 1686(1.6%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [74] 14.5% ---------------------------------------------------------------------------------------- ??? [63] 100.0% [70] 1708(1.6%) 858(0.8%) do-curry ...cket/collects/racket/function.rkt:71:2 procedure-keywords [74] 33.3% make-keyword-procedure [75] 16.5% ---------------------------------------------------------------------------------------- one-iter [49] 49.9% ??? [66] 50.1% [71] 572(0.5%) 572(0.5%) set-member? ...ts/racket/private/generic.rkt:472:9 ---------------------------------------------------------------------------------------- do-hash-update [67] 100.0% [72] 6244(5.9%) 4824(4.5%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 make-sequence [178] 9.1% update-en-expr [171] 9.0% reverse [170] 4.5% ---------------------------------------------------------------------------------------- new-enode [68] 100.0% [73] 5964(5.6%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [76] 100.0% ---------------------------------------------------------------------------------------- do-procedure-reduce-keyword-arity [69] 33.5% do-curry [70] 66.5% [74] 855(0.8%) 855(0.8%) procedure-keywords .../racket/private/kw.rkt:534:2 ---------------------------------------------------------------------------------------- do-curry [70] 100.0% [75] 281(0.3%) 281(0.3%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ---------------------------------------------------------------------------------------- type-of-enode-expr [73] 100.0% [76] 5964(5.6%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [79] 38.1% table-ref [78] 33.2% ...sting/src/common.rkt:47:2 [82] 19.0% ??? [77] 4.9% hash-has-key? [81] 4.7% ---------------------------------------------------------------------------------------- ??? [116] 1.4% get-sigs [76] 1.4% substitute-e [59] 4.2% match-e [55] 18.2% variable? [62] 19.6% finalize-iter! [26] 52.4% [77] 20408(19.2%) 288(0.3%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [80] 52.4% hash-has-key? [81] 44.8% atab-pick-alt [84] 1.4% ---------------------------------------------------------------------------------------- ??? [104] 6.1% get-sigs [76] 43.8% expression-cost [58] 50.1% [78] 4524(4.3%) 572(0.5%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [87] 75.1% ...sting/src/common.rkt:47:2 [82] 6.3% ??? [85] 6.0% ---------------------------------------------------------------------------------------- ??? [104] 10.6% get-sigs [76] 89.4% [79] 2543(2.4%) 270(0.3%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [83] 67.0% handle-the-hash [93] 22.4% ---------------------------------------------------------------------------------------- ??? [77] 100.0% [80] 10690(10.1%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [86] 100.0% ---------------------------------------------------------------------------------------- get-sigs [76] 2.8% mk-enode! [60] 5.7% ??? [77] 91.4% [81] 10010(9.4%) 8004(7.5%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [87] 20.0% ---------------------------------------------------------------------------------------- table-ref [78] 12.4% expression-cost [58] 37.8% get-sigs [76] 49.8% [82] 2278(2.1%) 283(0.3%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [89] 63.0% ??? [90] 24.6% ---------------------------------------------------------------------------------------- ??? [79] 100.0% [83] 1705(1.6%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [88] 100.0% ---------------------------------------------------------------------------------------- ??? [77] 100.0% [84] 276(0.3%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [91] 100.0% ---------------------------------------------------------------------------------------- table-ref [78] 100.0% [85] 272(0.3%) 272(0.3%) ??? ...cts/racket/contract/private/list.rkt:211:14 ---------------------------------------------------------------------------------------- atab-add-altns [80] 100.0% [86] 10690(10.1%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [92] 100.0% ---------------------------------------------------------------------------------------- hash-has-key? [81] 37.1% table-ref [78] 62.9% [87] 5402(5.1%) 2009(1.9%) ??? ...ects/racket/contract/private/list.rkt:814:4 successfully-got-the-right-kind-of-function [95] 15.8% ??? [96] 15.7% handle-the-hash [93] 15.4% arrow-higher-order:lnp [183] 10.6% ??? [99] 5.3% ---------------------------------------------------------------------------------------- ??? [83] 100.0% [88] 1705(1.6%) 284(0.3%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [94] 66.5% ??? [97] 16.9% ---------------------------------------------------------------------------------------- ??? [99] 20.0% ...sting/src/common.rkt:47:2 [82] 80.0% [89] 1434(1.4%) 860(0.8%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [99] 20.0% ??? [116] 20.0% ---------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [82] 100.0% [90] 560(0.5%) 282(0.3%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 return/no-unsupplied [139] 49.8% ---------------------------------------------------------------------------------------- atab-pick-alt [84] 100.0% [91] 276(0.3%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [150] 100.0% ---------------------------------------------------------------------------------------- atab-add-altn [86] 100.0% [92] 10690(10.1%) 282(0.3%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [98] 97.4% ---------------------------------------------------------------------------------------- ??? [79] 40.7% ??? [87] 59.3% [93] 1398(1.3%) 276(0.3%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [99] 80.2% ---------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [88] 100.0% [94] 1133(1.1%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [100] 74.8% do-blame-add-context [101] 25.2% ---------------------------------------------------------------------------------------- ??? [87] 100.0% [95] 856(0.8%) 571(0.5%) successfully-got-the-right-kind-of-function ...5:4 val-has-arrow-collapsible-support? [102] 33.3% ---------------------------------------------------------------------------------------- ??? [87] 100.0% [96] 846(0.8%) 846(0.8%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 ---------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [88] 100.0% [97] 288(0.3%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:44 do-blame-add-context [101] 100.0% ---------------------------------------------------------------------------------------- composed [41] 2.4% loop [150] 9.5% best-and-tied-at-points [92] 88.1% [98] 11820(11.1%) 562(0.5%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [103] 69.2% eval-prog [105] 16.6% ??? [104] 7.1% ulp-difference [107] 2.4% ---------------------------------------------------------------------------------------- ??? [87] 14.5% ??? [89] 28.9% handle-the-hash [93] 56.6% [99] 1982(1.9%) 286(0.3%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [106] 56.6% ??? [89] 28.9% ---------------------------------------------------------------------------------------- ??? [94] 100.0% [100] 847(0.8%) 566(0.5%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [108] 33.1% ---------------------------------------------------------------------------------------- ??? [94] 49.8% ??? [97] 50.2% [101] 574(0.5%) 574(0.5%) do-blame-add-context ...ct/private/blame.rkt:192:0 ---------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [95]100.0% [102] 285(0.3%) 285(0.3%) val-has-arrow-collapsible-support? ...le.rkt:116:0 ---------------------------------------------------------------------------------------- ??? [16] 3.2% copying-mergesort [21] 3.3% errors [98] 46.7% loop [150] 46.8% [103] 17490(16.5%) 8891(8.4%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [154] 16.6% ??? [112] 16.1% loop [150] 8.1% bf* [114] 5.0% ??? [115] 1.7% ??? [119] 1.6% ---------------------------------------------------------------------------------------- ??? [36] 3.6% loop [151] 6.7% f8 [141] 9.9% errors [98] 10.0% loop [109] 21.3% taylor-alt [34] 21.3% loop [150] 27.4% [104] 8424(7.9%) 281(0.3%) ??? ...tract/private/arrow-higher-order.rkt:375:33 ->flonum [111] 33.9% loop [109] 21.3% approximate [110] 21.3% real->bigfloat [117] 6.8% sample-multi-bounded [118] 3.6% ??? [116] 3.4% table-ref [78] 3.3% ??? [79] 3.2% ---------------------------------------------------------------------------------------- sindices->spoints [11] 8.4% sort-context-on-expr [9] 8.4% make-exacts* [40] 25.0% errors [98] 58.2% [105] 3371(3.2%) 1700(1.6%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f8 [141] 24.6% compile [113] 16.5% ??? [120] 8.4% ---------------------------------------------------------------------------------------- ??? [99] 100.0% [106] 1122(1.1%) 548(0.5%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [115] 51.2% ---------------------------------------------------------------------------------------- errors [98] 100.0% [107] 282(0.3%) 282(0.3%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 ---------------------------------------------------------------------------------------- ??? [100] 100.0% [108] 280(0.3%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [121] 100.0% ---------------------------------------------------------------------------------------- ??? [104] 8.9% loop [109] 91.1% [109] 3582(3.4%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [109] 91.1% ??? [104] 8.9% ---------------------------------------------------------------------------------------- ??? [104] 100.0% [110] 3582(3.4%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [122] 68.3% taylor [125] 23.9% taylor-sqrt [130] 7.9% ---------------------------------------------------------------------------------------- ??? [104] 100.0% [111] 2858(2.7%) 1694(1.6%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [139] 20.1% ^TYPE? [126] 10.8% ??? [129] 9.9% ---------------------------------------------------------------------------------------- ??? [103] 100.0% [112] 2822(2.7%) 1974(1.9%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [139] 20.0% list-member? [123] 10.0% ---------------------------------------------------------------------------------------- eval-prog [105] 39.5% expression-cost [58] 60.5% [113] 1411(1.3%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- ??? [103] 100.0% [114] 881(0.8%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [154] 100.0% ---------------------------------------------------------------------------------------- ??? [103] 33.6% ??? [106] 66.4% [115] 866(0.8%) 0(0.0%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [124] 100.0% ---------------------------------------------------------------------------------------- ??? [104] 33.1% ??? [89] 66.9% [116] 858(0.8%) 0(0.0%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [127] 66.9% ??? [77] 33.1% ---------------------------------------------------------------------------------------- ??? [104] 100.0% [117] 572(0.5%) 0(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [172] 100.0% ---------------------------------------------------------------------------------------- ??? [104] 100.0% [118] 300(0.3%) 300(0.3%) sample-multi-bounded ...esting/src/points.rkt:44:0 ---------------------------------------------------------------------------------------- ??? [103] 100.0% [119] 286(0.3%) 0(0.0%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [126] 100.0% ---------------------------------------------------------------------------------------- eval-prog [105] 100.0% [120] 284(0.3%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [128] 100.0% ---------------------------------------------------------------------------------------- get/build-late-neg-projection [108] 100.0% [121] 280(0.3%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [131] 100.0% ---------------------------------------------------------------------------------------- approximate [110] 100.0% [122] 2446(2.3%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- ??? [112] 24.8% one-iter [49] 75.2% [123] 1144(1.1%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [132] 100.0% ---------------------------------------------------------------------------------------- ??? [115] 100.0% [124] 866(0.8%) 574(0.5%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [134] 33.7% ---------------------------------------------------------------------------------------- loop [150] 11.1% taylor [125] 16.5% f8 [141] 19.4% approximate [110] 53.0% [125] 854(0.8%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 normalize-series [135] 33.6% loop [150] 22.3% taylor [125] 16.5% debug [136] 11.1% f8 [141] 8.3% taylor-exact [5] 8.3% ---------------------------------------------------------------------------------------- ??? [119] 48.1% ->flonum [111] 51.9% [126] 594(0.6%) 594(0.6%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ---------------------------------------------------------------------------------------- ??? [116] 100.0% [127] 574(0.5%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [133] 100.0% ---------------------------------------------------------------------------------------- ??? [120] 100.0% [128] 284(0.3%) 284(0.3%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ---------------------------------------------------------------------------------------- ->flonum [111] 100.0% [129] 282(0.3%) 282(0.3%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 ---------------------------------------------------------------------------------------- approximate [110] 100.0% [130] 282(0.3%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- contract-struct-name [137] 50.0% ??? [121] 50.0% [131] 280(0.3%) 0(0.0%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [137] 100.0% ---------------------------------------------------------------------------------------- list-member? [123] 100.0% [132] 1144(1.1%) 1144(1.1%) member ...collects/racket/private/member.rkt:13:21 ---------------------------------------------------------------------------------------- contract? [127] 100.0% [133] 574(0.5%) 574(0.5%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ---------------------------------------------------------------------------------------- ??? [124] 100.0% [134] 292(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [140] 100.0% ---------------------------------------------------------------------------------------- taylor [125] 100.0% [135] 287(0.3%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- taylor [125] 100.0% [136] 286(0.3%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 return/no-unsupplied [139] 100.0% ---------------------------------------------------------------------------------------- build-compound-type-name [131] 100.0% [137] 280(0.3%) 280(0.3%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [131] 50.0% ---------------------------------------------------------------------------------------- ??? [13] 1.7% taylor-sqrt [130] 1.7% ??? [149] 2.1% normalize-series [135] 2.6% ??? [147] 3.5% localize-error [35] 4.7% ??? [146] 4.7% ??? [144] 6.1% compile [113] 11.8% ??? [142] 13.4% composed [3] 13.9% loop [150] 14.1% ??? [122] 18.7% [138] 5435(5.1%) 572(0.5%) hash-ref! .../racket/private/more-scheme.rkt:377:2 f8 [141] 18.6% simplify [8] 18.4% ??? [145] 15.2% ??? [142] 13.4% bigfloat-hash [148] 7.7% ??? [144] 6.1% ??? [146] 4.7% ??? [4] 4.7% ??? [147] 3.5% ??? [149] 2.1% ??? [6] 1.7% ---------------------------------------------------------------------------------------- ??? [90] 14.0% debug [136] 14.3% flag-set? [47] 14.4% ??? [112] 28.4% ->flonum [111] 28.8% [139] 1990(1.9%) 863(0.8%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [143] 28.4% reverse [170] 28.3% ---------------------------------------------------------------------------------------- match-e [55] 49.6% ??? [134] 50.4% [140] 578(0.5%) 578(0.5%) check-list ...ollects/racket/private/for.rkt:690:2 ---------------------------------------------------------------------------------------- eval-prog [105] 1.5% taylor [125] 3.3% composed [3] 3.3% hash-ref! [138] 11.8% loop [150] 18.9% simplify [8] 24.2% split-table [29] 36.8% [141] 8528(8.0%) 3015(2.8%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [150] 65.7% taylor [125] 6.7% loop [151] 1.9% ??? [104] 1.5% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [142] 2160(2.0%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- one-iter [49] 16.8% return/no-unsupplied [139] 33.1% match-e [55] 50.1% [143] 1707(1.6%) 1707(1.6%) filter ...t/collects/racket/private/list.rkt:275:2 ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [144] 1141(1.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [145] 1126(1.1%) 282(0.3%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [150] 95.0% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [146] 1019(1.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [147] 854(0.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [148] 557(0.5%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [152] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [149] 448(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:357:30 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- point-best-alt [91] 0.1% set-precompute! [156] 0.1% option-on-expr [2] 0.4% iterate-egraph! [45] 0.4% loop [39] 0.6% mk-enode-rec! [53] 0.8% taylor-exact [5] 1.0% taylor [125] 1.0% ??? [103] 2.1% loop! [153] 2.2% ??? [145] 2.8% f8 [141] 8.6% match-e [55] 10.6% loop [150] 69.5% [150] 29684(28.0%) 834(0.8%) loop .../private/map.rkt:40:19 loop [150] 69.5% step [155] 6.9% f8 [141] 5.4% hash-ref! [138] 2.8% ??? [104] 2.1% loop! [153] 2.0% composed [3] 1.9% option-on-expr [2] 1.7% foldl [158] 1.5% simplify [8] 1.0% mk-enode-rec! [53] 0.6% ??? [103] 0.6% taylor [125] 0.5% errors [98] 0.5% set-precompute! [156] 0.4% mk-enode! [60] 0.2% keyword-apply [160] 0.1% ??? [16] 0.0% ??? [154] 0.0% ??? [157] 0.0% ---------------------------------------------------------------------------------------- f8 [141] 0.4% loop [151] 99.6% [151] 563(0.5%) 0(0.0%) loop .../private/map.rkt:54:19 loop [151] 99.6% ??? [104] 0.4% ---------------------------------------------------------------------------------------- bigfloat-hash [148] 100.0% [152] 557(0.5%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [159] 100.0% ---------------------------------------------------------------------------------------- merge-egraph-nodes! [56] 17.8% loop [150] 28.0% one-iter [49] 54.1% [153] 8834(8.3%) 860(0.8%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 loop [150] 34.2% custom-set-union [161] 33.9% ??? [163] 14.0% make-immutable-set [164] 11.3% ---------------------------------------------------------------------------------------- loop [150] 10.6% bf* [114] 20.9% ??? [103] 68.6% [154] 4222(4.0%) 284(0.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [162] 72.2% bfatan [165] 21.1% ---------------------------------------------------------------------------------------- loop [150] 100.0% [155] 2284(2.2%) 1998(1.9%) step .../racket/collects/racket/function.rkt:145:9 ??? [15] 12.5% ---------------------------------------------------------------------------------------- loop [150] 100.0% [156] 2010(1.9%) 860(0.8%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [150] 28.7% eval-const-expr [167] 14.4% simple-compose [169] 14.1% ---------------------------------------------------------------------------------------- loop [150] 25.3% err-lsts->split-indices [10] 74.7% [157] 1132(1.1%) 1132(1.1%) ??? ...e/racket/collects/racket/function.rkt:93:12 ---------------------------------------------------------------------------------------- loop [150] 100.0% [158] 857(0.8%) 286(0.3%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [166] 66.6% ---------------------------------------------------------------------------------------- bfcanonicalize [152] 100.0% [159] 557(0.5%) 557(0.5%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ---------------------------------------------------------------------------------------- loop [150] 100.0% [160] 286(0.3%) 0(0.0%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [168] 100.0% ---------------------------------------------------------------------------------------- loop! [153] 100.0% [161] 3138(3.0%) 2279(2.1%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [174] 27.4% ---------------------------------------------------------------------------------------- ??? [154] 100.0% [162] 3047(2.9%) 1580(1.5%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:846:4 ??? [173] 29.3% ??? [177] 9.5% new-mpfr [172] 9.4% ---------------------------------------------------------------------------------------- loop! [153] 100.0% [163] 2288(2.2%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [171] 50.1% reverse [170] 49.9% ---------------------------------------------------------------------------------------- loop! [153] 100.0% [164] 2002(1.9%) 2002(1.9%) make-immutable-set .../private/set-types.rkt:948:0 ---------------------------------------------------------------------------------------- ??? [154] 100.0% [165] 892(0.8%) 588(0.6%) bfatan ...lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [172] 34.1% ---------------------------------------------------------------------------------------- foldl [158] 100.0% [166] 570(0.5%) 0(0.0%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [175] 100.0% ---------------------------------------------------------------------------------------- set-precompute! [156] 100.0% [167] 290(0.3%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 kw-chaperone [176] 100.0% ---------------------------------------------------------------------------------------- keyword-apply [160] 100.0% [168] 286(0.3%) 286(0.3%) loop ...cket/collects/racket/private/kw.rkt:518:13 ---------------------------------------------------------------------------------------- set-precompute! [156] 100.0% [169] 284(0.3%) 284(0.3%) simple-compose ...s/racket/private/list.rkt:426:10 ---------------------------------------------------------------------------------------- ??? [72] 8.3% update-leader! [61] 8.3% one-iter [49] 8.4% partition [52] 8.5% return/no-unsupplied [139] 16.4% match-e [55] 16.7% ??? [163] 33.4% [170] 3422(3.2%) 3422(3.2%) reverse ...collects/racket/private/reverse.rkt:6:4 ---------------------------------------------------------------------------------------- ??? [72] 24.7% update-leader! [61] 25.2% ??? [163] 50.1% [171] 2286(2.2%) 1142(1.1%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [179] 25.2% make-sequence [178] 24.8% ---------------------------------------------------------------------------------------- bfdiv [162] 24.6% bfatan [165] 26.2% real->bigfloat [117] 49.2% [172] 1162(1.1%) 1162(1.1%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ---------------------------------------------------------------------------------------- bfdiv [162] 100.0% [173] 892(0.8%) 892(0.8%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ---------------------------------------------------------------------------------------- custom-set-union [161] 100.0% [174] 858(0.8%) 858(0.8%) choose-immutable ...et/private/set-types.rkt:151:0 ---------------------------------------------------------------------------------------- merge2 [166] 100.0% [175] 570(0.5%) 570(0.5%) assoc ...t/collects/racket/private/list.rkt:196:13 ---------------------------------------------------------------------------------------- eval-const-expr [167] 100.0% [176] 290(0.3%) 0(0.0%) kw-chaperone ...ects/racket/private/kw.rkt:2036:33 ...row-higher-order.rkt:387:44 [180] 100.0% ---------------------------------------------------------------------------------------- bfdiv [162] 100.0% [177] 289(0.3%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [181] 100.0% ---------------------------------------------------------------------------------------- loop [46] 8.2% merge-egraph-nodes! [56] 8.5% update-en-expr [171] 16.6% ??? [72] 16.7% match-e [55] 50.0% [178] 3414(3.2%) 2270(2.1%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [182] 33.5% ---------------------------------------------------------------------------------------- match-e [55] 24.6% one-iter [49] 25.1% update-en-expr [171] 50.3% [179] 1146(1.1%) 1146(1.1%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ---------------------------------------------------------------------------------------- kw-chaperone [176] 100.0% [180] 290(0.3%) 0(0.0%) ...row-higher-order.rkt:387:44 ...order.rkt:387:44 arrow-higher-order:lnp [183] 100.0% ---------------------------------------------------------------------------------------- ??? [177] 100.0% [181] 289(0.3%) 289(0.3%) assq ...et/collects/racket/private/list.rkt:187:13 ---------------------------------------------------------------------------------------- make-sequence [178] 100.0% [182] 1144(1.1%) 1144(1.1%) :hash-gen ...collects/racket/private/for.rkt:781:4 ---------------------------------------------------------------------------------------- ...row-higher-order.rkt:387:44 [180] 33.5% ??? [87] 66.5% [183] 864(0.8%) 288(0.3%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ??? [184] 66.7% ---------------------------------------------------------------------------------------- arrow-higher-order:lnp [183] 100.0% [184] 576(0.5%) 576(0.5%) ??? ...et/contract/private/arity-checking.rkt:19:2 ----------------------------------------------------------------------------------------