Profiling results ----------------- Total cpu time observed: 156000ms (out of 156362ms) Number of samples taken: 556 (once every 281ms) (Hiding functions with self<1.0% and local<2.0%: 10 of 198 hidden) ================================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ================================================================================ [1] 156000(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [10] 100.0% -------------------------------------------------------------------------------- loop [125] 100.0% [2] 6076(3.9%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [12] 45.5% loop [125] 36.4% pick-errors [13] 9.1% err-lsts->split-indices [14] 9.1% -------------------------------------------------------------------------------- hash-ref! [137] 100.0% [3] 5003(3.2%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [126] 100.0% -------------------------------------------------------------------------------- hash-ref! [137] 100.0% [4] 1408(0.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 simplify [11] 80.1% hash-ref! [137] 19.9% -------------------------------------------------------------------------------- hash-ref! [137] 100.0% [5] 1132(0.7%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [125] 100.0% -------------------------------------------------------------------------------- loop [125] 100.0% [6] 844(0.5%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [137] 100.0% -------------------------------------------------------------------------------- taylor [162] 100.0% [7] 556(0.4%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [11] 100.0% -------------------------------------------------------------------------------- taylor [162] 100.0% [8] 284(0.2%) 0(0.0%) taylor-exact ...-testing/src/core/taylor.rkt:252:0 loop [125] 100.0% -------------------------------------------------------------------------------- expression->type [9] 50.0% loop [18] 50.0% [9] 280(0.2%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 expression->type [9] 50.0% f8 [109] 50.0% -------------------------------------------------------------------------------- ??? [1] 100.0% [10] 156000(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [15] 100.0% -------------------------------------------------------------------------------- loop [125] 1.9% taylor-invert [7] 3.7% ??? [4] 7.5% hash-ref! [137] 86.9% [11] 14988(9.6%) 284(0.2%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [109] 88.8% debug-print [172] 7.4% loop [18] 1.9% -------------------------------------------------------------------------------- option-on-expr [2] 100.0% [12] 2762(1.8%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [16] 80.0% eval-prog [105] 20.0% -------------------------------------------------------------------------------- option-on-expr [2] 100.0% [13] 552(0.4%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [17] 100.0% -------------------------------------------------------------------------------- option-on-expr [2] 100.0% [14] 550(0.4%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 loop [19] 50.2% ??? [20] 49.8% -------------------------------------------------------------------------------- profile-thunk [10] 100.0% [15] 156000(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [21] 100.0% -------------------------------------------------------------------------------- sort-context-on-expr [12] 100.0% [16] 2208(1.4%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [22] 100.0% -------------------------------------------------------------------------------- loop [125] 33.3% pick-errors [13] 66.7% [17] 827(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [104] 66.5% ??? [103] 33.5% -------------------------------------------------------------------------------- simplify [11] 16.7% loop [18] 83.3% [18] 280(0.2%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 loop [18] 83.3% expression->type [9] 16.7% -------------------------------------------------------------------------------- err-lsts->split-indices [14] 0.8% loop [19] 99.2% [19] 276(0.2%) 276(0.2%) loop ...hare/racket/collects/racket/list.rkt:158:2 loop [19] 99.2% -------------------------------------------------------------------------------- err-lsts->split-indices [14] 100.0% [20] 274(0.2%) 274(0.2%) ??? ...e/racket/collects/racket/function.rkt:93:12 -------------------------------------------------------------------------------- ??? [15] 100.0% [21] 156000(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [23] 90.4% prepare-points [30] 9.6% -------------------------------------------------------------------------------- ??? [16] 100.0% [22] 2208(1.4%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [24] 75.0% ??? [104] 25.0% -------------------------------------------------------------------------------- ??? [21] 100.0% [23] 141002(90.4%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [25] 93.7% get-final-combination [26] 4.5% setup-alt-simplified [27] 1.4% setup-prog! [28] 0.4% -------------------------------------------------------------------------------- copying-mergesort [24] 47.4% generic-sort/key [22] 52.6% [24] 1656(1.1%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [24] 47.4% ??? [104] 31.7% ??? [103] 20.8% -------------------------------------------------------------------------------- run-improve [23] 100.0% [25] 132130(84.7%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [29] 80.1% gen-series! [31] 11.8% finalize-iter! [32] 6.4% localize! [35] 0.8% choose-best-alt! [36] 0.8% -------------------------------------------------------------------------------- run-improve [23] 100.0% [26] 6347(4.1%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [33] 95.7% extract-alt [37] 4.3% -------------------------------------------------------------------------------- run-improve [23] 100.0% [27] 1962(1.3%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [34] 100.0% -------------------------------------------------------------------------------- run-improve [23] 100.0% [28] 562(0.4%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [30] 100.0% -------------------------------------------------------------------------------- run-iter! [25] 100.0% [29] 105898(67.9%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [38] 100.0% -------------------------------------------------------------------------------- setup-prog! [28] 3.6% ??? [21] 96.4% [30] 15560(10.0%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [44] 52.6% make-exacts [40] 40.0% ??? [42] 5.6% make-exacts* [45] 1.8% -------------------------------------------------------------------------------- run-iter! [25] 100.0% [31] 15555(10.0%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [39] 100.0% -------------------------------------------------------------------------------- run-iter! [25] 100.0% [32] 8492(5.4%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [80] 100.0% -------------------------------------------------------------------------------- get-final-combination [26] 100.0% [33] 6076(3.9%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [109] 100.0% -------------------------------------------------------------------------------- setup-alt-simplified [27] 100.0% [34] 1962(1.3%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [43] 100.0% -------------------------------------------------------------------------------- run-iter! [25] 100.0% [35] 1105(0.7%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [41] 100.0% -------------------------------------------------------------------------------- run-iter! [25] 100.0% [36] 1081(0.7%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [80] 100.0% -------------------------------------------------------------------------------- get-final-combination [26] 100.0% [37] 271(0.2%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [134] 100.0% -------------------------------------------------------------------------------- simplify! [29] 100.0% [38] 105898(67.9%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [43] 100.0% -------------------------------------------------------------------------------- gen-series! [31] 100.0% [39] 15555(10.0%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [103] 100.0% -------------------------------------------------------------------------------- prepare-points [30] 100.0% [40] 6218(4.0%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [44] 81.9% make-exacts* [45] 18.1% -------------------------------------------------------------------------------- localize! [35] 100.0% [41] 1105(0.7%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [137] 100.0% -------------------------------------------------------------------------------- prepare-points [30] 100.0% [42] 870(0.6%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [103] 100.0% -------------------------------------------------------------------------------- simplify-alt [34] 1.8% ??? [38] 98.2% [43] 107860(69.1%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [46] 100.0% -------------------------------------------------------------------------------- make-exacts [40] 38.3% prepare-points [30] 61.7% [44] 13282(8.5%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [125] 100.0% -------------------------------------------------------------------------------- prepare-points [30] 20.0% make-exacts [40] 80.0% [45] 1408(0.9%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [105] 100.0% -------------------------------------------------------------------------------- simplify [43] 100.0% [46] 107860(69.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [47] 90.2% loop [48] 8.5% mk-egraph [49] 1.3% -------------------------------------------------------------------------------- ??? [46] 100.0% [47] 97304(62.4%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [50] 99.1% loop [125] 0.9% -------------------------------------------------------------------------------- ??? [46] 100.0% [48] 9168(5.9%) 278(0.2%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [51] 54.7% loop [52] 39.2% reverse [170] 3.1% -------------------------------------------------------------------------------- ??? [46] 100.0% [49] 1388(0.9%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [53] 100.0% -------------------------------------------------------------------------------- iterate-egraph! [47] 100.0% [50] 96474(61.8%) 1925(1.2%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [54] 40.4% loop! [138] 13.2% merge-egraph-nodes! [55] 12.6% mk-enode! [59] 12.1% substitute-e [56] 9.6% custom-set-member? [58] 7.5% set-member? [160] 0.9% ??? [64] 0.6% -------------------------------------------------------------------------------- loop [48] 100.0% [51] 5012(3.2%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [57] 100.0% -------------------------------------------------------------------------------- loop [48] 100.0% [52] 3597(2.3%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [57] 100.0% -------------------------------------------------------------------------------- mk-egraph [49] 43.3% loop [125] 56.7% [53] 1388(0.9%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [125] 100.0% -------------------------------------------------------------------------------- match-e [54] 29.6% one-iter [50] 70.4% [54] 38980(25.0%) 7223(4.6%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [54] 29.6% loop [125] 11.0% variable? [61] 7.7% ??? [62] 6.4% make-sequence [180] 5.7% ??? [80] 5.3% list-cartesian-product [63] 4.6% reverse [170] 4.0% do-procedure-reduce-keyword-arity [71] 2.5% ??? [64] 2.1% make-curried [66] 1.4% set-member? [160] 1.0% -------------------------------------------------------------------------------- merge-egraph-nodes! [55] 12.9% one-iter [50] 87.1% [55] 12166(7.8%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [60] 61.3% loop! [138] 21.3% merge-egraph-nodes! [55] 12.9% enode-merge! [65] 4.6% -------------------------------------------------------------------------------- substitute-e [56] 5.4% one-iter [50] 94.6% [56] 9244(5.9%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [59] 91.1% substitute-e [56] 5.4% make-sequence [180] 1.5% variable? [61] 1.0% ??? [80] 1.0% -------------------------------------------------------------------------------- loop [52] 41.8% mk-min [51] 58.2% [57] 8610(5.5%) 278(0.2%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [81] 70.9% ...sting/src/common.rkt:47:2 [127] 19.3% compile [116] 3.3% second [68] 3.3% -------------------------------------------------------------------------------- one-iter [50] 100.0% [58] 7240(4.6%) 6692(4.3%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [67] 7.6% -------------------------------------------------------------------------------- loop [125] 6.5% substitute-e [56] 39.2% one-iter [50] 54.3% [59] 21483(13.8%) 1663(1.1%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [69] 89.7% hash-has-key? [83] 2.6% -------------------------------------------------------------------------------- merge-egraph-nodes! [55] 100.0% [60] 8288(5.3%) 3056(2.0%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [70] 49.9% update-en-expr [171] 6.7% custom-set-union! [74] 6.6% -------------------------------------------------------------------------------- substitute-e [56] 3.8% match-e [54] 96.2% [61] 7328(4.7%) 279(0.2%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [80] 96.2% -------------------------------------------------------------------------------- match-e [54] 100.0% [62] 3324(2.1%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [72] 58.3% do-procedure-reduce-keyword-arity [71] 41.7% -------------------------------------------------------------------------------- list-cartesian-product [63] 31.3% match-e [54] 68.7% [63] 2228(1.4%) 1108(0.7%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [63] 31.3% make-sequence [180] 18.9% reverse [170] 12.5% -------------------------------------------------------------------------------- one-iter [50] 39.4% match-e [54] 60.6% [64] 1372(0.9%) 1094(0.7%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 make-sequence [180] 20.3% -------------------------------------------------------------------------------- merge-egraph-nodes! [55] 100.0% [65] 555(0.4%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [73] 100.0% -------------------------------------------------------------------------------- match-e [54] 100.0% [66] 552(0.4%) 278(0.2%) make-curried ...collects/racket/function.rkt:130:9 make-keyword-procedure [78] 49.6% -------------------------------------------------------------------------------- custom-set-member? [58] 100.0% [67] 547(0.4%) 547(0.4%) set-check-elem ...cket/private/set-types.rkt:329:0 -------------------------------------------------------------------------------- expression-cost [57] 100.0% [68] 280(0.2%) 280(0.2%) second ...are/racket/collects/racket/list.rkt:85:0 -------------------------------------------------------------------------------- mk-enode! [59] 100.0% [69] 19266(12.4%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [75] 100.0% -------------------------------------------------------------------------------- update-leader! [60] 100.0% [70] 4136(2.7%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [76] 100.0% -------------------------------------------------------------------------------- match-e [54] 44.7% ??? [62] 55.3% [71] 2506(1.6%) 1960(1.3%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [77] 21.8% -------------------------------------------------------------------------------- ??? [62] 100.0% [72] 1938(1.2%) 550(0.4%) do-curry ...cket/collects/racket/function.rkt:71:2 procedure-keywords [77] 57.3% make-keyword-procedure [78] 14.4% -------------------------------------------------------------------------------- enode-merge! [65] 100.0% [73] 555(0.4%) 278(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 check-list [181] 49.8% -------------------------------------------------------------------------------- update-leader! [60] 100.0% [74] 544(0.3%) 544(0.3%) custom-set-union! ...t/private/set-types.rkt:245:0 -------------------------------------------------------------------------------- new-enode [69] 100.0% [75] 19266(12.4%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [79] 100.0% -------------------------------------------------------------------------------- do-hash-update [70] 100.0% [76] 4136(2.7%) 3021(1.9%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [171] 20.2% make-sequence [180] 6.8% -------------------------------------------------------------------------------- do-procedure-reduce-keyword-arity [71] 33.0% do-curry [72] 67.0% [77] 1657(1.1%) 1657(1.1%) procedure-keywords .../racket/private/kw.rkt:534:2 -------------------------------------------------------------------------------- make-curried [66] 49.5% do-curry [72] 50.5% [78] 552(0.4%) 552(0.4%) make-keyword-procedure ...ket/private/kw.rkt:448:4 -------------------------------------------------------------------------------- f8 [109] 1.4% type-of-enode-expr [75] 98.6% [79] 19546(12.5%) 282(0.2%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [81] 48.7% ??? [80] 21.3% ??? [82] 20.0% ...sting/src/common.rkt:47:2 [127] 8.5% -------------------------------------------------------------------------------- substitute-e [56] 1.0% pattern-match [168] 1.0% choose-best-alt! [36] 4.1% get-sigs [79] 15.7% match-e [54] 18.7% variable? [61] 26.5% finalize-iter! [32] 31.9% [80] 26593(17.0%) 557(0.4%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [83] 58.8% atab-add-altns [84] 31.9% atab-pick-alt [86] 4.1% ??? [159] 3.1% -------------------------------------------------------------------------------- expression-cost [57] 39.1% get-sigs [79] 60.9% [81] 15620(10.0%) 3146(2.0%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [87] 64.0% reverse [170] 7.1% return/no-unsupplied [129] 5.3% ...sting/src/common.rkt:47:2 [127] 1.8% check-list [181] 1.7% -------------------------------------------------------------------------------- ??? [103] 6.5% get-sigs [79] 93.5% [82] 4184(2.7%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [85] 66.7% handle-the-hash [93] 26.7% get/build-late-neg-projection [106] 6.5% -------------------------------------------------------------------------------- mk-enode! [59] 3.4% ??? [80] 96.6% [83] 16183(10.4%) 12569(8.1%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [87] 22.3% -------------------------------------------------------------------------------- ??? [80] 100.0% [84] 8492(5.4%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [88] 100.0% -------------------------------------------------------------------------------- ??? [82] 100.0% [85] 2792(1.8%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [89] 100.0% -------------------------------------------------------------------------------- ??? [80] 100.0% [86] 1081(0.7%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [90] 74.6% ??? [103] 25.4% -------------------------------------------------------------------------------- hash-has-key? [83] 26.6% table-ref [81] 73.4% [87] 13610(8.7%) 6940(4.4%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [92] 30.8% handle-the-hash [93] 14.2% ??? [96] 2.1% arrow-higher-order:lnp [97] 2.0% -------------------------------------------------------------------------------- atab-add-altns [84] 100.0% [88] 8492(5.4%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [91] 93.6% override-at-pnts [95] 6.4% -------------------------------------------------------------------------------- ??? [85] 100.0% [89] 2792(1.8%) 1674(1.1%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [94] 40.0% -------------------------------------------------------------------------------- atab-pick-alt [86] 100.0% [90] 806(0.5%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [125] 100.0% -------------------------------------------------------------------------------- atab-add-altn [88] 100.0% [91] 7950(5.1%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [98] 100.0% -------------------------------------------------------------------------------- ??? [87] 100.0% [92] 4185(2.7%) 2228(1.4%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [99] 26.7% blame-add-missing-party [101] 20.1% -------------------------------------------------------------------------------- ??? [82] 36.7% ??? [87] 63.3% [93] 3046(2.0%) 1376(0.9%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [155] 54.8% -------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [89] 100.0% [94] 1117(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [100] 100.0% -------------------------------------------------------------------------------- atab-add-altn [88] 100.0% [95] 542(0.3%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [98] 100.0% -------------------------------------------------------------------------------- ??? [87] 100.0% [96] 280(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [102] 100.0% -------------------------------------------------------------------------------- ??? [87] 100.0% [97] 278(0.2%) 278(0.2%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 -------------------------------------------------------------------------------- override-at-pnts [95] 4.6% composed [146] 4.6% loop [125] 23.3% best-and-tied-at-points [91] 67.5% [98] 11780(7.6%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [104] 67.3% eval-prog [105] 21.0% ulp-difference [143] 7.0% ??? [108] 2.4% ??? [103] 2.3% -------------------------------------------------------------------------------- loop [99] 49.1% ??? [92] 50.9% [99] 1117(0.7%) 1117(0.7%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [99] 49.1% -------------------------------------------------------------------------------- ??? [94] 100.0% [100] 1117(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [106] 100.0% -------------------------------------------------------------------------------- ??? [92] 100.0% [101] 840(0.5%) 840(0.5%) blame-add-missing-party ...private/blame.rkt:382:0 -------------------------------------------------------------------------------- ??? [96] 100.0% [102] 280(0.2%) 0(0.0%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [107] 100.0% -------------------------------------------------------------------------------- atab-pick-alt [86] 0.6% f8 [109] 1.1% errors [98] 1.1% ??? [17] 1.1% loop [131] 1.2% copying-mergesort [24] 2.3% ??? [42] 3.6% loop [125] 25.0% loop [110] 32.0% taylor-alt [39] 32.0% [103] 24285(15.6%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:375:33 loop [110] 32.0% approximate [111] 32.0% ->flonum [112] 22.3% real->bigfloat [115] 6.0% sample-multi-bounded [119] 2.4% ??? [159] 1.3% ??? [182] 1.2% ??? [82] 1.1% best-alt [123] 0.6% -------------------------------------------------------------------------------- ??? [17] 2.5% generic-sort/key [22] 2.5% copying-mergesort [24] 5.0% errors [98] 36.1% loop [125] 53.9% [104] 21988(14.1%) 9806(6.3%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [125] 21.7% ??? [128] 9.0% bf* [113] 8.0% ??? [114] 7.6% ??? [118] 4.0% ??? [182] 2.5% ??? [121] 1.3% -------------------------------------------------------------------------------- sort-context-on-expr [12] 12.5% make-exacts* [45] 31.8% errors [98] 55.7% [105] 4433(2.8%) 2760(1.8%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [116] 19.2% ??? [120] 12.4% f8 [109] 6.2% -------------------------------------------------------------------------------- loop [125] 9.8% ??? [82] 9.8% ??? [100] 80.3% [106] 1391(0.9%) 279(0.2%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [117] 70.1% unconstrained-domain->-projection [124] 9.8% -------------------------------------------------------------------------------- check-hash/c [102] 100.0% [107] 280(0.2%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [122] 100.0% -------------------------------------------------------------------------------- errors [98] 100.0% [108] 278(0.2%) 278(0.2%) ??? ...ket/collects/racket/private/for.rkt:1280:14 -------------------------------------------------------------------------------- eval-prog [105] 0.2% expression->type [9] 1.3% hash-ref! [137] 5.3% simplify [11] 26.6% split-table [33] 28.9% loop [125] 37.7% [109] 21047(13.5%) 12754(8.2%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [125] 71.4% get-sigs [79] 1.3% loop [131] 0.8% ??? [103] 0.2% -------------------------------------------------------------------------------- ??? [103] 12.0% loop [110] 88.0% [110] 15555(10.0%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [110] 88.0% ??? [103] 12.0% -------------------------------------------------------------------------------- ??? [103] 100.0% [111] 15555(10.0%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [126] 62.4% hash-ref! [137] 32.2% taylor [162] 5.4% -------------------------------------------------------------------------------- ??? [103] 100.0% [112] 5542(3.6%) 2467(1.6%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [129] 19.9% ...sting/src/common.rkt:47:2 [127] 15.0% ??? [130] 10.5% ^TYPE? [178] 5.2% set-member? [160] 4.9% -------------------------------------------------------------------------------- ??? [104] 100.0% [113] 1751(1.1%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [128] 100.0% -------------------------------------------------------------------------------- ??? [104] 100.0% [114] 1678(1.1%) 1678(1.1%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 -------------------------------------------------------------------------------- ??? [103] 100.0% [115] 1450(0.9%) 287(0.2%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [157] 60.5% ??? [135] 19.7% -------------------------------------------------------------------------------- expression-cost [57] 24.9% eval-prog [105] 75.1% [116] 1132(0.7%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [137] 100.0% -------------------------------------------------------------------------------- get/build-late-neg-projection [106] 100.0% [117] 1112(0.7%) 282(0.2%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [132] 50.0% reverse [170] 24.6% -------------------------------------------------------------------------------- ??? [104] 100.0% [118] 870(0.6%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [159] 64.4% ??? [155] 35.6% -------------------------------------------------------------------------------- ??? [103] 100.0% [119] 576(0.4%) 576(0.4%) sample-multi-bounded ...esting/src/points.rkt:44:0 -------------------------------------------------------------------------------- eval-prog [105] 100.0% [120] 548(0.4%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [133] 100.0% -------------------------------------------------------------------------------- ??? [104] 100.0% [121] 281(0.2%) 0(0.0%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 list-member? [136] 100.0% -------------------------------------------------------------------------------- flat-contract? [107] 100.0% [122] 280(0.2%) 280(0.2%) simple-flat-contract? ...ct/private/guts.rkt:141:0 -------------------------------------------------------------------------------- ??? [103] 100.0% [123] 275(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [134] 100.0% -------------------------------------------------------------------------------- get/build-late-neg-projection [106] 100.0% [124] 274(0.2%) 0(0.0%) unconstrained-domain->-projection ...rrow.rkt:60:0 loop [125] 100.0% -------------------------------------------------------------------------------- iterate-egraph! [47] 0.1% unconstrained-domain->-projection [124] 0.1% loop [44] 0.3% option-on-expr [2] 0.5% point-best-alt [90] 0.5% taylor-exact [8] 0.5% taylor [162] 1.1% ??? [5] 1.6% mk-enode-rec! [53] 2.4% ??? [104] 2.4% loop! [138] 2.7% match-e [54] 7.5% f8 [109] 17.2% loop [125] 63.2% [125] 51786(33.2%) 1106(0.7%) loop .../private/map.rkt:40:19 loop [125] 63.2% f8 [109] 14.2% loop! [138] 2.7% foldl [142] 2.7% ??? [103] 2.4% option-on-expr [2] 1.9% hash-ref! [137] 1.6% step [141] 1.4% mk-enode-rec! [53] 1.3% taylor [162] 1.1% mk-enode! [59] 1.1% keyword-apply [144] 1.1% errors [98] 1.0% composed [6] 1.0% simplify [11] 0.5% ??? [104] 0.3% ??? [149] 0.1% get/build-late-neg-projection [106] 0.1% ??? [17] 0.0% -------------------------------------------------------------------------------- ??? [3] 34.0% approximate [111] 66.0% [126] 14709(9.4%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [137] 100.0% -------------------------------------------------------------------------------- ??? [150] 3.1% table-ref [81] 6.2% ->flonum [112] 18.7% expression-cost [57] 34.3% get-sigs [79] 37.6% [127] 4440(2.8%) 1385(0.9%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [140] 68.8% ??? [150] 3.1% -------------------------------------------------------------------------------- bf* [113] 46.8% ??? [104] 53.2% [128] 3738(2.4%) 283(0.2%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [139] 92.4% -------------------------------------------------------------------------------- table-ref [81] 43.0% ->flonum [112] 57.0% [129] 1935(1.2%) 1388(0.9%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 reverse [170] 28.3% -------------------------------------------------------------------------------- ->flonum [112] 100.0% [130] 582(0.4%) 290(0.2%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 ??? [166] 50.0% -------------------------------------------------------------------------------- f8 [109] 1.2% loop [131] 98.8% [131] 560(0.4%) 0(0.0%) loop .../private/map.rkt:54:19 loop [131] 98.8% ??? [103] 1.0% ulp-difference [143] 0.2% -------------------------------------------------------------------------------- contract-struct-name [145] 50.0% ??? [117] 50.0% [132] 556(0.4%) 278(0.2%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [145] 50.0% check-list [181] 25.0% -------------------------------------------------------------------------------- ??? [120] 100.0% [133] 548(0.4%) 548(0.4%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 -------------------------------------------------------------------------------- extract-alt [37] 49.6% best-alt [123] 50.4% [134] 546(0.3%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [146] 100.0% -------------------------------------------------------------------------------- real->bigfloat [115] 100.0% [135] 286(0.2%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [147] 100.0% -------------------------------------------------------------------------------- ??? [121] 100.0% [136] 281(0.2%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [148] 100.0% -------------------------------------------------------------------------------- ??? [4] 0.2% compile [116] 2.7% localize-error [41] 3.1% composed [6] 3.5% ??? [158] 3.5% loop [125] 4.0% approximate [111] 6.3% ??? [153] 11.5% ??? [151] 18.7% ??? [126] 20.4% ??? [152] 23.2% [137] 16946(10.9%) 282(0.2%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [152] 23.2% ??? [151] 18.7% simplify [11] 17.4% ??? [153] 11.5% f8 [109] 6.5% ??? [3] 6.3% ??? [5] 4.0% ??? [158] 3.5% bigfloat-hash [163] 2.2% taylor [162] 1.7% ??? [4] 1.5% -------------------------------------------------------------------------------- merge-egraph-nodes! [55] 12.9% loop [125] 27.3% one-iter [50] 59.8% [138] 16104(10.3%) 2226(1.4%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [154] 47.4% loop [125] 27.3% make-immutable-set [156] 12.0% ??? [161] 4.9% -------------------------------------------------------------------------------- ??? [128] 100.0% [139] 3456(2.2%) 840(0.5%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [157] 66.5% ??? [166] 9.2% -------------------------------------------------------------------------------- ??? [155] 27.2% ...sting/src/common.rkt:47:2 [127] 72.8% [140] 3054(2.0%) 1392(0.9%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [155] 54.5% ??? [159] 13.6% -------------------------------------------------------------------------------- loop [125] 100.0% [141] 1959(1.3%) 1116(0.7%) step .../racket/collects/racket/function.rkt:145:9 sort [164] 43.1% -------------------------------------------------------------------------------- loop [125] 100.0% [142] 1382(0.9%) 278(0.2%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [165] 59.9% check-fold [169] 19.9% -------------------------------------------------------------------------------- loop [131] 25.4% errors [98] 74.6% [143] 1108(0.7%) 830(0.5%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 set-member? [160] 25.1% -------------------------------------------------------------------------------- loop [125] 100.0% [144] 556(0.4%) 276(0.2%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [167] 50.4% -------------------------------------------------------------------------------- build-compound-type-name [132] 100.0% [145] 556(0.4%) 0(0.0%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [132] 100.0% -------------------------------------------------------------------------------- argmins [134] 100.0% [146] 546(0.3%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [98] 100.0% -------------------------------------------------------------------------------- ??? [135] 100.0% [147] 286(0.2%) 286(0.2%) assq ...et/collects/racket/private/list.rkt:187:13 -------------------------------------------------------------------------------- list-member? [136] 100.0% [148] 281(0.2%) 281(0.2%) member ...collects/racket/private/member.rkt:13:21 -------------------------------------------------------------------------------- loop [125] 100.0% [149] 278(0.2%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 pattern-match [168] 100.0% -------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [127] 100.0% [150] 276(0.2%) 0(0.0%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 ...sting/src/common.rkt:47:2 [127] 100.0% -------------------------------------------------------------------------------- hash-ref! [137] 100.0% [151] 14148(9.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [137] 100.0% -------------------------------------------------------------------------------- hash-ref! [137] 100.0% [152] 13057(8.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [137] 100.0% -------------------------------------------------------------------------------- hash-ref! [137] 100.0% [153] 9424(6.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [137] 100.0% -------------------------------------------------------------------------------- loop! [138] 100.0% [154] 8044(5.2%) 6670(4.3%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [174] 17.1% -------------------------------------------------------------------------------- ??? [118] 6.9% handle-the-hash [93] 37.3% ??? [140] 55.8% [155] 4475(2.9%) 1140(0.7%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [140] 37.1% ??? [173] 31.2% check-list [181] 6.3% -------------------------------------------------------------------------------- loop! [138] 100.0% [156] 4152(2.7%) 4152(2.7%) make-immutable-set .../private/set-types.rkt:948:0 -------------------------------------------------------------------------------- real->bigfloat [115] 27.6% bfmul [139] 72.4% [157] 3176(2.0%) 3176(2.0%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 -------------------------------------------------------------------------------- hash-ref! [137] 100.0% [158] 3064(2.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [137] 100.0% -------------------------------------------------------------------------------- ??? [103] 12.4% ??? [118] 22.1% ??? [140] 32.6% ??? [80] 32.9% [159] 2537(1.6%) 1146(0.7%) ??? ...ects/racket/contract/private/guts.rkt:794:8 dict? [176] 32.9% ^TYPE? [178] 11.1% contract? [179] 10.9% -------------------------------------------------------------------------------- ->flonum [112] 14.1% ulp-difference [143] 14.3% match-e [54] 28.8% one-iter [50] 42.8% [160] 1939(1.2%) 1939(1.2%) set-member? ...ts/racket/private/generic.rkt:472:9 -------------------------------------------------------------------------------- loop! [138] 100.0% [161] 1682(1.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [171] 66.6% reverse [170] 33.4% -------------------------------------------------------------------------------- hash-ref! [137] 13.9% loop [125] 20.9% approximate [111] 20.9% taylor [162] 44.4% [162] 1407(0.9%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [162] 44.4% loop [125] 20.9% debug-print [172] 20.1% taylor-invert [7] 10.6% taylor-exact [8] 4.0% -------------------------------------------------------------------------------- hash-ref! [137] 100.0% [163] 850(0.5%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [175] 100.0% -------------------------------------------------------------------------------- step [141] 100.0% [164] 844(0.5%) 844(0.5%) sort ...cket/collects/racket/private/list.rkt:43:2 -------------------------------------------------------------------------------- foldl [142] 100.0% [165] 828(0.5%) 0(0.0%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [177] 100.0% -------------------------------------------------------------------------------- ??? [130] 47.9% bfmul [139] 52.1% [166] 608(0.4%) 608(0.4%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 -------------------------------------------------------------------------------- keyword-apply [144] 100.0% [167] 280(0.2%) 280(0.2%) loop ...cket/collects/racket/private/kw.rkt:518:13 -------------------------------------------------------------------------------- pattern-match [168] 50.0% ??? [149] 50.0% [168] 278(0.2%) 0(0.0%) pattern-match ...testing/src/core/matcher.rkt:48:0 pattern-match [168] 50.0% ??? [80] 50.0% -------------------------------------------------------------------------------- foldl [142] 100.0% [169] 275(0.2%) 275(0.2%) check-fold ...llects/racket/private/list.rkt:223:2 -------------------------------------------------------------------------------- ??? [117] 5.2% list-cartesian-product [63] 5.3% loop [48] 5.3% return/no-unsupplied [129] 10.4% ??? [161] 10.6% table-ref [81] 21.0% match-e [54] 42.2% [170] 5280(3.4%) 5280(3.4%) reverse ...collects/racket/private/reverse.rkt:6:4 -------------------------------------------------------------------------------- update-leader! [60] 22.1% ??? [76] 33.3% ??? [161] 44.7% [171] 2506(1.6%) 1392(0.9%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [184] 33.5% make-sequence [180] 11.0% -------------------------------------------------------------------------------- taylor [162] 33.7% simplify [11] 66.3% [172] 1679(1.1%) 1679(1.1%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 -------------------------------------------------------------------------------- ??? [155] 100.0% [173] 1394(0.9%) 836(0.5%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [182] 20.3% check-list [181] 19.7% -------------------------------------------------------------------------------- custom-set-union [154] 100.0% [174] 1374(0.9%) 1101(0.7%) choose-immutable ...et/private/set-types.rkt:151:0 check-list [181] 19.8% -------------------------------------------------------------------------------- bigfloat-hash [163] 100.0% [175] 850(0.5%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [183] 100.0% -------------------------------------------------------------------------------- ??? [159] 100.0% [176] 834(0.5%) 834(0.5%) dict? ...ollects/racket/private/generic.rkt:146:11 -------------------------------------------------------------------------------- merge2 [165] 100.0% [177] 828(0.5%) 828(0.5%) assoc ...t/collects/racket/private/list.rkt:196:13 -------------------------------------------------------------------------------- ??? [159] 49.5% ->flonum [112] 50.5% [178] 568(0.4%) 568(0.4%) ^TYPE? .../ffi/unsafe.rkt:1621:20 -------------------------------------------------------------------------------- ??? [159] 100.0% [179] 276(0.2%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [185] 100.0% -------------------------------------------------------------------------------- update-en-expr [171] 6.6% ??? [64] 6.6% substitute-e [56] 6.7% ??? [76] 6.7% list-cartesian-product [63] 20.0% match-e [54] 53.3% [180] 4194(2.7%) 3632(2.3%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [187] 13.4% -------------------------------------------------------------------------------- table-ref [81] 15.8% choose-immutable [174] 16.6% ??? [173] 16.7% custom-set-intersect! [73] 16.8% build-compound-type-name [132] 16.9% ??? [155] 17.1% [181] 1642(1.1%) 1642(1.1%) check-list ...ollects/racket/private/for.rkt:690:2 -------------------------------------------------------------------------------- ??? [103] 24.9% ??? [173] 25.2% ??? [104] 49.9% [182] 1122(0.7%) 280(0.2%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [186] 75.1% -------------------------------------------------------------------------------- bfcanonicalize [175] 100.0% [183] 850(0.5%) 850(0.5%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 -------------------------------------------------------------------------------- update-en-expr [171] 100.0% [184] 838(0.5%) 838(0.5%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 -------------------------------------------------------------------------------- contract? [179] 100.0% [185] 276(0.2%) 276(0.2%) coerce-contract/f ...ntract/private/guts.rkt:372:0 -------------------------------------------------------------------------------- ??? [182] 100.0% [186] 843(0.5%) 560(0.4%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [188] 33.6% -------------------------------------------------------------------------------- make-sequence [180] 100.0% [187] 562(0.4%) 562(0.4%) :hash-gen ...collects/racket/private/for.rkt:781:4 -------------------------------------------------------------------------------- ??? [186] 100.0% [188] 283(0.2%) 283(0.2%) ??? ...ects/racket/contract/private/list.rkt:163:5 --------------------------------------------------------------------------------