Profiling results ----------------- Total cpu time observed: 135897ms (out of 136065ms) Number of samples taken: 509 (once every 267ms) (Hiding functions with self<1.0% and local<2.0%: 11 of 195 hidden) ===================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ===================================================================================== [1] 135897(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [5] 100.0% ------------------------------------------------------------------------------------- loop [161] 100.0% [2] 10805(8.0%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [161] 53.3% sort-context-on-expr [6] 38.3% pick-errors [7] 6.3% err-lsts->split-indices [9] 2.1% ------------------------------------------------------------------------------------- hash-ref! [144] 100.0% [3] 1154(0.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 hash-ref! [144] 74.9% simplify [148] 25.1% ------------------------------------------------------------------------------------- hash-ref! [144] 100.0% [4] 578(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 ??? [8] 50.8% hash-ref! [144] 49.2% ------------------------------------------------------------------------------------- ??? [1] 100.0% [5] 135897(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [10] 100.0% ------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [6] 4142(3.0%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [11] 100.0% ------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [7] 682(0.5%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [12] 100.0% ------------------------------------------------------------------------------------- ??? [4] 100.0% [8] 294(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [144] 100.0% ------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [9] 227(0.2%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [13] 100.0% ------------------------------------------------------------------------------------- profile-thunk [5] 100.0% [10] 135897(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [14] 100.0% ------------------------------------------------------------------------------------- sort-context-on-expr [6] 100.0% [11] 4142(3.0%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [15] 100.0% ------------------------------------------------------------------------------------- loop [161] 40.0% pick-errors [7] 60.0% [12] 1135(0.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [103] 100.0% ------------------------------------------------------------------------------------- err-lsts->split-indices [9] 100.0% [13] 227(0.2%) 227(0.2%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------- ??? [10] 100.0% [14] 135897(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [16] 94.4% prepare-points [24] 5.6% ------------------------------------------------------------------------------------- ??? [11] 100.0% [15] 4142(3.0%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [17] 72.4% ??? [103] 27.6% ------------------------------------------------------------------------------------- ??? [14] 100.0% [16] 128342(94.4%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [18] 91.0% get-final-combination [19] 8.6% setup-prog! [20] 0.4% ------------------------------------------------------------------------------------- generic-sort/key [15] 35.5% copying-mergesort [17] 64.5% [17] 3001(2.2%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [17] 64.5% ??? [103] 35.5% ------------------------------------------------------------------------------------- run-improve [16] 100.0% [18] 116746(85.9%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [21] 82.9% finalize-iter! [23] 9.1% gen-series! [25] 4.2% choose-best-alt! [26] 2.4% gen-rewrites! [27] 1.4% ------------------------------------------------------------------------------------- run-improve [16] 100.0% [19] 11035(8.1%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [22] 97.9% extract-alt [28] 2.1% ------------------------------------------------------------------------------------- run-improve [16] 100.0% [20] 561(0.4%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [24] 100.0% ------------------------------------------------------------------------------------- run-iter! [18] 100.0% [21] 96734(71.2%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [29] 100.0% ------------------------------------------------------------------------------------- get-final-combination [19] 100.0% [22] 10805(8.0%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f138 [157] 100.0% ------------------------------------------------------------------------------------- run-iter! [18] 100.0% [23] 10618(7.8%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [74] 100.0% ------------------------------------------------------------------------------------- setup-prog! [20] 6.9% ??? [14] 93.1% [24] 8116(6.0%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [34] 57.8% make-exacts [31] 35.9% make-exacts* [36] 6.3% ------------------------------------------------------------------------------------- run-iter! [18] 100.0% [25] 4889(3.6%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [30] 100.0% ------------------------------------------------------------------------------------- run-iter! [18] 100.0% [26] 2814(2.1%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [74] 100.0% ------------------------------------------------------------------------------------- run-iter! [18] 100.0% [27] 1691(1.2%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [32] 100.0% ------------------------------------------------------------------------------------- get-final-combination [19] 100.0% [28] 230(0.2%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [125] 100.0% ------------------------------------------------------------------------------------- simplify! [21] 100.0% [29] 96734(71.2%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [33] 100.0% ------------------------------------------------------------------------------------- gen-series! [25] 100.0% [30] 4889(3.6%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [104] 100.0% ------------------------------------------------------------------------------------- prepare-points [24] 100.0% [31] 2913(2.1%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [34] 81.7% make-exacts* [36] 18.3% ------------------------------------------------------------------------------------- gen-rewrites! [27] 100.0% [32] 1691(1.2%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [35] 100.0% ------------------------------------------------------------------------------------- ??? [29] 100.0% [33] 96734(71.2%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [37] 99.2% *simplify-rules* [40] 0.8% ------------------------------------------------------------------------------------- make-exacts [31] 33.6% prepare-points [24] 66.4% [34] 7073(5.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [161] 100.0% ------------------------------------------------------------------------------------- alt-rewrite-rm [32] 36.7% matcher [38] 63.3% [35] 1691(1.2%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [38] 63.3% *rules* [39] 22.8% f138 [157] 13.9% ------------------------------------------------------------------------------------- prepare-points [24] 48.8% make-exacts [31] 51.2% [36] 1043(0.8%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [105] 100.0% ------------------------------------------------------------------------------------- simplify [33] 100.0% [37] 95928(70.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [41] 92.8% loop [42] 6.0% mk-egraph [44] 1.2% ------------------------------------------------------------------------------------- matcher [38] 50.0% rewriter [35] 50.0% [38] 1691(1.2%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [38] 50.0% rewriter [35] 50.0% ------------------------------------------------------------------------------------- rewriter [35] 100.0% [39] 1126(0.8%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [43] 49.9% procedure-reduce-arity [66] 25.1% ??? [57] 25.0% ------------------------------------------------------------------------------------- simplify [33] 100.0% [40] 806(0.6%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [43] 100.0% ------------------------------------------------------------------------------------- ??? [37] 100.0% [41] 89026(65.5%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [45] 97.8% loop [161] 2.2% ------------------------------------------------------------------------------------- ??? [37] 100.0% [42] 5772(4.2%) 851(0.6%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [46] 46.5% loop [47] 38.8% ------------------------------------------------------------------------------------- *rules* [39] 41.1% *simplify-rules* [40] 58.9% [43] 1368(1.0%) 1089(0.8%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ...sting/src/common.rkt:47:2 [119] 20.4% ------------------------------------------------------------------------------------- ??? [37] 100.0% [44] 1130(0.8%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [48] 100.0% ------------------------------------------------------------------------------------- iterate-egraph! [41] 100.0% [45] 87073(64.1%) 1644(1.2%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [49] 28.4% merge-egraph-nodes! [50] 19.6% loop! [165] 17.3% mk-enode! [54] 11.1% custom-set-member? [51] 8.6% substitute-e [52] 6.0% list-member? [120] 3.0% reverse [178] 1.0% pack-leader [183] 0.9% filter [131] 0.9% update-leader! [55] 0.6% set-member? [174] 0.6% ------------------------------------------------------------------------------------- loop [42] 100.0% [46] 2683(2.0%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [53] 100.0% ------------------------------------------------------------------------------------- loop [42] 100.0% [47] 2238(1.6%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [53] 100.0% ------------------------------------------------------------------------------------- loop [161] 41.6% mk-egraph [44] 58.4% [48] 1130(0.8%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [161] 100.0% ------------------------------------------------------------------------------------- match-e [49] 28.3% one-iter [45] 71.7% [49] 24719(18.2%) 6828(5.0%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [49] 28.3% loop [161] 13.6% ??? [74] 7.3% ??? [57] 6.1% list-cartesian-product [58] 4.6% variable? [56] 4.5% reverse [178] 3.4% do-procedure-reduce-keyword-arity [63] 2.8% set-member? [174] 2.3% filter [131] 1.2% make-sequence [67] 0.6% check-list [167] 0.6% ------------------------------------------------------------------------------------- merge-egraph-nodes! [50] 13.7% one-iter [45] 86.3% [50] 17099(12.6%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [55] 64.7% loop! [165] 16.7% merge-egraph-nodes! [50] 13.7% enode-merge! [59] 4.9% ------------------------------------------------------------------------------------- one-iter [45] 100.0% [51] 7506(5.5%) 7221(5.3%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [60] 3.8% ------------------------------------------------------------------------------------- substitute-e [52] 11.1% one-iter [45] 88.9% [52] 5252(3.9%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [54] 79.3% substitute-e [52] 11.1% ??? [74] 5.4% variable? [56] 4.2% ------------------------------------------------------------------------------------- loop [47] 45.5% mk-min [46] 54.5% [53] 4922(3.6%) 278(0.2%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [75] 66.7% ...sting/src/common.rkt:47:2 [119] 16.2% compile [114] 11.4% ------------------------------------------------------------------------------------- loop [161] 7.6% substitute-e [52] 27.9% one-iter [45] 64.5% [54] 14916(11.0%) 564(0.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [61] 94.3% hash-has-key? [78] 1.9% ------------------------------------------------------------------------------------- one-iter [45] 4.3% merge-egraph-nodes! [50] 95.7% [55] 13168(9.7%) 3146(2.3%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [62] 68.3% update-en-expr [179] 4.2% reverse [178] 1.8% ------------------------------------------------------------------------------------- substitute-e [52] 16.0% match-e [49] 84.0% [56] 3270(2.4%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [74] 100.0% ------------------------------------------------------------------------------------- *rules* [39] 14.7% match-e [49] 85.3% [57] 1917(1.4%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [64] 44.0% do-procedure-reduce-keyword-arity [63] 41.3% procedure-reduce-arity [66] 14.7% ------------------------------------------------------------------------------------- match-e [49] 100.0% [58] 1408(1.0%) 852(0.6%) list-cartesian-product ...src/core/ematch.rkt:20:0 reverse [178] 20.0% make-sequence [67] 19.5% ------------------------------------------------------------------------------------- merge-egraph-nodes! [50] 100.0% [59] 840(0.6%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [65] 67.4% adopt-enode! [68] 32.6% ------------------------------------------------------------------------------------- custom-set-member? [51] 100.0% [60] 285(0.2%) 285(0.2%) set-check-elem ...cket/private/set-types.rkt:329:0 ------------------------------------------------------------------------------------- mk-enode! [54] 100.0% [61] 14072(10.4%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [69] 100.0% ------------------------------------------------------------------------------------- update-leader! [55] 100.0% [62] 8996(6.6%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [70] 100.0% ------------------------------------------------------------------------------------- ??? [57] 36.3% match-e [49] 63.7% [63] 2180(1.6%) 1348(1.0%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [71] 38.2% ------------------------------------------------------------------------------------- ??? [57] 100.0% [64] 844(0.6%) 562(0.4%) do-curry ...cket/collects/racket/function.rkt:71:2 partially-applied-procedure-arity-mask [72] 33.5% ------------------------------------------------------------------------------------- enode-merge! [59] 100.0% [65] 566(0.4%) 566(0.4%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------- ??? [57] 50.0% *rules* [39] 50.0% [66] 564(0.4%) 282(0.2%) procedure-reduce-arity ...t/private/kw.rkt:1823:11 procedure-keywords [71] 50.0% ------------------------------------------------------------------------------------- list-cartesian-product [58] 49.2% match-e [49] 50.8% [67] 560(0.4%) 560(0.4%) make-sequence ...ects/racket/private/for.rkt:557:2 ------------------------------------------------------------------------------------- enode-merge! [59] 100.0% [68] 274(0.2%) 0(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [171] 100.0% ------------------------------------------------------------------------------------- new-enode [61] 100.0% [69] 14072(10.4%) 280(0.2%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [73] 98.0% ------------------------------------------------------------------------------------- do-hash-update [62] 100.0% [70] 8996(6.6%) 7104(5.2%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 reverse [178] 12.3% update-en-expr [179] 8.8% ------------------------------------------------------------------------------------- procedure-reduce-arity [66] 25.3% do-procedure-reduce-keyword-arity [63] 74.7% [71] 1116(0.8%) 1116(0.8%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------- do-curry [64] 100.0% [72] 282(0.2%) 282(0.2%) partially-applied-procedure-arity-mask ...rkt:58:2 ------------------------------------------------------------------------------------- f138 [157] 2.0% type-of-enode-expr [69] 98.0% [73] 14076(10.4%) 283(0.2%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [75] 52.6% ??? [76] 23.4% ...sting/src/common.rkt:47:2 [119] 10.0% ??? [74] 8.0% hash-has-key? [78] 4.0% ------------------------------------------------------------------------------------- f138 [157] 0.5% ??? [141] 1.8% substitute-e [52] 2.6% get-sigs [73] 5.1% choose-best-alt! [26] 12.2% variable? [56] 14.9% match-e [49] 16.1% finalize-iter! [23] 46.7% [74] 21928(16.1%) 524(0.4%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [77] 46.7% hash-has-key? [78] 38.7% atab-pick-alt [80] 12.2% ------------------------------------------------------------------------------------- ??? [104] 2.1% expression-cost [53] 30.1% get-sigs [73] 67.8% [75] 10912(8.0%) 1634(1.2%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [83] 65.0% ??? [81] 5.2% return/no-unsupplied [123] 5.1% ...sting/src/common.rkt:47:2 [119] 5.0% dict? [146] 4.7% ------------------------------------------------------------------------------------- get-sigs [73] 100.0% [76] 3300(2.4%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [79] 91.6% get/build-late-neg-projection [107] 8.4% ------------------------------------------------------------------------------------- ??? [74] 100.0% [77] 10618(7.8%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [82] 100.0% ------------------------------------------------------------------------------------- mk-enode! [54] 2.8% get-sigs [73] 5.7% ??? [74] 91.5% [78] 9840(7.2%) 7400(5.4%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [83] 24.8% ------------------------------------------------------------------------------------- ??? [76] 100.0% [79] 3022(2.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [84] 100.0% ------------------------------------------------------------------------------------- ??? [74] 100.0% [80] 2814(2.1%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [85] 59.8% ??? [104] 30.1% errors [95] 10.1% ------------------------------------------------------------------------------------- table-ref [75] 100.0% [81] 565(0.4%) 565(0.4%) ??? ...cts/racket/contract/private/list.rkt:211:14 ------------------------------------------------------------------------------------- atab-add-altns [77] 100.0% [82] 10618(7.8%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [86] 84.7% override-at-pnts [88] 12.7% minimize-alts [93] 2.6% ------------------------------------------------------------------------------------- hash-has-key? [78] 25.6% table-ref [75] 74.4% [83] 9531(7.0%) 4606(3.4%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [87] 26.1% handle-the-hash [90] 11.3% ??? [91] 5.8% do-chaperone-procedure [92] 3.0% ??? [140] 2.9% arrow-higher-order:lnp [94] 2.5% ------------------------------------------------------------------------------------- ??? [79] 100.0% [84] 3022(2.2%) 1944(1.4%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [89] 35.7% ------------------------------------------------------------------------------------- atab-pick-alt [80] 100.0% [85] 1682(1.2%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [161] 100.0% ------------------------------------------------------------------------------------- atab-add-altn [82] 100.0% [86] 8996(6.6%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [95] 100.0% ------------------------------------------------------------------------------------- ??? [83] 100.0% [87] 2488(1.8%) 564(0.4%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [96] 56.4% blame-add-missing-party [100] 11.4% make-keyword-procedure [102] 9.6% ------------------------------------------------------------------------------------- atab-add-altn [82] 100.0% [88] 1344(1.0%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [95] 100.0% ------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [84] 100.0% [89] 1078(0.8%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [97] 100.0% ------------------------------------------------------------------------------------- ??? [83] 100.0% [90] 1076(0.8%) 237(0.2%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [140] 78.0% ------------------------------------------------------------------------------------- ??? [83] 100.0% [91] 558(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [98] 100.0% ------------------------------------------------------------------------------------- ??? [83] 100.0% [92] 285(0.2%) 0(0.0%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [99] 100.0% ------------------------------------------------------------------------------------- atab-add-altn [82] 100.0% [93] 278(0.2%) 0(0.0%) minimize-alts ...ting/src/core/alt-table.rkt:193:0 rm-alts [101] 100.0% ------------------------------------------------------------------------------------- ??? [83] 100.0% [94] 238(0.2%) 238(0.2%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ------------------------------------------------------------------------------------- atab-pick-alt [80] 1.5% composed [134] 5.8% override-at-pnts [88] 7.3% loop [161] 36.6% best-and-tied-at-points [86] 48.7% [95] 18455(13.6%) 233(0.2%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [103] 68.9% eval-prog [105] 18.1% ulp-difference [106] 6.1% ??? [104] 4.5% ------------------------------------------------------------------------------------- loop [96] 39.6% ??? [87] 60.4% [96] 1403(1.0%) 1403(1.0%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [96] 39.6% ------------------------------------------------------------------------------------- ??? [89] 100.0% [97] 1078(0.8%) 238(0.2%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [107] 77.9% ------------------------------------------------------------------------------------- ??? [91] 100.0% [98] 558(0.4%) 278(0.2%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [108] 50.0% ------------------------------------------------------------------------------------- do-chaperone-procedure [92] 100.0% [99] 285(0.2%) 285(0.2%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 ------------------------------------------------------------------------------------- ??? [87] 100.0% [100] 282(0.2%) 282(0.2%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------- minimize-alts [93] 100.0% [101] 278(0.2%) 0(0.0%) rm-alts ...lt-testing/src/core/alt-table.rkt:222:0 loop [161] 100.0% ------------------------------------------------------------------------------------- ??? [87] 100.0% [102] 238(0.2%) 238(0.2%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------- ??? [12] 4.6% generic-sort/key [15] 4.6% copying-mergesort [17] 12.1% loop [161] 27.5% errors [95] 51.2% [103] 24818(18.3%) 15716(11.6%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [111] 14.8% loop [161] 8.2% ??? [113] 7.8% ??? [151] 2.0% ------------------------------------------------------------------------------------- atab-pick-alt [80] 7.0% errors [95] 8.2% f138 [157] 11.5% loop [109] 24.2% taylor-alt [30] 24.2% loop [161] 24.9% [104] 10096(7.4%) 1021(0.8%) ??? ...tract/private/arrow-higher-order.rkt:375:33 loop [109] 24.2% approximate [110] 24.2% ->flonum [112] 20.4% best-alt [115] 7.0% ??? [141] 6.4% ...sting/src/common.rkt:47:2 [119] 2.8% real->bigfloat [118] 2.5% table-ref [75] 2.3% ------------------------------------------------------------------------------------- make-exacts* [36] 23.8% errors [95] 76.2% [105] 4392(3.2%) 1815(1.3%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f138 [157] 35.1% compile [114] 17.3% ??? [117] 6.2% ------------------------------------------------------------------------------------- errors [95] 100.0% [106] 1118(0.8%) 838(0.6%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [123] 25.0% ------------------------------------------------------------------------------------- ??? [76] 24.8% ??? [97] 75.2% [107] 1118(0.8%) 278(0.2%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [116] 75.2% ------------------------------------------------------------------------------------- check-hash/c [98] 100.0% [108] 279(0.2%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [152] 100.0% ------------------------------------------------------------------------------------- ??? [104] 24.8% loop [109] 75.2% [109] 4889(3.6%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [109] 75.2% ??? [104] 24.8% ------------------------------------------------------------------------------------- ??? [104] 100.0% [110] 4889(3.6%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [121] 58.7% taylor [122] 29.5% taylor-quotient [126] 11.8% ------------------------------------------------------------------------------------- ??? [103] 100.0% [111] 3677(2.7%) 2670(2.0%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [123] 15.1% list-member? [120] 6.3% ...sting/src/common.rkt:47:2 [119] 6.0% ------------------------------------------------------------------------------------- ??? [104] 100.0% [112] 2064(1.5%) 1543(1.1%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 list-member? [120] 13.6% ^TYPE? [163] 11.6% ------------------------------------------------------------------------------------- ??? [103] 100.0% [113] 1948(1.4%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [124] 61.9% bfsqrt [128] 26.1% ^TYPE? [163] 12.0% ------------------------------------------------------------------------------------- expression-cost [53] 42.5% eval-prog [105] 57.5% [114] 1324(1.0%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [144] 100.0% ------------------------------------------------------------------------------------- ??? [104] 100.0% [115] 847(0.6%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [125] 100.0% ------------------------------------------------------------------------------------- get/build-late-neg-projection [107] 100.0% [116] 840(0.6%) 285(0.2%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [127] 66.1% ------------------------------------------------------------------------------------- eval-prog [105] 100.0% [117] 274(0.2%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [129] 100.0% ------------------------------------------------------------------------------------- ??? [104] 100.0% [118] 256(0.2%) 0(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [135] 100.0% ------------------------------------------------------------------------------------- ??? [111] 6.2% flag-set? [43] 7.9% ??? [104] 8.0% ??? [133] 8.0% table-ref [75] 15.6% expression-cost [53] 22.6% get-sigs [73] 31.8% [119] 3538(2.6%) 1332(1.0%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [132] 38.5% ??? [133] 23.8% ??? [141] 4.0% ------------------------------------------------------------------------------------- ??? [111] 7.4% ->flonum [112] 9.0% one-iter [45] 83.6% [120] 3108(2.3%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [130] 100.0% ------------------------------------------------------------------------------------- approximate [110] 100.0% [121] 2870(2.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [144] 100.0% ------------------------------------------------------------------------------------- taylor [122] 20.1% approximate [110] 79.9% [122] 1440(1.1%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor-invert [136] 39.9% taylor-sqrt [137] 29.8% taylor [122] 20.1% debug-print [158] 10.2% ------------------------------------------------------------------------------------- ulp-difference [106] 20.0% ??? [111] 39.9% table-ref [75] 40.1% [123] 1396(1.0%) 555(0.4%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [131] 60.2% ------------------------------------------------------------------------------------- ??? [113] 100.0% [124] 1206(0.9%) 738(0.5%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [135] 19.6% ??? [139] 19.2% ------------------------------------------------------------------------------------- extract-alt [28] 21.4% best-alt [115] 78.6% [125] 1077(0.8%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [134] 100.0% ------------------------------------------------------------------------------------- approximate [110] 100.0% [126] 578(0.4%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 normalize-series [142] 100.0% ------------------------------------------------------------------------------------- contract-struct-name [138] 25.0% ??? [116] 75.0% [127] 555(0.4%) 0(0.0%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [138] 75.0% check-list [167] 25.0% ------------------------------------------------------------------------------------- ??? [113] 100.0% [128] 508(0.4%) 249(0.2%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [135] 51.0% ------------------------------------------------------------------------------------- ??? [117] 100.0% [129] 274(0.2%) 274(0.2%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------------- list-member? [120] 100.0% [130] 3108(2.3%) 3108(2.3%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------- match-e [49] 15.0% one-iter [45] 41.2% return/no-unsupplied [123] 43.8% [131] 1920(1.4%) 1920(1.4%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------- ??? [140] 41.3% ...sting/src/common.rkt:47:2 [119] 58.7% [132] 1362(1.0%) 802(0.6%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [140] 41.3% ??? [141] 20.6% ------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [119] 100.0% [133] 1127(0.8%) 0(0.0%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 ...sting/src/common.rkt:47:2 [119] 50.3% assoc-ref [143] 49.7% ------------------------------------------------------------------------------------- argmins [125] 100.0% [134] 1077(0.8%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [95] 100.0% ------------------------------------------------------------------------------------- bfsub [124] 31.4% real->bigfloat [118] 34.0% bfsqrt [128] 34.5% [135] 752(0.6%) 752(0.6%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------- taylor [122] 100.0% [136] 574(0.4%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 normalize-series [142] 100.0% ------------------------------------------------------------------------------------- taylor [122] 100.0% [137] 572(0.4%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 simplify [148] 100.0% ------------------------------------------------------------------------------------- build-compound-type-name [127] 100.0% [138] 555(0.4%) 0(0.0%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [127] 50.0% reverse [178] 50.0% ------------------------------------------------------------------------------------- bfsub [124] 100.0% [139] 232(0.2%) 232(0.2%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ------------------------------------------------------------------------------------- ??? [83] 12.5% handle-the-hash [90] 37.4% ??? [132] 50.1% [140] 2244(1.7%) 280(0.2%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [132] 50.1% ??? [145] 37.4% ------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [119] 17.4% ??? [132] 34.2% ??? [104] 48.4% [141] 1636(1.2%) 0(0.0%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ??? [74] 48.4% contract? [147] 34.2% dict? [146] 17.4% ------------------------------------------------------------------------------------- taylor-invert [136] 49.8% taylor-quotient [126] 50.2% [142] 1152(0.8%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [144] 100.0% ------------------------------------------------------------------------------------- ??? [133] 100.0% [143] 560(0.4%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [180] 100.0% ------------------------------------------------------------------------------------- ??? [4] 1.3% ??? [8] 1.8% ??? [154] 3.1% ??? [3] 4.5% loop [161] 5.6% normalize-series [142] 13.5% ??? [150] 15.7% ??? [149] 17.0% ??? [121] 17.0% compile [114] 19.1% [144] 5346(3.9%) 562(0.4%) hash-ref! .../racket/private/more-scheme.rkt:377:2 simplify [148] 29.1% ??? [149] 17.0% ??? [150] 15.7% bigfloat-hash [153] 8.6% ??? [3] 5.8% ??? [155] 5.6% ??? [4] 3.2% ??? [154] 3.1% ------------------------------------------------------------------------------------- ??? [140] 100.0% [145] 839(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [151] 66.3% check-list [167] 33.7% ------------------------------------------------------------------------------------- ??? [141] 35.7% table-ref [75] 64.3% [146] 798(0.6%) 516(0.4%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [156] 35.4% ------------------------------------------------------------------------------------- ??? [141] 100.0% [147] 560(0.4%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [152] 100.0% ------------------------------------------------------------------------------------- ??? [3] 6.3% taylor-sqrt [137] 12.4% hash-ref! [144] 81.3% [148] 4594(3.4%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f138 [157] 87.6% debug-print [158] 12.4% ------------------------------------------------------------------------------------- hash-ref! [144] 100.0% [149] 2870(2.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [144] 100.0% ------------------------------------------------------------------------------------- hash-ref! [144] 100.0% [150] 2305(1.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [144] 100.0% ------------------------------------------------------------------------------------- ??? [103] 46.9% ??? [145] 53.1% [151] 1048(0.8%) 236(0.2%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [159] 77.5% ------------------------------------------------------------------------------------- flat-contract? [108] 33.3% contract? [147] 66.7% [152] 839(0.6%) 839(0.6%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------- hash-ref! [144] 100.0% [153] 761(0.6%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [160] 100.0% ------------------------------------------------------------------------------------- hash-ref! [144] 100.0% [154] 570(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [144] 100.0% ------------------------------------------------------------------------------------- hash-ref! [144] 100.0% [155] 510(0.4%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [161] 100.0% ------------------------------------------------------------------------------------- dict? [146] 100.0% [156] 282(0.2%) 282(0.2%) assoc? ...et/collects/racket/private/dict.rkt:13:0 ------------------------------------------------------------------------------------- eval-prog [105] 2.3% rewriter [35] 3.4% simplify [148] 13.9% loop [161] 16.8% split-table [22] 63.6% [157] 16708(12.3%) 4026(3.0%) f138 .../collects/racket/match/compiler.rkt:548:40 loop [161] 80.4% ??? [104] 2.0% get-sigs [73] 1.7% set-member? [174] 1.7% ??? [74] 0.2% ------------------------------------------------------------------------------------- taylor [122] 34.1% simplify [148] 65.9% [158] 863(0.6%) 863(0.6%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ------------------------------------------------------------------------------------- ??? [151] 100.0% [159] 812(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [164] 68.5% ^TYPE? [163] 31.5% ------------------------------------------------------------------------------------- bigfloat-hash [153] 100.0% [160] 761(0.6%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [162] 100.0% ------------------------------------------------------------------------------------- rm-alts [101] 0.0% iterate-egraph! [41] 0.3% loop [34] 0.4% ??? [155] 0.6% option-on-expr [2] 1.0% point-best-alt [85] 1.3% ??? [103] 1.7% mk-enode-rec! [48] 1.7% loop! [165] 2.5% match-e [49] 6.7% f138 [157] 10.3% loop [161] 73.3% [161] 41730(30.7%) 1074(0.8%) loop .../private/map.rkt:40:19 loop [161] 73.3% f138 [157] 6.8% option-on-expr [2] 3.5% foldl [166] 2.6% loop! [165] 2.5% errors [95] 2.2% ??? [104] 1.7% keyword-apply [168] 1.4% mk-enode! [54] 1.0% mk-enode-rec! [48] 0.8% hash-ref! [144] 0.6% ??? [103] 0.5% enode-vars [169] 0.0% ??? [12] 0.0% rloop [170] 0.0% ------------------------------------------------------------------------------------- bfcanonicalize [160] 100.0% [162] 761(0.6%) 761(0.6%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------- ??? [113] 32.1% ->flonum [112] 32.9% ??? [159] 35.0% [163] 730(0.5%) 730(0.5%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------- ??? [159] 100.0% [164] 556(0.4%) 279(0.2%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [167] 49.9% ------------------------------------------------------------------------------------- merge-egraph-nodes! [50] 14.3% loop [161] 26.0% one-iter [45] 59.8% [165] 18734(13.8%) 2434(1.8%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [171] 45.8% loop [161] 26.0% make-immutable-set [172] 9.8% ??? [173] 7.9% set-member? [174] 1.2% ------------------------------------------------------------------------------------- loop [161] 100.0% [166] 1654(1.2%) 242(0.2%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [175] 68.3% check-fold [177] 17.1% ------------------------------------------------------------------------------------- ??? [164] 24.7% build-compound-type-name [127] 24.7% ??? [145] 25.2% match-e [49] 25.3% [167] 1122(0.8%) 1122(0.8%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------- loop [161] 100.0% [168] 786(0.6%) 234(0.2%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [176] 70.2% ------------------------------------------------------------------------------------- loop [161] 100.0% [169] 284(0.2%) 0(0.0%) enode-vars ...alt-testing/src/core/enode.rkt:263:0 pack-leader [183] 100.0% ------------------------------------------------------------------------------------- loop [161] 20.0% rloop [170] 80.0% [170] 278(0.2%) 278(0.2%) rloop ...ket/collects/racket/private/list.rkt:88:4 rloop [170] 80.0% ------------------------------------------------------------------------------------- adopt-enode! [68] 3.0% loop! [165] 97.0% [171] 9248(6.8%) 8460(6.2%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [181] 8.5% ------------------------------------------------------------------------------------- loop! [165] 100.0% [172] 3738(2.8%) 3452(2.5%) make-immutable-set .../private/set-types.rkt:948:0 stream? [182] 7.7% ------------------------------------------------------------------------------------- loop! [165] 100.0% [173] 3066(2.3%) 275(0.2%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [179] 73.3% reverse [178] 17.7% ------------------------------------------------------------------------------------- f138 [157] 14.5% loop! [165] 27.1% match-e [49] 29.2% one-iter [45] 29.2% [174] 1922(1.4%) 1922(1.4%) set-member? ...ts/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------- foldl [166] 100.0% [175] 1130(0.8%) 279(0.2%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [180] 75.3% ------------------------------------------------------------------------------------- keyword-apply [168] 100.0% [176] 552(0.4%) 552(0.4%) loop ...cket/collects/racket/private/kw.rkt:518:13 ------------------------------------------------------------------------------------- foldl [166] 100.0% [177] 282(0.2%) 282(0.2%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------- update-leader! [55] 5.7% contract-struct-name [138] 6.7% list-cartesian-product [58] 6.8% ??? [173] 13.2% one-iter [45] 20.3% match-e [49] 20.6% ??? [70] 26.7% [178] 4130(3.0%) 4130(3.0%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------- update-leader! [55] 15.3% ??? [70] 22.0% ??? [173] 62.7% [179] 3584(2.6%) 2478(1.8%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [183] 30.9% ------------------------------------------------------------------------------------- assoc-ref [143] 39.7% merge2 [175] 60.3% [180] 1410(1.0%) 1410(1.0%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------- custom-set-union [171] 100.0% [181] 788(0.6%) 515(0.4%) choose-immutable ...et/private/set-types.rkt:151:0 set-check-compatible [184] 34.7% ------------------------------------------------------------------------------------- make-immutable-set [172] 100.0% [182] 287(0.2%) 287(0.2%) stream? ...t/collects/racket/private/for.rkt:493:2 ------------------------------------------------------------------------------------- enode-vars [169] 12.9% one-iter [45] 36.5% update-en-expr [179] 50.5% [183] 2190(1.6%) 2190(1.6%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ------------------------------------------------------------------------------------- choose-immutable [181] 100.0% [184] 274(0.2%) 274(0.2%) set-check-compatible ...rivate/set-types.rkt:531:0 -------------------------------------------------------------------------------------