Profiling results ----------------- Total cpu time observed: 298349ms (out of 298764ms) Number of samples taken: 1071 (once every 279ms) (Hiding functions with self<1.0% and local<2.0%: 12 of 200 hidden) ===================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ===================================================================================== [1] 298349(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [4] 100.0% ------------------------------------------------------------------------------------- loop [141] 100.0% [2] 1662(0.6%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [5] 49.7% loop [141] 33.5% err-lsts->split-indices [6] 16.8% ------------------------------------------------------------------------------------- hash-ref! [158] 100.0% [3] 1370(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 simplify [130] 100.0% ------------------------------------------------------------------------------------- ??? [1] 100.0% [4] 298349(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [7] 100.0% ------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [5] 827(0.3%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [164] 66.8% eval-prog [100] 33.2% ------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [6] 279(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [8] 100.0% ------------------------------------------------------------------------------------- profile-thunk [4] 100.0% [7] 298349(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [9] 100.0% ------------------------------------------------------------------------------------- err-lsts->split-indices [6] 100.0% [8] 279(0.1%) 279(0.1%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------- ??? [7] 100.0% [9] 298349(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [10] 99.1% prepare-points [11] 0.9% ------------------------------------------------------------------------------------- ??? [9] 100.0% [10] 295684(99.1%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [12] 99.3% get-final-combination [13] 0.7% setup-alt-simplified [15] 0.1% ------------------------------------------------------------------------------------- ??? [9] 100.0% [11] 2666(0.9%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [19] 56.9% make-exacts [14] 43.1% ------------------------------------------------------------------------------------- run-improve [10] 100.0% [12] 293467(98.4%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [16] 92.8% gen-series! [17] 4.4% finalize-iter! [18] 2.2% gen-rewrites! [21] 0.3% choose-best-alt! [22] 0.3% localize! [25] 0.1% ------------------------------------------------------------------------------------- run-improve [10] 100.0% [13] 1940(0.7%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [20] 85.7% extract-alt [23] 14.3% ------------------------------------------------------------------------------------- prepare-points [11] 100.0% [14] 1150(0.4%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [19] 100.0% ------------------------------------------------------------------------------------- run-improve [10] 100.0% [15] 277(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [24] 100.0% ------------------------------------------------------------------------------------- run-iter! [12] 100.0% [16] 272402(91.3%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [26] 100.0% ------------------------------------------------------------------------------------- run-iter! [12] 100.0% [17] 12782(4.3%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [27] 100.0% ------------------------------------------------------------------------------------- run-iter! [12] 100.0% [18] 6348(2.1%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [67] 100.0% ------------------------------------------------------------------------------------- make-exacts [14] 43.1% prepare-points [11] 56.9% [19] 2666(0.9%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [141] 100.0% ------------------------------------------------------------------------------------- get-final-combination [13] 100.0% [20] 1662(0.6%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [135] 100.0% ------------------------------------------------------------------------------------- run-iter! [12] 100.0% [21] 834(0.3%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [28] 100.0% ------------------------------------------------------------------------------------- run-iter! [12] 100.0% [22] 826(0.3%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [67] 100.0% ------------------------------------------------------------------------------------- get-final-combination [13] 100.0% [23] 277(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [29] 100.0% ------------------------------------------------------------------------------------- setup-alt-simplified [15] 100.0% [24] 277(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [31] 100.0% ------------------------------------------------------------------------------------- run-iter! [12] 100.0% [25] 275(0.1%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [30] 100.0% ------------------------------------------------------------------------------------- simplify! [16] 100.0% [26] 272402(91.3%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [31] 100.0% ------------------------------------------------------------------------------------- gen-series! [17] 100.0% [27] 12782(4.3%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [97] 100.0% ------------------------------------------------------------------------------------- gen-rewrites! [21] 100.0% [28] 834(0.3%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [32] 100.0% ------------------------------------------------------------------------------------- extract-alt [23] 100.0% [29] 277(0.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [33] 100.0% ------------------------------------------------------------------------------------- localize! [25] 100.0% [30] 275(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [158] 100.0% ------------------------------------------------------------------------------------- simplify-alt [24] 0.1% ??? [26] 99.9% [31] 272678(91.4%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [34] 100.0% ------------------------------------------------------------------------------------- alt-rewrite-rm [28] 36.1% matcher [36] 63.9% [32] 834(0.3%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [36] 63.9% *rules* [35] 36.1% ------------------------------------------------------------------------------------- argmins [29] 100.0% [33] 277(0.1%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [89] 100.0% ------------------------------------------------------------------------------------- simplify [31] 100.0% [34] 272678(91.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [37] 94.3% loop [38] 5.7% ------------------------------------------------------------------------------------- rewriter [32] 100.0% [35] 834(0.3%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [39] 100.0% ------------------------------------------------------------------------------------- matcher [36] 50.0% rewriter [32] 50.0% [36] 834(0.3%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [36] 50.0% rewriter [32] 50.0% ------------------------------------------------------------------------------------- ??? [34] 100.0% [37] 257268(86.2%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [40] 98.9% loop [141] 1.1% ------------------------------------------------------------------------------------- ??? [34] 100.0% [38] 15410(5.2%) 542(0.2%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [41] 49.9% loop [42] 39.4% make-sequence [180] 3.6% reverse [168] 1.8% filter [79] 1.8% ------------------------------------------------------------------------------------- *rules* [35] 100.0% [39] 834(0.3%) 557(0.2%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [73] 33.3% ------------------------------------------------------------------------------------- iterate-egraph! [37] 100.0% [40] 254505(85.3%) 3294(1.1%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [43] 28.2% merge-egraph-nodes! [44] 18.8% list-member? [110] 16.6% loop! [147] 9.7% mk-enode! [50] 8.4% substitute-e [45] 8.3% custom-set-member? [47] 5.2% update-leader! [49] 2.0% reverse [168] 0.5% filter [79] 0.3% loop [48] 0.1% ------------------------------------------------------------------------------------- loop [38] 100.0% [41] 7688(2.6%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [46] 100.0% ------------------------------------------------------------------------------------- loop [38] 100.0% [42] 6072(2.0%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [46] 100.0% ------------------------------------------------------------------------------------- match-e [43] 32.1% one-iter [40] 67.9% [43] 71648(24.0%) 13841(4.6%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [43] 32.1% loop [141] 17.7% ??? [67] 5.8% list-cartesian-product [52] 5.6% ??? [53] 5.6% variable? [51] 4.2% make-sequence [180] 3.5% reverse [168] 3.3% do-procedure-reduce-keyword-arity [60] 2.5% filter [79] 1.1% ??? [56] 1.0% check-list [181] 0.6% custom-in-set [188] 0.2% ------------------------------------------------------------------------------------- merge-egraph-nodes! [44] 13.5% one-iter [40] 86.5% [44] 47904(16.1%) 1386(0.5%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [49] 70.1% merge-egraph-nodes! [44] 13.5% loop! [147] 12.9% enode-merge! [57] 1.2% ------------------------------------------------------------------------------------- substitute-e [45] 12.7% one-iter [40] 87.3% [45] 21066(7.1%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [50] 77.7% substitute-e [45] 12.7% variable? [51] 4.2% ??? [67] 3.0% reverse [168] 2.0% ------------------------------------------------------------------------------------- loop [42] 44.1% mk-min [41] 55.9% [46] 13760(4.6%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [68] 66.1% ...sting/src/common.rkt:47:2 [112] 21.9% compile [54] 12.0% ------------------------------------------------------------------------------------- one-iter [40] 100.0% [47] 13268(4.4%) 12168(4.1%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [55] 8.3% ------------------------------------------------------------------------------------- one-iter [40] 12.5% loop [48] 87.5% [48] 276(0.1%) 276(0.1%) loop ...cket/collects/racket/private/hash.rkt:25:8 loop [48] 87.5% ------------------------------------------------------------------------------------- one-iter [40] 11.9% merge-egraph-nodes! [44] 88.1% [49] 41810(14.0%) 9451(3.2%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [59] 66.2% update-en-expr [170] 6.6% reverse [168] 3.3% make-sequence [180] 0.7% ------------------------------------------------------------------------------------- substitute-e [45] 43.5% one-iter [40] 56.5% [50] 37656(12.6%) 2204(0.7%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [58] 91.9% loop [141] 0.7% hash-has-key? [70] 0.7% ------------------------------------------------------------------------------------- substitute-e [45] 21.7% match-e [43] 78.3% [51] 10240(3.4%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [67] 100.0% ------------------------------------------------------------------------------------- list-cartesian-product [52] 23.7% match-e [43] 76.3% [52] 5852(2.0%) 4458(1.5%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [52] 23.7% make-sequence [180] 16.6% reverse [168] 4.9% ------------------------------------------------------------------------------------- match-e [43] 100.0% [53] 5234(1.8%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [61] 68.1% do-procedure-reduce-keyword-arity [60] 31.9% ------------------------------------------------------------------------------------- expression-cost [46] 100.0% [54] 1654(0.6%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [158] 83.3% reverse [168] 16.7% ------------------------------------------------------------------------------------- custom-set-member? [47] 100.0% [55] 1100(0.4%) 1100(0.4%) set-check-elem ...cket/private/set-types.rkt:329:0 ------------------------------------------------------------------------------------- match-e [43] 100.0% [56] 834(0.3%) 558(0.2%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 custom-in-set [188] 33.2% ------------------------------------------------------------------------------------- merge-egraph-nodes! [44] 100.0% [57] 556(0.2%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [62] 50.1% pack-leader [182] 49.9% ------------------------------------------------------------------------------------- mk-enode! [50] 100.0% [58] 34621(11.6%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [63] 99.2% make-immutable-set [160] 0.8% ------------------------------------------------------------------------------------- update-leader! [49] 100.0% [59] 27660(9.3%) 274(0.1%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [64] 99.0% ------------------------------------------------------------------------------------- ??? [53] 40.1% match-e [43] 59.9% [60] 4164(1.4%) 3330(1.1%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [186] 20.0% ------------------------------------------------------------------------------------- ??? [53] 100.0% [61] 3562(1.2%) 2772(0.9%) do-curry ...cket/collects/racket/function.rkt:71:2 partially-applied-procedure-arity-mask [65] 14.4% procedure-keywords [186] 7.8% ------------------------------------------------------------------------------------- enode-merge! [57] 100.0% [62] 279(0.1%) 279(0.1%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 ------------------------------------------------------------------------------------- new-enode [58] 100.0% [63] 34347(11.5%) 278(0.1%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [66] 99.2% ------------------------------------------------------------------------------------- do-hash-update [59] 100.0% [64] 27386(9.2%) 22960(7.7%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [170] 9.1% reverse [168] 7.1% ------------------------------------------------------------------------------------- do-curry [61] 100.0% [65] 514(0.2%) 514(0.2%) partially-applied-procedure-arity-mask ...rkt:58:2 ------------------------------------------------------------------------------------- type-of-enode-expr [63] 100.0% [66] 34070(11.4%) 276(0.1%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [68] 43.0% ??? [69] 28.5% ??? [67] 16.3% ...sting/src/common.rkt:47:2 [112] 11.3% ------------------------------------------------------------------------------------- f8 [135] 0.8% choose-best-alt! [22] 2.4% substitute-e [45] 4.7% get-sigs [66] 15.8% finalize-iter! [18] 18.1% match-e [43] 29.1% variable? [51] 29.2% [67] 35113(11.8%) 838(0.3%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [70] 76.4% atab-add-altns [72] 18.1% atab-pick-alt [74] 2.4% ??? [126] 0.8% ------------------------------------------------------------------------------------- expression-cost [46] 38.3% get-sigs [66] 61.7% [68] 23760(8.0%) 4411(1.5%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [76] 73.3% return/no-unsupplied [73] 2.3% ??? [75] 2.3% reverse [168] 1.2% ...sting/src/common.rkt:47:2 [112] 1.2% ------------------------------------------------------------------------------------- get-sigs [66] 100.0% [69] 9722(3.3%) 281(0.1%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [71] 79.9% handle-the-hash [84] 8.6% get/build-late-neg-projection [99] 8.6% ------------------------------------------------------------------------------------- mk-enode! [50] 1.0% ??? [67] 99.0% [70] 27098(9.1%) 22366(7.5%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [76] 16.4% reverse [168] 1.0% ------------------------------------------------------------------------------------- ??? [69] 100.0% [71] 7768(2.6%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [77] 100.0% ------------------------------------------------------------------------------------- ??? [67] 100.0% [72] 6348(2.1%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [78] 100.0% ------------------------------------------------------------------------------------- flag-set? [39] 33.3% table-ref [68] 66.7% [73] 834(0.3%) 554(0.2%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [79] 33.6% ------------------------------------------------------------------------------------- ??? [67] 100.0% [74] 826(0.3%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [80] 66.6% errors [89] 33.4% ------------------------------------------------------------------------------------- table-ref [68] 100.0% [75] 552(0.2%) 552(0.2%) ??? ...cts/racket/contract/private/list.rkt:211:14 ------------------------------------------------------------------------------------- hash-has-key? [70] 20.4% table-ref [68] 79.6% [76] 21866(7.3%) 8863(3.0%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [81] 38.0% handle-the-hash [84] 15.2% arrow-higher-order:lnp [85] 2.5% ??? [125] 1.3% ??? [128] 1.3% do-chaperone-procedure [88] 1.2% ------------------------------------------------------------------------------------- ??? [71] 100.0% [77] 7768(2.6%) 2520(0.8%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [83] 64.0% ??? [86] 3.6% ------------------------------------------------------------------------------------- atab-add-altns [72] 100.0% [78] 6348(2.1%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [82] 95.7% override-at-pnts [87] 4.3% ------------------------------------------------------------------------------------- loop [38] 10.1% return/no-unsupplied [73] 10.2% one-iter [40] 29.9% match-e [43] 49.8% [79] 2740(0.9%) 2740(0.9%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------- atab-pick-alt [74] 100.0% [80] 550(0.2%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [141] 100.0% ------------------------------------------------------------------------------------- ??? [76] 100.0% [81] 8305(2.8%) 4442(1.5%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 blame-add-missing-party [91] 23.2% loop [92] 19.9% make-keyword-procedure [93] 3.4% ------------------------------------------------------------------------------------- atab-add-altn [78] 100.0% [82] 6074(2.0%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [89] 95.4% ??? [94] 4.6% ------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [77] 100.0% [83] 4972(1.7%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [90] 100.0% ------------------------------------------------------------------------------------- ??? [69] 20.2% ??? [76] 79.8% [84] 4152(1.4%) 1396(0.5%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [125] 59.7% ??? [137] 6.7% ------------------------------------------------------------------------------------- ??? [76] 100.0% [85] 555(0.2%) 555(0.2%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [77] 100.0% [86] 276(0.1%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:44 blame-add-context [95] 100.0% ------------------------------------------------------------------------------------- atab-add-altn [78] 100.0% [87] 274(0.1%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [89] 100.0% ------------------------------------------------------------------------------------- ??? [76] 100.0% [88] 273(0.1%) 0(0.0%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [96] 100.0% ------------------------------------------------------------------------------------- override-at-pnts [87] 3.5% atab-pick-alt [74] 3.6% composed [33] 3.6% loop [141] 14.3% best-and-tied-at-points [82] 75.0% [89] 7730(2.6%) 276(0.1%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [98] 71.4% eval-prog [100] 14.4% ??? [97] 10.7% ------------------------------------------------------------------------------------- ??? [83] 100.0% [90] 4972(1.7%) 273(0.1%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [99] 83.4% check-list [181] 5.7% reverse [168] 5.4% ------------------------------------------------------------------------------------- ??? [81] 100.0% [91] 1923(0.6%) 1923(0.6%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------- loop [92] 32.0% ??? [81] 68.0% [92] 1656(0.6%) 1656(0.6%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [92] 32.0% ------------------------------------------------------------------------------------- ??? [81] 100.0% [93] 285(0.1%) 285(0.1%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------- best-and-tied-at-points [82] 100.0% [94] 278(0.1%) 278(0.1%) ??? ...ket/collects/racket/private/for.rkt:1280:14 ------------------------------------------------------------------------------------- ??? [86] 100.0% [95] 276(0.1%) 276(0.1%) blame-add-context ...tract/private/blame.rkt:170:0 ------------------------------------------------------------------------------------- do-chaperone-procedure [88] 100.0% [96] 273(0.1%) 273(0.1%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 ------------------------------------------------------------------------------------- errors [89] 5.2% loop [141] 14.6% loop [101] 40.1% taylor-alt [27] 40.1% [97] 15938(5.3%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:375:33 loop [101] 40.1% approximate [102] 40.1% ->flonum [104] 14.4% real->bigfloat [107] 3.6% ??? [126] 1.8% ------------------------------------------------------------------------------------- copying-mergesort [185] 7.1% loop [141] 22.4% errors [89] 70.5% [98] 7820(2.6%) 3908(1.3%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [141] 18.1% ??? [105] 14.2% ??? [106] 13.8% ??? [108] 3.9% ------------------------------------------------------------------------------------- ??? [109] 2.8% ??? [69] 14.0% ??? [90] 83.2% [99] 4980(1.7%) 826(0.3%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [103] 80.6% ??? [109] 2.8% ------------------------------------------------------------------------------------- sort-context-on-expr [5] 19.8% errors [89] 80.2% [100] 1386(0.5%) 1111(0.4%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f8 [135] 19.8% ------------------------------------------------------------------------------------- ??? [97] 21.0% loop [101] 79.0% [101] 12782(4.3%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [101] 79.0% ??? [97] 21.0% ------------------------------------------------------------------------------------- ??? [97] 100.0% [102] 12782(4.3%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [111] 93.5% taylor-sqrt [116] 2.2% hash-ref! [158] 2.1% taylor [117] 2.1% ------------------------------------------------------------------------------------- get/build-late-neg-projection [99] 100.0% [103] 4154(1.4%) 554(0.2%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [113] 79.9% reverse [168] 6.8% ------------------------------------------------------------------------------------- ??? [97] 100.0% [104] 2295(0.8%) 1405(0.5%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 ...sting/src/common.rkt:47:2 [112] 13.7% ^TYPE? [114] 13.1% list-member? [110] 11.9% ------------------------------------------------------------------------------------- ??? [98] 100.0% [105] 1108(0.4%) 1108(0.4%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------- ??? [98] 100.0% [106] 1083(0.4%) 275(0.1%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 list-member? [110] 48.9% ...sting/src/common.rkt:47:2 [112] 25.7% ------------------------------------------------------------------------------------- ??? [97] 100.0% [107] 578(0.2%) 0(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [115] 100.0% ------------------------------------------------------------------------------------- ??? [98] 100.0% [108] 305(0.1%) 0(0.0%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [114] 100.0% ------------------------------------------------------------------------------------- get/build-late-neg-projection [99] 100.0% [109] 278(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [99] 100.0% ------------------------------------------------------------------------------------- ->flonum [104] 0.6% ??? [106] 1.2% one-iter [40] 98.1% [110] 43042(14.4%) 255(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 member [118] 99.4% ------------------------------------------------------------------------------------- approximate [102] 100.0% [111] 11950(4.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [158] 100.0% ------------------------------------------------------------------------------------- ??? [121] 1.8% table-ref [68] 3.6% ??? [106] 3.6% ->flonum [104] 4.1% expression-cost [46] 37.2% get-sigs [66] 49.8% [112] 7730(2.6%) 556(0.2%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [119] 56.6% ??? [121] 23.3% ??? [126] 5.3% dict-key-contract [122] 4.1% coerce-contract [124] 3.5% ------------------------------------------------------------------------------------- contract-struct-name [120] 8.3% ??? [103] 91.7% [113] 3318(1.1%) 829(0.3%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [120] 62.4% check-list [181] 16.8% ------------------------------------------------------------------------------------- ->flonum [104] 49.7% ??? [108] 50.3% [114] 606(0.2%) 606(0.2%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------- real->bigfloat [107] 100.0% [115] 578(0.2%) 578(0.2%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------- approximate [102] 100.0% [116] 284(0.1%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 hash-ref! [158] 100.0% ------------------------------------------------------------------------------------- loop [141] 50.0% approximate [102] 50.0% [117] 274(0.1%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 loop [141] 50.0% taylor-invert [123] 50.0% ------------------------------------------------------------------------------------- list-member? [110] 100.0% [118] 42787(14.3%) 42787(14.3%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------- ??? [125] 15.6% ...sting/src/common.rkt:47:2 [112] 84.4% [119] 4376(1.5%) 1342(0.4%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [125] 59.9% ??? [126] 9.4% ??? [128] 6.2% ------------------------------------------------------------------------------------- build-compound-type-name [113] 100.0% [120] 2206(0.7%) 1382(0.5%) contract-struct-name ...ract/private/prop.rkt:98:0 reverse [168] 25.0% build-compound-type-name [113] 18.7% ------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [112] 100.0% [121] 1936(0.6%) 1110(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 assoc-ref [127] 28.4% ...sting/src/common.rkt:47:2 [112] 14.3% ------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [112] 100.0% [122] 315(0.1%) 315(0.1%) dict-key-contract ...collects/racket/dict.rkt:71:0 ------------------------------------------------------------------------------------- taylor [117] 100.0% [123] 274(0.1%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 normalize-series [129] 100.0% ------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [112] 100.0% [124] 270(0.1%) 0(0.0%) coerce-contract ...contract/private/guts.rkt:307:0 coerce-contract/f [138] 100.0% ------------------------------------------------------------------------------------- ??? [76] 4.6% handle-the-hash [84] 40.9% ??? [119] 54.5% [125] 6058(2.0%) 3055(1.0%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [131] 27.1% ??? [119] 22.5% ------------------------------------------------------------------------------------- ??? [67] 14.3% ??? [97] 14.6% ...sting/src/common.rkt:47:2 [112] 28.5% ??? [119] 42.6% [126] 1934(0.6%) 558(0.2%) ??? ...ects/racket/contract/private/guts.rkt:794:8 dict? [132] 42.8% contract? [134] 28.3% ------------------------------------------------------------------------------------- ??? [121] 100.0% [127] 549(0.2%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [183] 100.0% ------------------------------------------------------------------------------------- ??? [119] 49.8% ??? [76] 50.2% [128] 548(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [133] 100.0% ------------------------------------------------------------------------------------- taylor-invert [123] 100.0% [129] 274(0.1%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 simplify [130] 100.0% ------------------------------------------------------------------------------------- normalize-series [129] 2.2% ??? [3] 11.0% hash-ref! [158] 86.9% [130] 12507(4.2%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [135] 84.5% debug-print [136] 13.4% simplify* [152] 2.1% ------------------------------------------------------------------------------------- ??? [125] 100.0% [131] 1640(0.5%) 819(0.3%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [137] 33.0% check-list [181] 17.0% ------------------------------------------------------------------------------------- ??? [126] 100.0% [132] 828(0.3%) 552(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [139] 33.4% ------------------------------------------------------------------------------------- ??? [128] 100.0% [133] 548(0.2%) 276(0.1%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [140] 49.8% ------------------------------------------------------------------------------------- ??? [126] 100.0% [134] 548(0.2%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [138] 51.4% simple-flat-contract? [142] 48.6% ------------------------------------------------------------------------------------- eval-prog [100] 0.4% hash-ref! [158] 2.2% split-table [20] 11.5% simplify [130] 38.5% loop [141] 47.4% [135] 12506(4.2%) 8627(2.9%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [141] 63.8% simple-compose [184] 2.3% parse-app [143] 2.3% ??? [67] 0.4% ------------------------------------------------------------------------------------- simplify [130] 100.0% [136] 1672(0.6%) 1672(0.6%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ------------------------------------------------------------------------------------- handle-the-hash [84] 33.9% ??? [131] 66.1% [137] 820(0.3%) 275(0.1%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [144] 33.9% ??? [146] 32.6% ------------------------------------------------------------------------------------- coerce-contract [124] 49.0% contract? [134] 51.0% [138] 552(0.2%) 282(0.1%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [145] 49.0% ------------------------------------------------------------------------------------- dict? [132] 100.0% [139] 277(0.1%) 277(0.1%) assoc? ...et/collects/racket/private/dict.rkt:13:0 ------------------------------------------------------------------------------------- check-hash/c [133] 100.0% [140] 273(0.1%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [142] 100.0% ------------------------------------------------------------------------------------- loop [19] 0.0% option-on-expr [2] 0.2% taylor [117] 0.2% mk-enode! [50] 0.3% iterate-egraph! [37] 0.3% ??? [98] 0.6% point-best-alt [80] 0.7% ??? [176] 1.1% loop! [147] 4.2% f8 [135] 8.9% match-e [43] 15.3% loop [141] 68.1% [141] 55886(18.7%) 2493(0.8%) loop .../private/map.rkt:40:19 loop [141] 68.1% f8 [135] 7.9% step [148] 6.0% loop! [147] 4.1% ??? [149] 3.6% foldl [162] 2.4% keyword-apply [151] 1.7% errors [89] 0.9% hash-ref! [158] 0.9% ??? [97] 0.6% option-on-expr [2] 0.5% pack-leader [182] 0.3% taylor [117] 0.2% setfindf [150] 0.2% simplify* [152] 0.2% ??? [153] 0.2% make-multiplication-node [156] 0.1% ??? [98] 0.0% enode-vars [155] 0.0% ------------------------------------------------------------------------------------- contract? [134] 49.4% flat-contract? [140] 50.6% [142] 539(0.2%) 539(0.2%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------- f8 [135] 100.0% [143] 282(0.1%) 282(0.1%) parse-app ...collects/racket/private/kw.rkt:1207:2 ------------------------------------------------------------------------------------- ??? [137] 100.0% [144] 278(0.1%) 0(0.0%) ??? ...lects/racket/contract/private/orc.rkt:117:8 eqables-pred [154] 100.0% ------------------------------------------------------------------------------------- coerce-contract/f [138] 100.0% [145] 270(0.1%) 270(0.1%) coerce-simple-value ...ract/private/guts.rkt:385:0 ------------------------------------------------------------------------------------- ??? [137] 100.0% [146] 267(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [157] 100.0% ------------------------------------------------------------------------------------- merge-egraph-nodes! [44] 18.7% loop [141] 33.4% one-iter [40] 48.0% [147] 33818(11.3%) 5560(1.9%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [159] 34.8% loop [141] 34.2% make-immutable-set [160] 12.6% ??? [161] 8.0% ------------------------------------------------------------------------------------- loop [141] 100.0% [148] 7488(2.5%) 5820(2.0%) step .../racket/collects/racket/function.rkt:145:9 sort [163] 14.8% ??? [164] 7.4% ------------------------------------------------------------------------------------- loop [141] 100.0% [149] 2460(0.8%) 2460(0.8%) ??? .../racket/collects/racket/function.rkt:138:13 ------------------------------------------------------------------------------------- loop [141] 100.0% [150] 1662(0.6%) 1104(0.4%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 make-sequence [180] 33.6% ------------------------------------------------------------------------------------- loop [141] 100.0% [151] 1102(0.4%) 554(0.2%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [165] 49.7% ------------------------------------------------------------------------------------- simplify [130] 32.7% loop [141] 67.3% [152] 816(0.3%) 539(0.2%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [158] 33.9% ------------------------------------------------------------------------------------- loop [141] 100.0% [153] 555(0.2%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 foldl [162] 50.4% pattern-match [166] 49.6% ------------------------------------------------------------------------------------- ??? [144] 100.0% [154] 278(0.1%) 278(0.1%) eqables-pred ...et/contract/private/orc.rkt:100:10 ------------------------------------------------------------------------------------- loop [141] 100.0% [155] 274(0.1%) 0(0.0%) enode-vars ...alt-testing/src/core/enode.rkt:263:0 pack-leader [182] 100.0% ------------------------------------------------------------------------------------- loop [141] 100.0% [156] 272(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [167] 100.0% ------------------------------------------------------------------------------------- ??? [146] 100.0% [157] 267(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [181] 100.0% ------------------------------------------------------------------------------------- simplify* [152] 0.3% localize-error [30] 1.0% taylor-sqrt [116] 1.0% approximate [102] 1.9% loop [141] 3.7% compile [54] 6.0% ??? [173] 8.6% ??? [172] 11.2% ??? [171] 16.2% ??? [169] 23.3% ??? [111] 23.3% [158] 14161(4.7%) 1646(0.6%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [169] 23.3% simplify [130] 22.1% ??? [171] 16.2% ??? [172] 11.2% ??? [173] 8.6% ??? [176] 5.7% ??? [3] 2.2% f8 [135] 1.9% ------------------------------------------------------------------------------------- loop! [147] 100.0% [159] 13561(4.5%) 11068(3.7%) custom-set-union ...et/private/set-types.rkt:168:0 check-list [181] 10.2% choose-immutable [175] 8.2% ------------------------------------------------------------------------------------- new-enode [58] 3.0% loop! [147] 97.0% [160] 9144(3.1%) 9144(3.1%) make-immutable-set .../private/set-types.rkt:948:0 ------------------------------------------------------------------------------------- loop! [147] 100.0% [161] 5004(1.7%) 558(0.2%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [170] 60.9% reverse [168] 27.9% ------------------------------------------------------------------------------------- ??? [153] 8.4% loop [141] 91.6% [162] 3325(1.1%) 832(0.3%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [174] 58.5% check-fold [178] 16.5% ------------------------------------------------------------------------------------- step [148] 100.0% [163] 1110(0.4%) 1110(0.4%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------------- sort-context-on-expr [5] 49.8% step [148] 50.2% [164] 1110(0.4%) 558(0.2%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [177] 49.8% ------------------------------------------------------------------------------------- keyword-apply [151] 100.0% [165] 547(0.2%) 547(0.2%) loop ...cket/collects/racket/private/kw.rkt:518:13 ------------------------------------------------------------------------------------- ??? [153] 100.0% [166] 276(0.1%) 276(0.1%) pattern-match ...testing/src/core/matcher.rkt:48:0 ------------------------------------------------------------------------------------- make-multiplication-node [156] 100.0% [167] 272(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubnode [179] 100.0% ------------------------------------------------------------------------------------- ??? [90] 2.2% compile [54] 2.3% table-ref [68] 2.3% loop [38] 2.3% hash-has-key? [70] 2.3% ??? [103] 2.3% list-cartesian-product [52] 2.3% contract-struct-name [120] 4.5% substitute-e [45] 4.6% update-leader! [49] 11.3% one-iter [40] 11.3% ??? [161] 11.5% ??? [64] 15.9% match-e [43] 25.0% [168] 12190(4.1%) 12190(4.1%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------- hash-ref! [158] 100.0% [169] 11950(4.0%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [158] 100.0% ------------------------------------------------------------------------------------- ??? [64] 30.0% update-leader! [49] 33.3% ??? [161] 36.7% [170] 8310(2.8%) 5268(1.8%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [182] 26.5% make-sequence [180] 10.1% ------------------------------------------------------------------------------------- hash-ref! [158] 100.0% [171] 8060(2.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [158] 100.0% ------------------------------------------------------------------------------------- hash-ref! [158] 100.0% [172] 6718(2.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [158] 100.0% ------------------------------------------------------------------------------------- hash-ref! [158] 100.0% [173] 5856(2.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [158] 100.0% ------------------------------------------------------------------------------------- foldl [162] 100.0% [174] 1946(0.7%) 278(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [183] 85.7% ------------------------------------------------------------------------------------- custom-set-union [159] 100.0% [175] 1112(0.4%) 838(0.3%) choose-immutable ...et/private/set-types.rkt:151:0 check-list [181] 24.6% ------------------------------------------------------------------------------------- hash-ref! [158] 100.0% [176] 1111(0.4%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [141] 100.0% ------------------------------------------------------------------------------------- ??? [164] 100.0% [177] 552(0.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [185] 100.0% ------------------------------------------------------------------------------------- foldl [162] 100.0% [178] 548(0.2%) 548(0.2%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------- make-multiplication-subnode [167] 100.0% [179] 272(0.1%) 0(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 simple-compose [184] 100.0% ------------------------------------------------------------------------------------- update-leader! [49] 4.3% loop [38] 8.7% setfindf [150] 8.8% update-en-expr [170] 13.1% list-cartesian-product [52] 17.4% match-e [43] 47.7% [180] 6374(2.1%) 6098(2.0%) make-sequence ...ects/racket/private/for.rkt:557:2 ??? [187] 4.3% ------------------------------------------------------------------------------------- ??? [157] 7.4% choose-immutable [175] 7.6% ??? [131] 7.8% ??? [90] 7.9% build-compound-type-name [113] 15.4% match-e [43] 15.6% custom-set-union [159] 38.3% [181] 3604(1.2%) 3604(1.2%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------- enode-vars [155] 9.0% enode-merge! [57] 9.1% loop [141] 9.3% update-en-expr [170] 72.6% [182] 3038(1.0%) 3038(1.0%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ------------------------------------------------------------------------------------- assoc-ref [127] 24.8% merge2 [174] 75.2% [183] 2216(0.7%) 2216(0.7%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------- make-multiplication-subsubnode [179] 48.8% f8 [135] 51.2% [184] 556(0.2%) 272(0.1%) simple-compose ...s/racket/private/list.rkt:426:10 procedure-keywords [186] 51.2% ------------------------------------------------------------------------------------- generic-sort/key [177] 26.7% copying-mergesort [185] 73.3% [185] 552(0.2%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [185] 73.3% ??? [98] 26.7% ------------------------------------------------------------------------------------- do-curry [61] 19.9% simple-compose [184] 20.4% do-procedure-reduce-keyword-arity [60] 59.7% [186] 1395(0.5%) 1395(0.5%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------- make-sequence [180] 100.0% [187] 276(0.1%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:477:7 custom-in-set [188] 100.0% ------------------------------------------------------------------------------------- match-e [43] 32.9% ??? [187] 33.5% ??? [56] 33.6% [188] 824(0.3%) 824(0.3%) custom-in-set ...acket/private/set-types.rkt:580:0 -------------------------------------------------------------------------------------