Profiling results ----------------- Total cpu time observed: 425101ms (out of 425462ms) Number of samples taken: 461 (once every 922ms) (Hiding functions with self<1.0% and local<2.0%: 10 of 186 hidden) ================================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ================================================================================= [1] 425101(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [3] 100.0% --------------------------------------------------------------------------------- loop [136] 100.0% [2] 1838(0.4%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [4] 100.0% --------------------------------------------------------------------------------- ??? [1] 100.0% [3] 425101(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [5] 100.0% --------------------------------------------------------------------------------- make-multiplication-node [2] 100.0% [4] 1838(0.4%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubnode [6] 100.0% --------------------------------------------------------------------------------- profile-thunk [3] 100.0% [5] 425101(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [7] 100.0% --------------------------------------------------------------------------------- make-multiplication-subnode [4] 100.0% [6] 1838(0.4%) 0(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 mterm->expr [8] 100.0% --------------------------------------------------------------------------------- ??? [5] 100.0% [7] 425101(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 prepare-points [13] 75.7% run-improve [9] 24.3% --------------------------------------------------------------------------------- make-multiplication-subsubnode [6] 100.0% [8] 1838(0.4%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 f53 [129] 100.0% --------------------------------------------------------------------------------- ??? [7] 100.0% [9] 103444(24.3%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [10] 93.0% get-final-combination [11] 4.6% setup-prog! [12] 2.4% --------------------------------------------------------------------------------- run-improve [9] 100.0% [10] 96250(22.6%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [14] 46.8% gen-series! [15] 44.4% finalize-iter! [16] 6.4% choose-best-alt! [18] 1.8% localize! [19] 0.6% --------------------------------------------------------------------------------- run-improve [9] 100.0% [11] 4752(1.1%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [17] 94.1% extract-alt [20] 5.9% --------------------------------------------------------------------------------- run-improve [9] 100.0% [12] 2443(0.6%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [13] 100.0% --------------------------------------------------------------------------------- setup-prog! [12] 0.8% ??? [7] 99.2% [13] 324100(76.2%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 make-exacts [21] 99.4% loop [25] 0.5% make-exacts* [28] 0.1% --------------------------------------------------------------------------------- run-iter! [10] 100.0% [14] 45051(10.6%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [22] 100.0% --------------------------------------------------------------------------------- run-iter! [10] 100.0% [15] 42697(10.0%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [23] 100.0% --------------------------------------------------------------------------------- run-iter! [10] 100.0% [16] 6208(1.5%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [73] 100.0% --------------------------------------------------------------------------------- get-final-combination [11] 100.0% [17] 4471(1.1%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f53 [129] 100.0% --------------------------------------------------------------------------------- run-iter! [10] 100.0% [18] 1729(0.4%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [73] 100.0% --------------------------------------------------------------------------------- run-iter! [10] 100.0% [19] 565(0.1%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [24] 100.0% --------------------------------------------------------------------------------- get-final-combination [11] 100.0% [20] 280(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [39] 100.0% --------------------------------------------------------------------------------- prepare-points [13] 100.0% [21] 322210(75.8%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [25] 99.9% make-exacts* [28] 0.1% --------------------------------------------------------------------------------- simplify! [14] 100.0% [22] 45051(10.6%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [27] 100.0% --------------------------------------------------------------------------------- gen-series! [15] 100.0% [23] 42697(10.0%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [26] 100.0% --------------------------------------------------------------------------------- localize! [19] 100.0% [24] 565(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [114] 100.0% --------------------------------------------------------------------------------- prepare-points [13] 0.5% make-exacts [21] 99.5% [25] 323542(76.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [136] 100.0% --------------------------------------------------------------------------------- errors [97] 0.4% atab-pick-alt [79] 0.5% loop [141] 0.9% f53 [129] 1.0% loop [136] 28.0% loop [30] 34.6% taylor-alt [23] 34.6% [26] 61724(14.5%) 285(0.1%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 loop [30] 34.6% approximate [31] 34.6% ->flonum [32] 22.1% real->bigfloat [33] 6.8% ??? [132] 0.5% best-alt [34] 0.5% table-ref [74] 0.5% --------------------------------------------------------------------------------- ??? [22] 100.0% [27] 45051(10.6%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [29] 100.0% --------------------------------------------------------------------------------- prepare-points [13] 49.0% make-exacts [21] 51.0% [28] 558(0.1%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [106] 100.0% --------------------------------------------------------------------------------- simplify [27] 100.0% [29] 45051(10.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [35] 93.9% loop [37] 5.5% mk-egraph [41] 0.6% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [26] 7.1% loop [30] 92.9% [30] 42697(10.0%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [30] 92.9% ...row-higher-order.rkt:375:33 [26] 7.1% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [26] 100.0% [31] 42697(10.0%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [36] 97.3% taylor [38] 2.7% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [26] 100.0% [32] 13654(3.2%) 5464(1.3%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 list-member? [117] 31.1% return/no-unsupplied [153] 26.4% ??? [40] 2.5% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [26] 100.0% [33] 4193(1.0%) 2103(0.5%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [137] 49.8% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [26] 100.0% [34] 278(0.1%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [39] 100.0% --------------------------------------------------------------------------------- ??? [29] 100.0% [35] 42301(10.0%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [42] 96.0% loop [136] 4.0% --------------------------------------------------------------------------------- approximate [31] 100.0% [36] 41542(9.8%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [114] 100.0% --------------------------------------------------------------------------------- ??? [29] 100.0% [37] 2470(0.6%) 273(0.1%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 loop [43] 56.3% mk-min [44] 32.7% --------------------------------------------------------------------------------- approximate [31] 35.0% taylor [38] 65.0% [38] 1154(0.3%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [38] 65.0% debug-print [134] 24.2% taylor-log [47] 3.8% taylor-invert [48] 3.6% debug [50] 3.4% --------------------------------------------------------------------------------- best-alt [34] 49.8% extract-alt [20] 50.2% [39] 559(0.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [45] 100.0% --------------------------------------------------------------------------------- ->flonum [32] 100.0% [40] 336(0.1%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 bigfloat->flonum [46] 100.0% --------------------------------------------------------------------------------- ??? [29] 100.0% [41] 280(0.1%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [49] 100.0% --------------------------------------------------------------------------------- iterate-egraph! [35] 100.0% [42] 40618(9.6%) 1088(0.3%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [51] 39.3% custom-set-member? [52] 21.9% merge-egraph-nodes! [53] 11.5% mk-enode! [58] 9.6% loop! [145] 6.8% substitute-e [55] 3.5% list-member? [117] 1.3% in-set [118] 0.7% filter [168] 0.7% reverse [164] 0.7% update-leader! [59] 0.7% pack-leader [174] 0.7% --------------------------------------------------------------------------------- loop [37] 100.0% [43] 1390(0.3%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [54] 100.0% --------------------------------------------------------------------------------- loop [37] 100.0% [44] 808(0.2%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [54] 100.0% --------------------------------------------------------------------------------- argmins [39] 100.0% [45] 559(0.1%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [97] 100.0% --------------------------------------------------------------------------------- ??? [40] 100.0% [46] 336(0.1%) 336(0.1%) bigfloat->flonum ...rivate/bigfloat/mpfr.rkt:480:0 --------------------------------------------------------------------------------- taylor [38] 100.0% [47] 308(0.1%) 0(0.0%) taylor-log ...lt-testing/src/core/taylor.rkt:476:0 simplify [120] 100.0% --------------------------------------------------------------------------------- taylor [38] 100.0% [48] 291(0.1%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 normalize-series [56] 100.0% --------------------------------------------------------------------------------- mk-egraph [41] 33.3% loop [136] 66.7% [49] 280(0.1%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [136] 100.0% --------------------------------------------------------------------------------- taylor [38] 100.0% [50] 276(0.1%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [57] 100.0% --------------------------------------------------------------------------------- match-e [51] 26.0% one-iter [42] 74.0% [51] 15960(3.8%) 4802(1.1%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [51] 26.0% reverse [164] 7.9% make-sequence [172] 7.8% list-cartesian-product [61] 6.1% ??? [73] 5.2% ??? [62] 5.2% loop [136] 5.2% pack-leader [174] 3.3% variable? [60] 2.8% in-set [118] 1.7% do-procedure-reduce-keyword-arity [65] 1.7% --------------------------------------------------------------------------------- one-iter [42] 100.0% [52] 8897(2.1%) 8897(2.1%) custom-set-member? ...t/private/set-types.rkt:45:0 --------------------------------------------------------------------------------- merge-egraph-nodes! [53] 5.9% one-iter [42] 94.1% [53] 4683(1.1%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [59] 79.4% loop! [145] 14.7% merge-egraph-nodes! [53] 5.9% --------------------------------------------------------------------------------- mk-min [44] 36.7% loop [43] 63.3% [54] 2198(0.5%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [74] 63.2% ...sting/src/common.rkt:47:2 [76] 24.0% compile [112] 12.8% --------------------------------------------------------------------------------- substitute-e [55] 13.6% one-iter [42] 86.4% [55] 1404(0.3%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [58] 79.7% substitute-e [55] 13.6% ??? [73] 6.8% --------------------------------------------------------------------------------- taylor-invert [48] 100.0% [56] 291(0.1%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 simplify [120] 100.0% --------------------------------------------------------------------------------- debug [50] 100.0% [57] 276(0.1%) 0(0.0%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 hash-ref! [114] 100.0% --------------------------------------------------------------------------------- loop [136] 5.3% substitute-e [55] 21.2% one-iter [42] 73.6% [58] 5288(1.2%) 272(0.1%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [63] 84.2% make-imperative-set [67] 5.3% hash-has-key? [78] 5.3% --------------------------------------------------------------------------------- one-iter [42] 6.8% merge-egraph-nodes! [53] 93.2% [59] 4133(1.0%) 838(0.2%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [64] 73.0% custom-set-union! [68] 6.7% --------------------------------------------------------------------------------- pattern-match [157] 19.8% match-e [51] 80.2% [60] 1459(0.3%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [73] 100.0% --------------------------------------------------------------------------------- list-cartesian-product [61] 37.8% match-e [51] 62.2% [61] 1121(0.3%) 1121(0.3%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [61] 37.8% --------------------------------------------------------------------------------- match-e [51] 100.0% [62] 1097(0.3%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [66] 75.2% do-procedure-reduce-keyword-arity [65] 24.8% --------------------------------------------------------------------------------- mk-enode! [58] 100.0% [63] 4455(1.0%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [69] 100.0% --------------------------------------------------------------------------------- update-leader! [59] 100.0% [64] 3019(0.7%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [70] 100.0% --------------------------------------------------------------------------------- ??? [62] 33.0% match-e [51] 67.0% [65] 826(0.2%) 546(0.1%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [71] 33.9% --------------------------------------------------------------------------------- ??? [62] 100.0% [66] 824(0.2%) 824(0.2%) do-curry ...cket/collects/racket/function.rkt:71:2 --------------------------------------------------------------------------------- mk-enode! [58] 100.0% [67] 282(0.1%) 282(0.1%) make-imperative-set ...private/set-types.rkt:954:0 --------------------------------------------------------------------------------- update-leader! [59] 100.0% [68] 276(0.1%) 276(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 --------------------------------------------------------------------------------- new-enode [63] 100.0% [69] 4455(1.0%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [72] 100.0% --------------------------------------------------------------------------------- do-hash-update [64] 100.0% [70] 3019(0.7%) 1938(0.5%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [166] 27.5% make-sequence [172] 8.3% --------------------------------------------------------------------------------- do-procedure-reduce-keyword-arity [65]100.0% [71] 280(0.1%) 280(0.1%) procedure-keywords .../racket/private/kw.rkt:534:2 --------------------------------------------------------------------------------- f53 [129] 29.2% type-of-enode-expr [69] 70.8% [72] 6294(1.5%) 282(0.1%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [74] 42.3% ??? [75] 26.7% ??? [73] 13.3% ...sting/src/common.rkt:47:2 [76] 13.3% --------------------------------------------------------------------------------- ??? [132] 1.4% substitute-e [55] 2.3% get-sigs [72] 6.7% variable? [60] 11.7% choose-best-alt! [18] 12.5% match-e [51] 15.7% finalize-iter! [16] 49.8% [73] 12472(2.9%) 846(0.2%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [77] 49.8% hash-has-key? [78] 28.7% atab-pick-alt [79] 12.5% ??? [132] 2.2% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [26] 6.4% expression-cost [54] 32.1% get-sigs [72] 61.5% [74] 4328(1.0%) 2392(0.6%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [84] 44.7% --------------------------------------------------------------------------------- get-sigs [72] 100.0% [75] 1679(0.4%) 276(0.1%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [81] 50.0% handle-the-hash [92] 16.9% get/build-late-neg-projection [82] 16.6% --------------------------------------------------------------------------------- simplify* [147] 16.8% expression-cost [54] 32.2% get-sigs [72] 50.9% [76] 1637(0.4%) 276(0.1%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [80] 83.2% --------------------------------------------------------------------------------- ??? [73] 100.0% [77] 6208(1.5%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [83] 100.0% --------------------------------------------------------------------------------- mk-enode! [58] 6.9% ??? [73] 93.1% [78] 4030(0.9%) 2852(0.7%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [84] 29.2% --------------------------------------------------------------------------------- ??? [73] 100.0% [79] 1729(0.4%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [85] 51.8% write-json* [89] 16.1% ...row-higher-order.rkt:375:33 [26] 16.1% errors [97] 15.9% --------------------------------------------------------------------------------- ??? [125] 30.4% ...sting/src/common.rkt:47:2 [76] 69.6% [80] 1362(0.3%) 841(0.2%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [125] 48.9% ??? [132] 9.9% --------------------------------------------------------------------------------- ??? [75] 100.0% [81] 839(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [86] 100.0% --------------------------------------------------------------------------------- ??? [88] 50.0% ??? [75] 50.0% [82] 280(0.1%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [88] 50.0% ??? [87] 50.0% --------------------------------------------------------------------------------- atab-add-altns [77] 100.0% [83] 6208(1.5%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [90] 91.0% override-at-pnts [93] 9.0% --------------------------------------------------------------------------------- hash-has-key? [78] 37.8% table-ref [74] 62.2% [84] 3114(0.7%) 834(0.2%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [91] 53.3% handle-the-hash [92] 19.9% --------------------------------------------------------------------------------- atab-pick-alt [79] 100.0% [85] 896(0.2%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [136] 100.0% --------------------------------------------------------------------------------- ??? [81] 100.0% [86] 839(0.2%) 556(0.1%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [94] 33.7% --------------------------------------------------------------------------------- get/build-late-neg-projection [82] 100.0% [87] 280(0.1%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [95] 100.0% --------------------------------------------------------------------------------- get/build-late-neg-projection [82] 100.0% [88] 280(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [82] 100.0% --------------------------------------------------------------------------------- atab-pick-alt [79] 100.0% [89] 279(0.1%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [96] 100.0% --------------------------------------------------------------------------------- atab-add-altn [83] 100.0% [90] 5650(1.3%) 280(0.1%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [97] 95.1% --------------------------------------------------------------------------------- ??? [84] 100.0% [91] 1661(0.4%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [98] 33.0% blame-add-missing-party [100] 16.9% update-the-info [102] 16.8% ??? [103] 16.8% loop [104] 16.6% --------------------------------------------------------------------------------- ??? [75] 31.5% ??? [84] 68.5% [92] 903(0.2%) 0(0.0%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [125] 100.0% --------------------------------------------------------------------------------- atab-add-altn [83] 100.0% [93] 558(0.1%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [97] 100.0% --------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [86] 100.0% [94] 282(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [99] 100.0% --------------------------------------------------------------------------------- ??? [87] 100.0% [95] 280(0.1%) 0(0.0%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [101] 100.0% --------------------------------------------------------------------------------- write-json* [89] 25.0% loop [96] 75.0% [96] 279(0.1%) 279(0.1%) loop .../share/racket/collects/json/main.rkt:132:2 loop [96] 75.0% --------------------------------------------------------------------------------- atab-pick-alt [79] 3.0% override-at-pnts [93] 6.2% composed [45] 6.2% loop [136] 25.4% best-and-tied-at-points [90] 59.3% [97] 9062(2.1%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [105] 59.3% eval-prog [106] 31.5% ulp-difference [107] 3.1% ...row-higher-order.rkt:375:33 [26] 3.1% flonums-between [108] 3.0% --------------------------------------------------------------------------------- ??? [91] 100.0% [98] 548(0.1%) 548(0.1%) make-keyword-procedure ...ket/private/kw.rkt:448:4 --------------------------------------------------------------------------------- ??? [94] 100.0% [99] 282(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 reverse [164] 100.0% --------------------------------------------------------------------------------- ??? [91] 100.0% [100] 280(0.1%) 280(0.1%) blame-add-missing-party ...private/blame.rkt:382:0 --------------------------------------------------------------------------------- build-compound-type-name [95] 100.0% [101] 280(0.1%) 280(0.1%) contract-struct-name ...ract/private/prop.rkt:98:0 --------------------------------------------------------------------------------- ??? [91] 100.0% [102] 279(0.1%) 279(0.1%) update-the-info ...ontract/private/blame.rkt:318:0 --------------------------------------------------------------------------------- ??? [91] 100.0% [103] 278(0.1%) 278(0.1%) ??? ...rivate/unconstrained-domain-arrow.rkt:19:10 --------------------------------------------------------------------------------- ??? [91] 25.0% loop [104] 75.0% [104] 276(0.1%) 276(0.1%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [104] 75.0% --------------------------------------------------------------------------------- generic-sort/key [173] 0.1% ??? [170] 0.1% copying-mergesort [175] 0.5% errors [97] 1.7% loop [136] 97.6% [105] 318884(75.0%) 141826(33.4%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [119] 40.4% bffmod [109] 9.3% ??? [138] 1.9% loop [136] 1.6% ??? [115] 1.5% ??? [110] 0.5% ??? [111] 0.3% --------------------------------------------------------------------------------- sindices->spoints [162] 7.5% make-exacts* [28] 15.1% errors [97] 77.4% [106] 3692(0.9%) 1956(0.5%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f53 [129] 16.7% parse-app [113] 15.2% compile [112] 15.1% --------------------------------------------------------------------------------- errors [97] 100.0% [107] 284(0.1%) 284(0.1%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 --------------------------------------------------------------------------------- errors [97] 100.0% [108] 276(0.1%) 276(0.1%) flonums-between ...te/flonum/flonum-bits.rkt:103:2 --------------------------------------------------------------------------------- ??? [105] 100.0% [109] 29559(7.0%) 0(0.0%) bffmod .../alt-testing/src/syntax/syntax.rkt:332:0 ??? [119] 58.5% ??? [115] 20.8% bf* [116] 20.7% --------------------------------------------------------------------------------- ??? [105] 100.0% [110] 1667(0.4%) 835(0.2%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [153] 16.7% list-member? [117] 16.7% in-set [118] 16.5% --------------------------------------------------------------------------------- ??? [105] 100.0% [111] 842(0.2%) 598(0.1%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [152] 28.9% --------------------------------------------------------------------------------- expression-cost [54] 33.5% eval-prog [106] 66.5% [112] 839(0.2%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [114] 100.0% --------------------------------------------------------------------------------- eval-prog [106] 100.0% [113] 562(0.1%) 562(0.1%) parse-app ...collects/racket/private/kw.rkt:1207:2 --------------------------------------------------------------------------------- simplify* [147] 0.4% localize-error [24] 0.5% cur-debug-level [57] 0.6% loop [136] 0.9% compile [112] 1.1% ??? [124] 5.3% ??? [123] 17.1% ??? [121] 22.9% ??? [36] 22.9% ??? [122] 25.4% [114] 43223(10.2%) 1412(0.3%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [122] 25.7% ??? [121] 22.9% simplify [120] 22.7% ??? [123] 17.1% ??? [124] 5.3% f53 [129] 1.3% bigfloat-hash [127] 0.9% --------------------------------------------------------------------------------- ??? [105] 43.0% bffmod [109] 57.0% [115] 10778(2.5%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [125] 71.3% ??? [132] 28.7% --------------------------------------------------------------------------------- bffmod [109] 100.0% [116] 6114(1.4%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [119] 100.0% --------------------------------------------------------------------------------- ??? [110] 5.5% one-iter [42] 10.5% ->flonum [32] 84.0% [117] 5057(1.2%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [126] 100.0% --------------------------------------------------------------------------------- ??? [110] 32.9% match-e [51] 33.4% one-iter [42] 33.8% [118] 836(0.2%) 836(0.2%) in-set ...ollects/racket/private/generic.rkt:472:9 --------------------------------------------------------------------------------- bf* [116] 4.0% bffmod [109] 11.4% ??? [105] 84.6% [119] 152318(35.8%) 49251(11.6%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [128] 52.4% bffloor [130] 7.5% bfsinh [131] 6.4% ^TYPE? [152] 1.4% --------------------------------------------------------------------------------- normalize-series [56] 0.7% taylor-log [47] 0.7% hash-ref! [114] 98.6% [120] 41858(9.8%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f53 [129] 98.6% debug-print [134] 1.4% --------------------------------------------------------------------------------- hash-ref! [114] 100.0% [121] 41542(9.8%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [114] 100.0% --------------------------------------------------------------------------------- hash-ref! [114] 100.0% [122] 34521(8.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [114] 99.2% --------------------------------------------------------------------------------- hash-ref! [114] 100.0% [123] 32820(7.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [114] 100.0% --------------------------------------------------------------------------------- hash-ref! [114] 100.0% [124] 16552(3.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:483:23 hash-ref! [114] 100.0% --------------------------------------------------------------------------------- handle-the-hash [92] 9.3% ??? [80] 11.2% ??? [115] 79.5% [125] 9672(2.3%) 3898(0.9%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [132] 38.6% ??? [133] 9.3% ??? [80] 8.6% check-list [167] 3.2% --------------------------------------------------------------------------------- list-member? [117] 100.0% [126] 5057(1.2%) 5057(1.2%) member ...collects/racket/private/member.rkt:13:21 --------------------------------------------------------------------------------- hash-ref! [114] 100.0% [127] 558(0.1%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [135] 100.0% --------------------------------------------------------------------------------- ??? [119] 100.0% [128] 79804(18.8%) 22250(5.2%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [137] 71.7% ??? [139] 0.4% --------------------------------------------------------------------------------- eval-prog [106] 0.2% expression->type [140] 0.8% mterm->expr [8] 0.8% hash-ref! [114] 1.2% split-table [17] 9.5% simplify [120] 26.8% loop [136] 60.7% [129] 46926(11.0%) 36836(8.7%) f53 ...t/collects/racket/match/compiler.rkt:548:40 loop [136] 73.4% expression->type [140] 0.8% get-sigs [72] 0.8% loop [141] 0.5% ...row-higher-order.rkt:375:33 [26] 0.2% --------------------------------------------------------------------------------- ??? [119] 100.0% [130] 11434(2.7%) 1814(0.4%) bffloor ...ib/math/private/bigfloat/mpfr.rkt:733:4 new-mpfr [137] 65.8% ??? [139] 18.3% --------------------------------------------------------------------------------- ??? [119] 100.0% [131] 9706(2.3%) 3868(0.9%) bfsinh ...lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [137] 56.8% ??? [139] 3.3% --------------------------------------------------------------------------------- ??? [80] 3.5% ??? [73] 3.6% ...row-higher-order.rkt:375:33 [26] 4.4% ??? [115] 40.1% ??? [125] 48.4% [132] 7710(1.8%) 864(0.2%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ^TYPE? [152] 80.8% ??? [73] 4.4% dict? [143] 3.6% --------------------------------------------------------------------------------- ??? [125] 100.0% [133] 903(0.2%) 339(0.1%) ??? ...ects/racket/contract/private/list.rkt:763:7 check-list [167] 31.5% ??? [138] 31.0% --------------------------------------------------------------------------------- taylor [38] 32.3% simplify [120] 67.7% [134] 864(0.2%) 864(0.2%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 --------------------------------------------------------------------------------- bigfloat-hash [127] 100.0% [135] 558(0.1%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [142] 100.0% --------------------------------------------------------------------------------- set-precompute! [148] 0.0% iterate-egraph! [35] 0.0% mk-enode-rec! [49] 0.0% option-on-expr [144] 0.1% loop! [145] 0.1% match-e [51] 0.1% point-best-alt [85] 0.2% ??? [105] 0.2% loop [25] 0.3% f53 [129] 5.8% loop [136] 93.1% [136] 375998(88.4%) 278(0.1%) loop .../private/map.rkt:40:19 loop [136] 93.1% f53 [129] 5.2% option-on-expr [144] 0.3% ??? [105] 0.2% errors [97] 0.2% ...row-higher-order.rkt:375:33 [26] 0.2% hash-ref! [114] 0.1% simplify* [147] 0.1% loop! [145] 0.1% step [149] 0.1% make-multiplication-node [2] 0.1% mk-enode-rec! [49] 0.0% set-precompute! [148] 0.0% ??? [150] 0.0% mk-enode! [58] 0.0% setfindf [151] 0.0% --------------------------------------------------------------------------------- real->bigfloat [33] 2.9% bfsinh [131] 7.6% bffloor [130] 10.4% bfsub [128] 79.1% [137] 72371(17.0%) 72371(17.0%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 --------------------------------------------------------------------------------- ??? [133] 4.4% ??? [105] 95.6% [138] 6426(1.5%) 3431(0.8%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [146] 46.6% --------------------------------------------------------------------------------- bfsub [128] 11.7% bfsinh [131] 11.8% bffloor [130] 76.6% [139] 2730(0.6%) 2730(0.6%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 --------------------------------------------------------------------------------- expression->type [140] 50.0% f53 [129] 50.0% [140] 1838(0.4%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 expression->type [140] 50.0% f53 [129] 50.0% --------------------------------------------------------------------------------- f53 [129] 0.7% loop [141] 99.3% [141] 565(0.1%) 0(0.0%) loop .../private/map.rkt:54:19 loop [141] 99.3% ...row-higher-order.rkt:375:33 [26] 0.7% --------------------------------------------------------------------------------- bfcanonicalize [135] 100.0% [142] 558(0.1%) 558(0.1%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 --------------------------------------------------------------------------------- ??? [132] 100.0% [143] 278(0.1%) 278(0.1%) dict? ...ollects/racket/private/generic.rkt:146:11 --------------------------------------------------------------------------------- loop [136] 100.0% [144] 4471(1.1%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [154] 43.7% loop [136] 37.6% pick-errors [160] 6.2% err-lsts->split-indices [161] 6.2% sindices->spoints [162] 6.2% --------------------------------------------------------------------------------- merge-egraph-nodes! [53] 19.3% loop [136] 35.8% one-iter [42] 44.9% [145] 3599(0.8%) 556(0.1%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [155] 42.6% loop [136] 35.8% make-immutable-set [156] 10.1% ??? [163] 3.9% --------------------------------------------------------------------------------- ??? [138] 100.0% [146] 2995(0.7%) 2476(0.6%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [159] 9.3% ^TYPE? [152] 8.0% --------------------------------------------------------------------------------- loop [136] 100.0% [147] 1684(0.4%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [114] 50.7% return/no-unsupplied [153] 32.9% ...sting/src/common.rkt:47:2 [76] 16.4% --------------------------------------------------------------------------------- loop [136] 100.0% [148] 1683(0.4%) 1117(0.3%) set-precompute! ...ing/src/core/simplify.rkt:193:0 simple-compose [158] 16.9% loop [136] 16.8% --------------------------------------------------------------------------------- loop [136] 100.0% [149] 834(0.2%) 558(0.1%) step .../racket/collects/racket/function.rkt:145:9 ??? [165] 33.0% --------------------------------------------------------------------------------- loop [136] 100.0% [150] 632(0.1%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 pattern-match [157] 100.0% --------------------------------------------------------------------------------- loop [136] 100.0% [151] 282(0.1%) 0(0.0%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 make-sequence [172] 100.0% --------------------------------------------------------------------------------- ??? [146] 2.7% ??? [111] 2.8% ??? [119] 24.0% ??? [132] 70.5% [152] 8834(2.1%) 8834(2.1%) ^TYPE? .../ffi/unsafe.rkt:1621:20 --------------------------------------------------------------------------------- ??? [110] 6.3% simplify* [147] 12.5% ->flonum [32] 81.2% [153] 4436(1.0%) 578(0.1%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 reverse [164] 80.7% filter [168] 6.3% --------------------------------------------------------------------------------- option-on-expr [144] 100.0% [154] 1954(0.5%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [165] 100.0% --------------------------------------------------------------------------------- loop! [145] 100.0% [155] 1952(0.5%) 1121(0.3%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [169] 28.5% check-list [167] 14.1% --------------------------------------------------------------------------------- loop! [145] 100.0% [156] 814(0.2%) 814(0.2%) make-immutable-set .../private/set-types.rkt:948:0 --------------------------------------------------------------------------------- pattern-match [157] 22.9% ??? [150] 77.1% [157] 632(0.1%) 342(0.1%) pattern-match ...testing/src/core/matcher.rkt:48:0 pattern-match [157] 22.9% variable? [60] 22.9% --------------------------------------------------------------------------------- set-precompute! [148] 100.0% [158] 284(0.1%) 284(0.1%) simple-compose ...s/racket/private/list.rkt:426:10 --------------------------------------------------------------------------------- ??? [146] 100.0% [159] 280(0.1%) 280(0.1%) ??? ...ects/racket/contract/private/list.rkt:163:5 --------------------------------------------------------------------------------- option-on-expr [144] 100.0% [160] 279(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [170] 100.0% --------------------------------------------------------------------------------- option-on-expr [144] 100.0% [161] 278(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [171] 100.0% --------------------------------------------------------------------------------- option-on-expr [144] 100.0% [162] 278(0.1%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 eval-prog [106] 100.0% --------------------------------------------------------------------------------- loop! [145] 100.0% [163] 278(0.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [166] 100.0% --------------------------------------------------------------------------------- one-iter [42] 5.0% ??? [99] 5.1% match-e [51] 25.3% return/no-unsupplied [153] 64.5% [164] 5546(1.3%) 5546(1.3%) reverse ...collects/racket/private/reverse.rkt:6:4 --------------------------------------------------------------------------------- step [149] 12.4% sort-context-on-expr [154] 87.6% [165] 2230(0.5%) 276(0.1%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [173] 87.6% --------------------------------------------------------------------------------- ??? [163] 25.1% ??? [70] 74.9% [166] 1107(0.3%) 552(0.1%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [174] 25.1% make-sequence [172] 25.1% --------------------------------------------------------------------------------- custom-set-union [155] 31.7% ??? [133] 32.8% ??? [125] 35.5% [167] 866(0.2%) 866(0.2%) check-list ...ollects/racket/private/for.rkt:690:2 --------------------------------------------------------------------------------- return/no-unsupplied [153] 49.8% one-iter [42] 50.2% [168] 560(0.1%) 560(0.1%) filter ...t/collects/racket/private/list.rkt:275:2 --------------------------------------------------------------------------------- custom-set-union [155] 100.0% [169] 557(0.1%) 557(0.1%) choose-immutable ...et/private/set-types.rkt:151:0 --------------------------------------------------------------------------------- pick-errors [160] 100.0% [170] 279(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [105] 100.0% --------------------------------------------------------------------------------- err-lsts->split-indices [161] 100.0% [171] 278(0.1%) 278(0.1%) ??? ...e/racket/collects/racket/function.rkt:93:12 --------------------------------------------------------------------------------- ??? [70] 11.4% update-en-expr [166] 12.7% setfindf [151] 12.9% match-e [51] 63.0% [172] 2194(0.5%) 1662(0.4%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [176] 24.2% --------------------------------------------------------------------------------- ??? [165] 100.0% [173] 1954(0.5%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [175] 85.7% ??? [105] 14.3% --------------------------------------------------------------------------------- one-iter [42] 25.3% update-en-expr [166] 25.6% match-e [51] 49.1% [174] 1086(0.3%) 1086(0.3%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 --------------------------------------------------------------------------------- generic-sort/key [173] 35.6% copying-mergesort [175] 64.4% [175] 1676(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [175] 64.4% ??? [105] 35.6% --------------------------------------------------------------------------------- make-sequence [172] 100.0% [176] 531(0.1%) 531(0.1%) :hash-gen ...collects/racket/private/for.rkt:781:4 ---------------------------------------------------------------------------------