Profiling results ----------------- Total cpu time observed: 174303ms (out of 174604ms) Number of samples taken: 541 (once every 322ms) (Hiding functions with self<1.0% and local<2.0%: 15 of 197 hidden) ===================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ===================================================================================== [1] 174303(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [4] 100.0% ------------------------------------------------------------------------------------- loop [151] 100.0% [2] 15404(8.8%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [151] 60.0% sort-context-on-expr [5] 30.9% pick-errors [6] 3.7% eval-prog [107] 1.8% err-lsts->split-indices [7] 1.8% sindices->spoints [8] 1.8% ------------------------------------------------------------------------------------- taylor [163] 100.0% [3] 282(0.2%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [140] 100.0% ------------------------------------------------------------------------------------- ??? [1] 100.0% [4] 174303(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [9] 100.0% ------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [5] 4760(2.7%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [10] 94.1% eval-prog [107] 5.9% ------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [6] 567(0.3%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [11] 100.0% ------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [7] 281(0.2%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [12] 100.0% ------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [8] 276(0.2%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 eval-prog [107] 100.0% ------------------------------------------------------------------------------------- profile-thunk [4] 100.0% [9] 174303(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [13] 100.0% ------------------------------------------------------------------------------------- sort-context-on-expr [5] 100.0% [10] 4480(2.6%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [14] 100.0% ------------------------------------------------------------------------------------- loop [151] 49.8% pick-errors [6] 50.2% [11] 1130(0.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [106] 100.0% ------------------------------------------------------------------------------------- err-lsts->split-indices [7] 100.0% [12] 281(0.2%) 281(0.2%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------- ??? [9] 100.0% [13] 174303(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [15] 71.0% prepare-points [21] 29.0% ------------------------------------------------------------------------------------- ??? [10] 100.0% [14] 4480(2.6%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [16] 93.7% ??? [106] 6.3% ------------------------------------------------------------------------------------- ??? [13] 100.0% [15] 123695(71.0%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [17] 85.4% get-final-combination [18] 13.1% setup-prog! [19] 1.2% ??? [69] 0.2% ------------------------------------------------------------------------------------- generic-sort/key [14] 34.5% copying-mergesort [16] 65.5% [16] 4200(2.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [16] 65.5% ??? [106] 34.5% ------------------------------------------------------------------------------------- run-improve [15] 100.0% [17] 105630(60.6%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [20] 52.8% gen-series! [22] 35.5% finalize-iter! [24] 8.7% choose-best-alt! [25] 2.1% localize! [27] 0.5% gen-rewrites! [28] 0.3% ------------------------------------------------------------------------------------- run-improve [15] 100.0% [18] 16244(9.3%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [23] 96.5% extract-alt [26] 3.5% ------------------------------------------------------------------------------------- run-improve [15] 100.0% [19] 1543(0.9%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [21] 100.0% ------------------------------------------------------------------------------------- run-iter! [17] 100.0% [20] 55808(32.0%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [29] 99.5% debug-print [171] 0.5% ------------------------------------------------------------------------------------- setup-prog! [19] 3.0% ??? [13] 97.0% [21] 52151(29.9%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [35] 66.4% make-exacts [31] 33.6% ------------------------------------------------------------------------------------- run-iter! [17] 100.0% [22] 37543(21.5%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [30] 100.0% ------------------------------------------------------------------------------------- get-final-combination [18] 100.0% [23] 15683(9.0%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f53 [146] 100.0% ------------------------------------------------------------------------------------- run-iter! [17] 100.0% [24] 9210(5.3%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [69] 100.0% ------------------------------------------------------------------------------------- run-iter! [17] 100.0% [25] 2228(1.3%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [69] 100.0% ------------------------------------------------------------------------------------- get-final-combination [18] 100.0% [26] 561(0.3%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [93] 100.0% ------------------------------------------------------------------------------------- run-iter! [17] 100.0% [27] 558(0.3%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [32] 100.0% ------------------------------------------------------------------------------------- run-iter! [17] 100.0% [28] 283(0.2%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [33] 100.0% ------------------------------------------------------------------------------------- simplify! [20] 100.0% [29] 55529(31.9%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [34] 100.0% ------------------------------------------------------------------------------------- gen-series! [22] 100.0% [30] 37543(21.5%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [75] 100.0% ------------------------------------------------------------------------------------- prepare-points [21] 100.0% [31] 17512(10.0%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [35] 93.6% make-exacts* [36] 6.4% ------------------------------------------------------------------------------------- localize! [27] 100.0% [32] 558(0.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [123] 100.0% ------------------------------------------------------------------------------------- gen-rewrites! [28] 100.0% [33] 283(0.2%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [37] 100.0% ------------------------------------------------------------------------------------- ??? [29] 100.0% [34] 55529(31.9%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [38] 99.5% *simplify-rules* [39] 0.5% ------------------------------------------------------------------------------------- make-exacts [31] 32.1% prepare-points [21] 67.9% [35] 51034(29.3%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [151] 100.0% ------------------------------------------------------------------------------------- make-exacts [31] 100.0% [36] 1118(0.6%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [107] 100.0% ------------------------------------------------------------------------------------- matcher [40] 50.0% alt-rewrite-rm [33] 50.0% [37] 283(0.2%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [40] 50.0% f53 [146] 50.0% ------------------------------------------------------------------------------------- simplify [34] 100.0% [38] 55244(31.7%) 281(0.2%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [41] 89.8% loop [42] 8.7% mk-egraph [43] 1.0% ------------------------------------------------------------------------------------- simplify [34] 100.0% [39] 285(0.2%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [44] 100.0% ------------------------------------------------------------------------------------- matcher [40] 50.0% rewriter [37] 50.0% [40] 283(0.2%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [40] 50.0% rewriter [37] 50.0% ------------------------------------------------------------------------------------- ??? [38] 100.0% [41] 49608(28.5%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [45] 97.8% loop [151] 2.2% ------------------------------------------------------------------------------------- ??? [38] 100.0% [42] 4780(2.7%) 283(0.2%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [83] 53.0% loop [46] 41.1% ------------------------------------------------------------------------------------- ??? [38] 100.0% [43] 574(0.3%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [47] 100.0% ------------------------------------------------------------------------------------- *simplify-rules* [39] 100.0% [44] 285(0.2%) 285(0.2%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ------------------------------------------------------------------------------------- iterate-egraph! [41] 100.0% [45] 48492(27.8%) 2260(1.3%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [48] 45.6% substitute-e [49] 10.4% custom-set-member? [50] 10.4% mk-enode! [53] 10.4% merge-egraph-nodes! [51] 8.7% loop! [159] 3.5% list-member? [52] 2.3% set-member? [128] 1.2% update-leader! [55] 1.1% reverse [68] 0.6% filter [138] 0.6% ------------------------------------------------------------------------------------- loop [42] 100.0% [46] 1962(1.1%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [91] 100.0% ------------------------------------------------------------------------------------- mk-egraph [43] 29.1% loop [151] 70.9% [47] 574(0.3%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [151] 100.0% ------------------------------------------------------------------------------------- match-e [48] 30.3% one-iter [45] 69.7% [48] 22096(12.7%) 4769(2.7%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [48] 30.3% reverse [68] 7.7% variable? [54] 6.5% ??? [69] 6.1% ??? [153] 5.1% loop [151] 5.1% make-sequence [182] 5.1% list-cartesian-product [56] 4.4% make-curried [58] 3.8% ??? [59] 2.5% do-procedure-reduce-keyword-arity [160] 1.9% set-member? [128] 1.3% custom-in-set [173] 1.2% filter [138] 0.6% ------------------------------------------------------------------------------------- substitute-e [49] 15.8% one-iter [45] 84.2% [49] 5054(2.9%) 567(0.3%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [53] 66.5% substitute-e [49] 15.8% variable? [54] 6.5% ??? [69] 2.8% ------------------------------------------------------------------------------------- one-iter [45] 100.0% [50] 5050(2.9%) 5050(2.9%) custom-set-member? ...t/private/set-types.rkt:45:0 ------------------------------------------------------------------------------------- merge-egraph-nodes! [51] 10.0% one-iter [45] 90.0% [51] 4196(2.4%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [55] 69.8% loop! [159] 13.4% merge-egraph-nodes! [51] 10.0% enode-merge! [60] 6.8% ------------------------------------------------------------------------------------- one-iter [45] 100.0% [52] 1132(0.6%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [57] 100.0% ------------------------------------------------------------------------------------- loop [151] 6.4% substitute-e [49] 37.5% one-iter [45] 56.1% [53] 8968(5.1%) 1116(0.6%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [61] 81.4% hash-has-key? [71] 6.1% ------------------------------------------------------------------------------------- substitute-e [49] 19.0% match-e [48] 81.0% [54] 4452(2.6%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [69] 100.0% ------------------------------------------------------------------------------------- one-iter [45] 15.2% merge-egraph-nodes! [51] 84.8% [55] 3623(2.1%) 1126(0.6%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [62] 68.9% ------------------------------------------------------------------------------------- list-cartesian-product [56] 29.7% match-e [48] 70.3% [56] 1394(0.8%) 1112(0.6%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [56] 29.7% reverse [68] 20.2% ------------------------------------------------------------------------------------- list-member? [52] 100.0% [57] 1132(0.6%) 1132(0.6%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------- match-e [48] 100.0% [58] 850(0.5%) 568(0.3%) make-curried ...collects/racket/function.rkt:130:9 partially-applied-procedure-arity-mask [64] 33.2% ------------------------------------------------------------------------------------- match-e [48] 100.0% [59] 560(0.3%) 560(0.3%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 ------------------------------------------------------------------------------------- merge-egraph-nodes! [51] 100.0% [60] 285(0.2%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [63] 100.0% ------------------------------------------------------------------------------------- mk-enode! [53] 100.0% [61] 7304(4.2%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [65] 100.0% ------------------------------------------------------------------------------------- update-leader! [55] 100.0% [62] 2498(1.4%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [66] 100.0% ------------------------------------------------------------------------------------- enode-merge! [60] 100.0% [63] 285(0.2%) 285(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------- make-curried [58] 100.0% [64] 282(0.2%) 282(0.2%) partially-applied-procedure-arity-mask ...rkt:58:2 ------------------------------------------------------------------------------------- new-enode [61] 100.0% [65] 7304(4.2%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [67] 96.1% f53 [146] 3.9% ------------------------------------------------------------------------------------- do-hash-update [62] 100.0% [66] 2498(1.4%) 1132(0.6%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [180] 44.0% reverse [68] 10.7% ------------------------------------------------------------------------------------- f53 [146] 3.9% type-of-enode-expr [65] 96.1% [67] 7305(4.2%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [70] 42.4% table-ref [95] 42.3% ...sting/src/common.rkt:47:2 [126] 7.8% hash-has-key? [71] 3.8% ??? [69] 3.8% ------------------------------------------------------------------------------------- ??? [66] 9.5% list-cartesian-product [56] 10.0% one-iter [45] 10.2% match-e [48] 70.2% [68] 2801(1.6%) 2801(1.6%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------- get-sigs [67] 1.3% run-improve [15] 1.4% substitute-e [49] 1.4% ??? [147] 5.5% choose-best-alt! [25] 10.9% match-e [48] 13.7% variable? [54] 21.9% finalize-iter! [24] 43.8% [69] 20361(11.7%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [72] 45.2% hash-has-key? [71] 42.5% atab-pick-alt [73] 10.9% ??? [147] 1.4% ------------------------------------------------------------------------------------- get-sigs [67] 100.0% [70] 3094(1.8%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [74] 63.4% handle-the-hash [109] 27.5% get/build-late-neg-projection [99] 9.1% ------------------------------------------------------------------------------------- get-sigs [67] 2.9% mk-enode! [53] 5.6% ??? [69] 91.5% [71] 9756(5.6%) 8070(4.6%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [102] 17.3% ------------------------------------------------------------------------------------- ??? [69] 100.0% [72] 9488(5.4%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [76] 100.0% ------------------------------------------------------------------------------------- ??? [69] 100.0% [73] 2228(1.3%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [78] 62.5% ??? [75] 37.5% ------------------------------------------------------------------------------------- ??? [70] 100.0% [74] 1962(1.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [77] 100.0% ------------------------------------------------------------------------------------- all-critical-subexpressions [170] 0.5% atab-pick-alt [73] 1.6% errors [101] 1.6% f53 [146] 3.2% loop [151] 21.1% loop [79] 35.7% taylor-alt [30] 35.7% [75] 52578(30.2%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:375:33 loop [79] 35.7% approximate [80] 35.7% ->flonum [81] 16.5% real->bigfloat [84] 4.4% ??? [147] 2.7% best-alt [85] 1.6% ??? [148] 0.6% table-ref [95] 0.5% f53 [146] 0.5% ------------------------------------------------------------------------------------- atab-add-altns [72] 100.0% [76] 9488(5.4%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [82] 88.3% override-at-pnts [86] 8.8% remove-chnged-pnts [89] 2.9% ------------------------------------------------------------------------------------- ??? [74] 100.0% [77] 1962(1.1%) 1128(0.6%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [87] 28.0% ??? [88] 14.5% ------------------------------------------------------------------------------------- atab-pick-alt [73] 100.0% [78] 1392(0.8%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [151] 79.7% mk-min [83] 20.3% ------------------------------------------------------------------------------------- ??? [75] 13.6% loop [79] 86.4% [79] 37543(21.5%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [79] 86.4% ??? [75] 13.6% ------------------------------------------------------------------------------------- ??? [75] 100.0% [80] 37543(21.5%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [90] 98.5% taylor [163] 1.5% ------------------------------------------------------------------------------------- ??? [75] 100.0% [81] 8702(5.0%) 4060(2.3%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 ??? [92] 28.8% ...sting/src/common.rkt:47:2 [126] 9.8% ^TYPE? [158] 7.8% set-member? [128] 3.7% return/no-unsupplied [129] 3.1% ------------------------------------------------------------------------------------- atab-add-altn [76] 100.0% [82] 8375(4.8%) 280(0.2%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [101] 96.7% ------------------------------------------------------------------------------------- point-best-alt [78] 10.0% loop [42] 90.0% [83] 2817(1.6%) 282(0.2%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [91] 90.0% ------------------------------------------------------------------------------------- ??? [75] 100.0% [84] 2318(1.3%) 1430(0.8%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [133] 38.3% ------------------------------------------------------------------------------------- ??? [75] 100.0% [85] 836(0.5%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [93] 100.0% ------------------------------------------------------------------------------------- atab-add-altn [76] 100.0% [86] 834(0.5%) 275(0.2%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [101] 67.0% ------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [77] 100.0% [87] 550(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [94] 100.0% ------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [77] 100.0% [88] 284(0.2%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:44 do-blame-add-context [98] 100.0% ------------------------------------------------------------------------------------- atab-add-altn [76] 100.0% [89] 278(0.2%) 0(0.0%) remove-chnged-pnts ...src/core/alt-table.rkt:167:0 loop [151] 100.0% ------------------------------------------------------------------------------------- approximate [80] 100.0% [90] 36977(21.2%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [123] 100.0% ------------------------------------------------------------------------------------- loop [46] 43.6% mk-min [83] 56.4% [91] 4498(2.6%) 283(0.2%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [95] 56.2% ...sting/src/common.rkt:47:2 [126] 25.2% second [100] 6.2% compile [117] 6.2% ------------------------------------------------------------------------------------- ->flonum [81] 100.0% [92] 2510(1.4%) 1510(0.9%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 ??? [97] 39.8% ------------------------------------------------------------------------------------- extract-alt [26] 40.1% best-alt [85] 59.9% [93] 1398(0.8%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [96] 100.0% ------------------------------------------------------------------------------------- ??? [87] 100.0% [94] 550(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 do-blame-add-context [98] 51.2% get/build-late-neg-projection [99] 48.8% ------------------------------------------------------------------------------------- ??? [75] 4.8% expression-cost [91] 42.8% get-sigs [67] 52.4% [95] 5898(3.4%) 1690(1.0%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [102] 57.2% set-member? [128] 4.7% ...sting/src/common.rkt:47:2 [126] 4.7% dict? [154] 4.7% ------------------------------------------------------------------------------------- argmins [93] 100.0% [96] 1398(0.8%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [101] 100.0% ------------------------------------------------------------------------------------- ??? [92] 100.0% [97] 1000(0.6%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [103] 100.0% ------------------------------------------------------------------------------------- ??? [94] 49.8% ??? [88] 50.2% [98] 565(0.3%) 565(0.3%) do-blame-add-context ...ct/private/blame.rkt:192:0 ------------------------------------------------------------------------------------- ??? [105] 25.6% ??? [70] 25.6% ??? [94] 48.9% [99] 548(0.3%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [104] 74.4% ??? [105] 25.6% ------------------------------------------------------------------------------------- expression-cost [91] 100.0% [100] 280(0.2%) 280(0.2%) second ...are/racket/collects/racket/list.rkt:85:0 ------------------------------------------------------------------------------------- override-at-pnts [86] 2.8% composed [96] 7.0% best-and-tied-at-points [82] 40.8% loop [151] 49.3% [101] 19836(11.4%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [106] 66.1% eval-prog [107] 25.4% ulp-difference [110] 4.3% ??? [75] 4.2% ------------------------------------------------------------------------------------- hash-has-key? [71] 33.3% table-ref [95] 66.7% [102] 5060(2.9%) 2248(1.3%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [108] 33.3% handle-the-hash [109] 5.7% ??? [150] 5.6% do-chaperone-procedure [112] 5.5% check-list [143] 5.5% ------------------------------------------------------------------------------------- ??? [97] 100.0% [103] 1000(0.6%) 1000(0.6%) assq ...et/collects/racket/private/list.rkt:187:13 ------------------------------------------------------------------------------------- get/build-late-neg-projection [99] 100.0% [104] 548(0.3%) 268(0.2%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [111] 51.1% ------------------------------------------------------------------------------------- get/build-late-neg-projection [99] 100.0% [105] 280(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [99] 100.0% ------------------------------------------------------------------------------------- generic-sort/key [14] 0.4% ??? [11] 1.8% copying-mergesort [16] 6.7% errors [101] 20.8% loop [151] 70.3% [106] 62980(36.1%) 27988(16.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [113] 21.9% ??? [148] 7.3% loop [151] 6.9% ??? [125] 5.7% ??? [114] 4.4% ??? [115] 3.4% ??? [116] 2.3% ??? [118] 1.8% ------------------------------------------------------------------------------------- sindices->spoints [8] 3.9% sort-context-on-expr [5] 4.0% option-on-expr [2] 4.0% make-exacts* [36] 16.0% errors [101] 72.0% [107] 6992(4.0%) 4182(2.4%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f53 [146] 24.2% compile [117] 16.0% ------------------------------------------------------------------------------------- ??? [102] 100.0% [108] 1684(1.0%) 1122(0.6%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 blame-add-missing-party [119] 16.8% loop [121] 16.6% ------------------------------------------------------------------------------------- ??? [102] 25.4% ??? [70] 74.6% [109] 1142(0.7%) 857(0.5%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [135] 25.0% ------------------------------------------------------------------------------------- errors [101] 100.0% [110] 849(0.5%) 566(0.3%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [129] 33.3% ------------------------------------------------------------------------------------- ??? [104] 100.0% [111] 280(0.2%) 0(0.0%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [120] 100.0% ------------------------------------------------------------------------------------- ??? [102] 100.0% [112] 278(0.2%) 0(0.0%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [122] 100.0% ------------------------------------------------------------------------------------- ??? [106] 100.0% [113] 13777(7.9%) 2319(1.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [124] 70.6% bftan [127] 12.5% ------------------------------------------------------------------------------------- ??? [106] 100.0% [114] 2786(1.6%) 1954(1.1%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ...sting/src/common.rkt:47:2 [126] 10.2% return/no-unsupplied [129] 10.0% set-member? [128] 9.7% ------------------------------------------------------------------------------------- ??? [106] 100.0% [115] 2148(1.2%) 1818(1.0%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [158] 15.3% ------------------------------------------------------------------------------------- ??? [106] 100.0% [116] 1444(0.8%) 1444(0.8%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------- expression-cost [91] 19.9% eval-prog [107] 80.1% [117] 1394(0.8%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [123] 100.0% ------------------------------------------------------------------------------------- ??? [106] 100.0% [118] 1116(0.6%) 0(0.0%) ??? ...bie/alt-testing/src/syntax/syntax.rkt:530:0 ??? [125] 100.0% ------------------------------------------------------------------------------------- ??? [108] 100.0% [119] 282(0.2%) 282(0.2%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------- build-compound-type-name [111] 100.0% [120] 280(0.2%) 280(0.2%) contract-struct-name ...ract/private/prop.rkt:98:0 ------------------------------------------------------------------------------------- loop [121] 50.0% ??? [108] 50.0% [121] 280(0.2%) 280(0.2%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [121] 50.0% ------------------------------------------------------------------------------------- do-chaperone-procedure [112] 100.0% [122] 278(0.2%) 278(0.2%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 ------------------------------------------------------------------------------------- ??? [144] 0.3% localize-error [32] 0.6% loop [151] 1.6% compile [117] 2.0% ??? [134] 2.9% ??? [132] 13.4% ??? [131] 22.5% ??? [130] 26.6% ??? [90] 27.3% [123] 38930(22.3%) 1406(0.8%) hash-ref! .../racket/private/more-scheme.rkt:377:2 simplify [140] 26.8% ??? [130] 26.6% ??? [131] 22.8% ??? [132] 13.4% ??? [134] 3.2% bigfloat-hash [137] 1.8% f53 [146] 1.4% ------------------------------------------------------------------------------------- ??? [113] 100.0% [124] 9730(5.6%) 4918(2.8%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [133] 34.8% ??? [136] 14.7% ------------------------------------------------------------------------------------- ??? [118] 23.6% ??? [106] 76.4% [125] 4736(2.7%) 1500(0.9%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [147] 44.5% ??? [135] 23.8% ------------------------------------------------------------------------------------- ??? [139] 4.6% table-ref [95] 8.9% ??? [114] 9.1% get-sigs [67] 13.6% ->flonum [81] 27.4% expression-cost [91] 36.3% [126] 3114(1.8%) 845(0.5%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [141] 36.4% ??? [147] 22.9% ??? [139] 13.6% ------------------------------------------------------------------------------------- ??? [113] 100.0% [127] 1728(1.0%) 1180(0.7%) bftan ...-lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [133] 31.7% ------------------------------------------------------------------------------------- ??? [114] 15.6% table-ref [95] 16.2% match-e [48] 16.4% ->flonum [81] 18.8% one-iter [45] 33.0% [128] 1722(1.0%) 1722(1.0%) set-member? ...ts/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------- ->flonum [81] 32.7% ??? [114] 33.5% ulp-difference [110] 33.8% [129] 836(0.5%) 554(0.3%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [138] 33.8% ------------------------------------------------------------------------------------- hash-ref! [123] 100.0% [130] 36684(21.0%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [123] 100.0% ------------------------------------------------------------------------------------- hash-ref! [123] 100.0% [131] 28468(16.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [123] 99.0% simplify [140] 1.0% ------------------------------------------------------------------------------------- hash-ref! [123] 100.0% [132] 23387(13.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [123] 100.0% ------------------------------------------------------------------------------------- bftan [127] 11.4% real->bigfloat [84] 18.4% bfsub [124] 70.2% [133] 4820(2.8%) 4820(2.8%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------- hash-ref! [123] 100.0% [134] 4787(2.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [123] 88.2% ??? [144] 11.8% ------------------------------------------------------------------------------------- handle-the-hash [109] 14.4% ??? [141] 28.6% ??? [125] 57.0% [135] 1979(1.1%) 0(0.0%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [147] 38.1% ??? [141] 28.6% check-list [143] 18.9% ??? [145] 14.4% ------------------------------------------------------------------------------------- bfsub [124] 100.0% [136] 1428(0.8%) 1428(0.8%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ------------------------------------------------------------------------------------- hash-ref! [123] 100.0% [137] 1118(0.6%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [142] 100.0% ------------------------------------------------------------------------------------- match-e [48] 33.0% return/no-unsupplied [129] 33.4% one-iter [45] 33.6% [138] 847(0.5%) 847(0.5%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [126] 100.0% [139] 564(0.3%) 280(0.2%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 ...sting/src/common.rkt:47:2 [126] 50.3% ------------------------------------------------------------------------------------- taylor-invert [3] 0.8% ??? [131] 0.8% hash-ref! [123] 97.0% [140] 37258(21.4%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f53 [146] 92.4% debug-print [171] 6.9% ------------------------------------------------------------------------------------- ??? [135] 25.0% ...sting/src/common.rkt:47:2 [126] 75.0% [141] 1134(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [150] 50.0% ??? [135] 25.0% ??? [147] 25.0% ------------------------------------------------------------------------------------- bigfloat-hash [137] 100.0% [142] 1118(0.6%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [149] 100.0% ------------------------------------------------------------------------------------- ??? [102] 42.6% ??? [135] 57.4% [143] 652(0.4%) 652(0.4%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------- ??? [134] 100.0% [144] 565(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [123] 100.0% ------------------------------------------------------------------------------------- ??? [135] 100.0% [145] 285(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [148] 100.0% ------------------------------------------------------------------------------------- ??? [75] 0.1% type-of-enode-expr [65] 0.5% rewriter [37] 0.5% eval-prog [107] 0.9% hash-ref! [123] 1.1% simplify [140] 25.9% split-table [23] 28.4% loop [151] 42.6% [146] 52070(29.9%) 31028(17.8%) f53 ...t/collects/racket/match/compiler.rkt:548:40 loop [151] 73.4% ??? [75] 0.9% get-sigs [67] 0.5% parse-app [155] 0.4% exprs-to-branch-on [157] 0.1% ??? [153] 0.1% ------------------------------------------------------------------------------------- ??? [69] 4.7% ??? [141] 9.5% ??? [135] 12.6% ...sting/src/common.rkt:47:2 [126] 14.3% ??? [75] 23.6% ??? [125] 35.3% [147] 5980(3.4%) 2686(1.5%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ??? [69] 23.6% dict? [154] 19.0% ^TYPE? [158] 12.4% ------------------------------------------------------------------------------------- ??? [145] 5.5% ??? [75] 6.1% ??? [106] 88.5% [148] 5220(3.0%) 1130(0.6%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [152] 78.4% ------------------------------------------------------------------------------------- bfcanonicalize [142] 100.0% [149] 1118(0.6%) 1118(0.6%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------- ??? [102] 33.2% ??? [141] 66.8% [150] 849(0.5%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [156] 100.0% ------------------------------------------------------------------------------------- iterate-egraph! [41] 0.0% remove-chnged-pnts [89] 0.1% loop [35] 0.1% taylor [163] 0.2% ??? [106] 0.3% mk-enode-rec! [47] 0.3% loop! [159] 0.4% point-best-alt [78] 0.6% option-on-expr [2] 0.7% match-e [48] 0.8% f53 [146] 17.8% loop [151] 78.0% [151] 105636(60.6%) 840(0.5%) loop .../private/map.rkt:40:19 loop [151] 78.0% f53 [146] 15.8% option-on-expr [2] 1.4% errors [101] 1.3% hash-ref! [123] 0.7% loop! [159] 0.4% ??? [75] 0.3% mk-enode-rec! [47] 0.2% taylor [163] 0.2% ??? [106] 0.1% mk-enode! [53] 0.1% rloop [169] 0.1% ??? [168] 0.0% setfindf [164] 0.0% ??? [11] 0.0% ------------------------------------------------------------------------------------- ??? [148] 100.0% [152] 4091(2.3%) 2784(1.6%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ^TYPE? [158] 31.9% ------------------------------------------------------------------------------------- f53 [146] 14.2% match-e [48] 85.8% [153] 1965(1.1%) 278(0.2%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [160] 43.2% do-curry [161] 42.6% ------------------------------------------------------------------------------------- table-ref [95] 19.6% ??? [147] 80.4% [154] 1416(0.8%) 1132(0.6%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [166] 20.1% ------------------------------------------------------------------------------------- f53 [146] 100.0% [155] 850(0.5%) 280(0.2%) parse-app ...collects/racket/private/kw.rkt:1207:2 ??? [165] 33.9% identifier? [167] 33.2% ------------------------------------------------------------------------------------- ??? [150] 100.0% [156] 849(0.5%) 282(0.2%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [162] 66.8% ------------------------------------------------------------------------------------- f53 [146] 100.0% [157] 278(0.2%) 0(0.0%) exprs-to-branch-on ...ng/src/core/regimes.rkt:42:0 all-critical-subexpressions [170] 100.0% ------------------------------------------------------------------------------------- ??? [115] 10.8% ->flonum [81] 22.2% ??? [147] 24.3% ??? [152] 42.7% [158] 3058(1.8%) 3058(1.8%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------- merge-egraph-nodes! [51] 22.1% loop [151] 33.4% one-iter [45] 44.5% [159] 2536(1.5%) 569(0.3%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 loop [151] 33.4% make-immutable-set [172] 27.7% custom-set-union [175] 22.1% ??? [178] 5.5% ------------------------------------------------------------------------------------- match-e [48] 39.8% ??? [153] 60.2% [160] 1411(0.8%) 1411(0.8%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 ------------------------------------------------------------------------------------- ??? [153] 100.0% [161] 837(0.5%) 280(0.2%) do-curry ...cket/collects/racket/function.rkt:71:2 make-keyword-procedure [177] 33.5% procedure-keywords [179] 33.2% ------------------------------------------------------------------------------------- check-hash/c [156] 100.0% [162] 567(0.3%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [174] 100.0% ------------------------------------------------------------------------------------- loop [151] 14.4% approximate [80] 19.6% taylor [163] 66.0% [163] 566(0.3%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [163] 66.0% loop [151] 14.4% taylor-invert [3] 12.4% debug-print [171] 7.2% ------------------------------------------------------------------------------------- loop [151] 100.0% [164] 552(0.3%) 266(0.2%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 custom-in-set [173] 51.7% ------------------------------------------------------------------------------------- parse-app [155] 100.0% [165] 288(0.2%) 288(0.2%) ??? ...cket/collects/racket/private/kw.rkt:1212:27 ------------------------------------------------------------------------------------- dict? [154] 100.0% [166] 284(0.2%) 284(0.2%) assoc? ...et/collects/racket/private/dict.rkt:13:0 ------------------------------------------------------------------------------------- parse-app [155] 100.0% [167] 282(0.2%) 282(0.2%) identifier? ...ollects/racket/private/stx.rkt:13:4 ------------------------------------------------------------------------------------- loop [151] 100.0% [168] 281(0.2%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 pattern-match [176] 100.0% ------------------------------------------------------------------------------------- loop [151] 0.9% rloop [169] 99.1% [169] 278(0.2%) 278(0.2%) rloop ...ket/collects/racket/private/list.rkt:88:4 rloop [169] 99.1% ------------------------------------------------------------------------------------- exprs-to-branch-on [157] 100.0% [170] 278(0.2%) 0(0.0%) all-critical-subexpressions ...re/regimes.rkt:58:0 ??? [75] 100.0% ------------------------------------------------------------------------------------- simplify! [20] 8.9% taylor [163] 9.1% simplify [140] 82.0% [171] 3124(1.8%) 2845(1.6%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 write-proc [181] 8.9% ------------------------------------------------------------------------------------- loop! [159] 100.0% [172] 1127(0.6%) 1127(0.6%) make-immutable-set .../private/set-types.rkt:948:0 ------------------------------------------------------------------------------------- setfindf [164] 34.2% match-e [48] 65.8% [173] 834(0.5%) 834(0.5%) custom-in-set ...acket/private/set-types.rkt:580:0 ------------------------------------------------------------------------------------- flat-contract? [162] 100.0% [174] 567(0.3%) 567(0.3%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------- loop! [159] 100.0% [175] 562(0.3%) 562(0.3%) custom-set-union ...et/private/set-types.rkt:168:0 ------------------------------------------------------------------------------------- ??? [168] 100.0% [176] 281(0.2%) 281(0.2%) pattern-match ...testing/src/core/matcher.rkt:48:0 ------------------------------------------------------------------------------------- do-curry [161] 100.0% [177] 280(0.2%) 280(0.2%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------- loop! [159] 100.0% [178] 278(0.2%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [180] 100.0% ------------------------------------------------------------------------------------- do-curry [161] 100.0% [179] 278(0.2%) 278(0.2%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------- ??? [178] 20.2% ??? [66] 79.8% [180] 1376(0.8%) 1099(0.6%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [182] 20.1% ------------------------------------------------------------------------------------- debug-print [171] 100.0% [181] 278(0.2%) 278(0.2%) write-proc ...alt-testing/src/alternative.rkt:22:9 ------------------------------------------------------------------------------------- update-en-expr [180] 16.5% match-e [48] 83.5% [182] 1678(1.0%) 1678(1.0%) make-sequence ...ects/racket/private/for.rkt:557:2 -------------------------------------------------------------------------------------