Profiling results ----------------- Total cpu time observed: 490216ms (out of 490434ms) Number of samples taken: 1733 (once every 283ms) (Hiding functions with self<1.0% and local<2.0%: 18 of 265 hidden) =========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================================== [1] 490216(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [9] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [183] 100.0% [2] 112468(22.9%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 ??? [10] 96.7% hash-ref! [183] 2.5% simplify [160] 0.7% ------------------------------------------------------------------------------------------- hash-ref! [183] 100.0% [3] 110183(22.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 ??? [10] 75.4% hash-ref! [183] 23.3% simplify [160] 1.3% ------------------------------------------------------------------------------------------- loop [199] 100.0% [4] 94268(19.2%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [11] 84.9% loop [199] 5.6% err-lsts->split-indices [12] 5.3% sort-context-on-expr [13] 3.9% pick-errors [15] 0.3% ------------------------------------------------------------------------------------------- hash-ref! [183] 100.0% [5] 19311(3.9%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [141] 93.3% hash-ref! [183] 6.7% ------------------------------------------------------------------------------------------- gather-additive-terms [206] 33.5% loop [199] 66.5% [6] 3474(0.7%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [14] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [183] 100.0% [7] 2892(0.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:483:23 simplify [160] 90.0% hash-ref! [183] 10.0% ------------------------------------------------------------------------------------------- taylor [195] 100.0% [8] 2026(0.4%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 normalize-series [155] 72.0% simplify [160] 28.0% ------------------------------------------------------------------------------------------- ??? [1] 100.0% [9] 490216(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [16] 100.0% ------------------------------------------------------------------------------------------- ??? [2] 23.8% ??? [3] 75.9% [10] 110196(22.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [183] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [4] 100.0% [11] 79988(16.3%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [17] 99.7% eval-prog [114] 0.3% ------------------------------------------------------------------------------------------- option-on-expr [4] 100.0% [12] 5020(1.0%) 2930(0.6%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [208] 26.5% check-list [240] 15.1% ------------------------------------------------------------------------------------------- option-on-expr [4] 100.0% [13] 3678(0.8%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [49] 100.0% ------------------------------------------------------------------------------------------- make-multiplication-node [6] 100.0% [14] 3474(0.7%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubnode [18] 58.2% group-by [19] 41.8% ------------------------------------------------------------------------------------------- option-on-expr [4] 100.0% [15] 270(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [20] 100.0% ------------------------------------------------------------------------------------------- profile-thunk [9] 100.0% [16] 490216(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [21] 100.0% ------------------------------------------------------------------------------------------- sindices->spoints [11] 44.7% loop [17] 55.3% [17] 79712(16.3%) 0(0.0%) loop .../private/map.rkt:54:19 loop [17] 55.3% sidx->spoint [22] 44.7% ------------------------------------------------------------------------------------------- make-multiplication-subnode [14] 100.0% [18] 2020(0.4%) 0(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 make-multiplication-subsubsubnode [23] 43.4% simple-compose [225] 28.3% mterm->expr [26] 28.3% ------------------------------------------------------------------------------------------- make-multiplication-subnode [14] 100.0% [19] 1454(0.3%) 1454(0.3%) group-by .../racket/collects/racket/list.rkt:816:0 ------------------------------------------------------------------------------------------- pick-errors [15] 33.5% loop [199] 66.5% [20] 806(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [115] 100.0% ------------------------------------------------------------------------------------------- ??? [16] 100.0% [21] 490216(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [24] 97.4% prepare-points [34] 2.6% ------------------------------------------------------------------------------------------- loop [17] 100.0% [22] 79712(16.3%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [25] 99.7% debug-print [201] 0.3% ------------------------------------------------------------------------------------------- make-multiplication-subsubsubnode [23] 16.7% make-multiplication-subsubnode [18] 83.3% [23] 877(0.2%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [26] 83.3% make-multiplication-subsubsubnode [23] 16.7% ------------------------------------------------------------------------------------------- ??? [21] 100.0% [24] 477452(97.4%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [27] 80.0% get-final-combination [28] 19.8% setup-alt-simplified [30] 0.1% ------------------------------------------------------------------------------------------- sidx->spoint [22] 100.0% [25] 79440(16.2%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [29] 100.0% ------------------------------------------------------------------------------------------- make-multiplication-subsubnode [18] 39.5% make-multiplication-subsubsubnode [23] 60.5% [26] 1448(0.3%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 free-variables [210] 40.2% type-of [176] 39.5% f162 [165] 20.3% ------------------------------------------------------------------------------------------- run-improve [24] 100.0% [27] 381849(77.9%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [31] 62.5% gen-series! [32] 31.3% finalize-iter! [35] 4.7% choose-best-alt! [36] 1.0% gen-rewrites! [37] 0.5% localize! [38] 0.1% ------------------------------------------------------------------------------------------- run-improve [24] 100.0% [28] 94524(19.3%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [33] 99.7% loop [199] 0.3% ------------------------------------------------------------------------------------------- binary-search-floats [25] 100.0% [29] 79440(16.2%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [34] 77.8% errors [107] 21.8% ...row-higher-order.rkt:375:33 [119] 0.3% ------------------------------------------------------------------------------------------- run-improve [24] 100.0% [30] 270(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [39] 100.0% ------------------------------------------------------------------------------------------- run-iter! [27] 100.0% [31] 238706(48.7%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [40] 99.9% debug-print [201] 0.1% ------------------------------------------------------------------------------------------- run-iter! [27] 100.0% [32] 119346(24.3%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [41] 100.0% ------------------------------------------------------------------------------------------- get-final-combination [28] 100.0% [33] 94268(19.2%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f162 [165] 100.0% ------------------------------------------------------------------------------------------- ??? [21] 16.9% pred [29] 82.0% [34] 75378(15.4%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 make-exacts* [47] 60.6% loop [48] 29.4% make-exacts [42] 7.1% ??? [44] 2.2% debug-print [201] 0.7% ------------------------------------------------------------------------------------------- run-iter! [27] 100.0% [35] 17884(3.6%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [86] 100.0% ------------------------------------------------------------------------------------------- run-iter! [27] 100.0% [36] 3902(0.8%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [86] 100.0% ------------------------------------------------------------------------------------------- run-iter! [27] 100.0% [37] 1720(0.4%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [43] 100.0% ------------------------------------------------------------------------------------------- run-iter! [27] 100.0% [38] 291(0.1%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [45] 100.0% ------------------------------------------------------------------------------------------- setup-alt-simplified [30] 100.0% [39] 270(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [46] 100.0% ------------------------------------------------------------------------------------------- simplify! [31] 100.0% [40] 238422(48.6%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [46] 100.0% ------------------------------------------------------------------------------------------- gen-series! [32] 100.0% [41] 119346(24.3%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [119] 100.0% ------------------------------------------------------------------------------------------- prepare-points [34] 100.0% [42] 5360(1.1%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [48] 85.3% make-exacts* [47] 5.1% debug [169] 5.0% debug-print [201] 4.6% ------------------------------------------------------------------------------------------- gen-rewrites! [37] 100.0% [43] 1720(0.4%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [50] 100.0% ------------------------------------------------------------------------------------------- prepare-points [34] 100.0% [44] 1638(0.3%) 259(0.1%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ...row-higher-order.rkt:375:33 [119] 84.2% ------------------------------------------------------------------------------------------- localize! [38] 100.0% [45] 291(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 ??? [49] 100.0% ------------------------------------------------------------------------------------------- simplify-alt [39] 0.1% ??? [40] 99.9% [46] 238692(48.7%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [51] 99.5% *simplify-rules* [55] 0.5% ------------------------------------------------------------------------------------------- make-exacts [42] 0.6% prepare-points [34] 99.4% [47] 45944(9.4%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [114] 100.0% ------------------------------------------------------------------------------------------- make-exacts [42] 17.1% prepare-points [34] 82.9% [48] 26724(5.5%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [199] 94.0% debug-print [201] 5.0% debug [169] 1.0% ------------------------------------------------------------------------------------------- localize-error [45] 7.3% sort-context-on-expr [13] 92.7% [49] 3969(0.8%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [52] 100.0% ------------------------------------------------------------------------------------------- alt-rewrite-rm [43] 36.1% matcher [53] 63.9% [50] 1720(0.4%) 290(0.1%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [53] 63.9% *rules* [54] 25.2% f162 [165] 5.3% ------------------------------------------------------------------------------------------- simplify [46] 100.0% [51] 237540(48.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [56] 94.1% loop [57] 5.5% mk-egraph [60] 0.4% ------------------------------------------------------------------------------------------- ??? [49] 100.0% [52] 3969(0.8%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [58] 73.2% ??? [115] 19.5% errors-score [61] 7.3% ------------------------------------------------------------------------------------------- matcher [53] 50.0% rewriter [50] 50.0% [53] 1720(0.4%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [53] 50.0% rewriter [50] 50.0% ------------------------------------------------------------------------------------------- rewriter [50] 100.0% [54] 1155(0.2%) 284(0.1%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [59] 75.5% ------------------------------------------------------------------------------------------- simplify [46] 100.0% [55] 1152(0.2%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [59] 49.9% list-member? [143] 25.7% ??? [221] 24.4% ------------------------------------------------------------------------------------------- ??? [51] 100.0% [56] 223598(45.6%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [62] 98.4% loop [199] 1.5% debug [169] 0.1% ------------------------------------------------------------------------------------------- ??? [51] 100.0% [57] 13090(2.7%) 550(0.1%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [63] 48.5% loop [64] 47.3% ------------------------------------------------------------------------------------------- generic-sort/key [52] 31.9% copying-mergesort [58] 68.1% [58] 2906(0.6%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [58] 68.1% ??? [115] 30.1% ...row-higher-order.rkt:375:33 [119] 1.8% ------------------------------------------------------------------------------------------- *simplify-rules* [55] 39.8% *rules* [54] 60.2% [59] 1447(0.3%) 1447(0.3%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ------------------------------------------------------------------------------------------- ??? [51] 100.0% [60] 852(0.2%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [65] 100.0% ------------------------------------------------------------------------------------------- generic-sort/key [52] 100.0% [61] 291(0.1%) 0(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 loop [199] 100.0% ------------------------------------------------------------------------------------------- iterate-egraph! [56] 100.0% [62] 219922(44.9%) 4501(0.9%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [66] 36.0% merge-egraph-nodes! [67] 19.1% loop! [202] 13.8% mk-enode! [73] 7.8% custom-set-member? [68] 7.0% substitute-e [70] 5.3% update-leader! [72] 3.6% list-member? [143] 2.8% filter [196] 0.9% reverse [231] 0.5% set-member? [224] 0.5% reduce-to-single! [71] 0.3% make-sequence [239] 0.1% pack-leader [241] 0.1% ------------------------------------------------------------------------------------------- loop [57] 100.0% [63] 6354(1.3%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [69] 100.0% ------------------------------------------------------------------------------------------- loop [57] 100.0% [64] 6186(1.3%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [69] 100.0% ------------------------------------------------------------------------------------------- loop [199] 39.1% mk-egraph [60] 60.9% [65] 852(0.2%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [199] 100.0% ------------------------------------------------------------------------------------------- match-e [66] 27.0% one-iter [62] 73.0% [66] 79148(16.1%) 17347(3.5%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [66] 27.0% loop [199] 11.3% ??? [221] 7.1% ??? [86] 6.5% make-sequence [239] 5.6% reverse [231] 5.4% list-cartesian-product [75] 4.4% variable? [74] 4.3% do-procedure-reduce-keyword-arity [234] 2.4% ??? [76] 1.7% set-member? [224] 1.4% make-curried [78] 1.1% filter [196] 0.9% check-list [240] 0.3% pack-leader [241] 0.2% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [67] 13.2% one-iter [62] 86.8% [67] 41973(8.6%) 860(0.2%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [72] 63.3% loop! [202] 18.1% merge-egraph-nodes! [67] 13.2% enode-merge! [77] 3.0% make-sequence [239] 0.7% ------------------------------------------------------------------------------------------- one-iter [62] 100.0% [68] 15306(3.1%) 15306(3.1%) custom-set-member? ...t/private/set-types.rkt:45:0 ------------------------------------------------------------------------------------------- loop [64] 49.3% mk-min [63] 50.7% [69] 12540(2.6%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [87] 68.1% compile [120] 18.2% ...sting/src/common.rkt:47:2 [142] 13.7% ------------------------------------------------------------------------------------------- substitute-e [70] 7.0% one-iter [62] 93.0% [70] 11730(2.4%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [73] 87.7% substitute-e [70] 7.0% variable? [74] 4.5% ??? [86] 0.8% ------------------------------------------------------------------------------------------- one-iter [62] 100.0% [71] 574(0.1%) 288(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 make-sequence [239] 49.8% ------------------------------------------------------------------------------------------- one-iter [62] 21.6% merge-egraph-nodes! [67] 78.4% [72] 37140(7.6%) 9716(2.0%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [80] 66.9% hash-ref! [183] 1.6% reverse [231] 1.5% make-sequence [239] 1.5% update-en-expr [232] 0.8% pack-leader [241] 0.8% ------------------------------------------------------------------------------------------- loop [199] 3.0% substitute-e [70] 36.2% one-iter [62] 60.8% [73] 28373(5.8%) 1984(0.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [79] 93.0% ------------------------------------------------------------------------------------------- f162 [165] 2.4% free-variables [210] 2.7% substitute-e [70] 10.7% match-e [66] 84.2% [74] 10748(2.2%) 561(0.1%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [86] 94.8% ------------------------------------------------------------------------------------------- list-cartesian-product [75] 17.9% match-e [66] 82.1% [75] 4021(0.8%) 1462(0.3%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [239] 28.3% reverse [231] 21.1% list-cartesian-product [75] 17.9% ------------------------------------------------------------------------------------------- match-e [66] 100.0% [76] 1748(0.4%) 878(0.2%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 ??? [86] 33.4% make-sequence [239] 16.4% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [67] 100.0% [77] 1421(0.3%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [81] 59.3% adopt-enode! [82] 40.7% ------------------------------------------------------------------------------------------- match-e [66] 100.0% [78] 1122(0.2%) 536(0.1%) make-curried ...collects/racket/function.rkt:130:9 make-keyword-procedure [244] 52.3% ------------------------------------------------------------------------------------------- mk-enode! [73] 100.0% [79] 26389(5.4%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [83] 100.0% ------------------------------------------------------------------------------------------- update-leader! [72] 100.0% [80] 24844(5.1%) 290(0.1%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [84] 98.8% ------------------------------------------------------------------------------------------- enode-merge! [77] 100.0% [81] 843(0.2%) 843(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------------- enode-merge! [77] 100.0% [82] 578(0.1%) 0(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [219] 50.7% set-member? [224] 49.3% ------------------------------------------------------------------------------------------- new-enode [79] 100.0% [83] 26389(5.4%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [85] 100.0% ------------------------------------------------------------------------------------------- do-hash-update [80] 100.0% [84] 24554(5.0%) 20838(4.3%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [232] 11.6% reverse [231] 2.4% make-sequence [239] 1.2% ------------------------------------------------------------------------------------------- f162 [165] 2.1% type-of-enode-expr [83] 97.9% [85] 26958(5.5%) 576(0.1%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [87] 46.7% ??? [88] 24.5% ??? [86] 18.1% ...sting/src/common.rkt:47:2 [142] 8.5% ------------------------------------------------------------------------------------------- free-variables [210] 0.6% substitute-e [70] 0.6% gather-additive-terms [206] 0.6% ??? [76] 1.1% ??? [167] 3.1% choose-best-alt! [36] 7.6% get-sigs [85] 9.5% variable? [74] 19.8% match-e [66] 22.5% finalize-iter! [35] 34.7% [86] 51526(10.5%) 1125(0.2%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [89] 54.4% atab-add-altns [90] 34.7% atab-pick-alt [92] 7.6% ??? [167] 1.1% ------------------------------------------------------------------------------------------- ->bf [213] 1.1% ...row-higher-order.rkt:375:33 [119] 13.9% expression-cost [69] 34.3% get-sigs [85] 50.6% [87] 24874(5.1%) 4852(1.0%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [93] 72.6% reverse [231] 4.5% ...sting/src/common.rkt:47:2 [142] 1.2% return/no-unsupplied [184] 1.1% set-member? [224] 1.1% ------------------------------------------------------------------------------------------- ->bf [213] 3.7% ...row-higher-order.rkt:375:33 [119] 3.8% get-sigs [85] 92.5% [88] 7150(1.5%) 560(0.1%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [91] 64.3% handle-the-hash [100] 16.1% get/build-late-neg-projection [117] 8.0% successfully-got-the-right-kind-of-function [101] 3.7% ------------------------------------------------------------------------------------------- ??? [86] 100.0% [89] 28032(5.7%) 21247(4.3%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [93] 24.2% ------------------------------------------------------------------------------------------- ??? [86] 100.0% [90] 17884(3.6%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [94] 100.0% ------------------------------------------------------------------------------------------- ??? [88] 100.0% [91] 4596(0.9%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [95] 100.0% ------------------------------------------------------------------------------------------- ??? [86] 100.0% [92] 3902(0.8%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [96] 49.7% ...row-higher-order.rkt:375:33 [119] 21.5% write-json* [97] 21.3% errors [107] 7.4% ------------------------------------------------------------------------------------------- hash-has-key? [89] 27.3% table-ref [87] 72.7% [93] 24832(5.1%) 9836(2.0%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [99] 36.3% handle-the-hash [100] 16.1% successfully-got-the-right-kind-of-function [101] 3.4% ??? [161] 2.2% do-chaperone-procedure [105] 2.2% ------------------------------------------------------------------------------------------- atab-add-altns [90] 100.0% [94] 17884(3.6%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [98] 93.8% override-at-pnts [103] 4.7% ------------------------------------------------------------------------------------------- ??? [91] 100.0% [95] 4596(0.9%) 3430(0.7%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [102] 19.0% ??? [106] 6.4% ------------------------------------------------------------------------------------------- atab-pick-alt [92] 100.0% [96] 1940(0.4%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [199] 100.0% ------------------------------------------------------------------------------------------- atab-pick-alt [92] 100.0% [97] 832(0.2%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [104] 100.0% ------------------------------------------------------------------------------------------- atab-add-altn [94] 100.0% [98] 16774(3.4%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [107] 100.0% ------------------------------------------------------------------------------------------- ??? [93] 100.0% [99] 9021(1.8%) 5642(1.2%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [108] 22.3% blame-add-missing-party [109] 12.1% make-keyword-procedure [244] 3.1% ------------------------------------------------------------------------------------------- ??? [88] 22.4% ??? [93] 77.6% [100] 5158(1.1%) 2268(0.5%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [161] 50.4% ??? [173] 5.6% ------------------------------------------------------------------------------------------- ??? [88] 23.6% ??? [93] 76.4% [101] 1120(0.2%) 855(0.2%) successfully-got-the-right-kind-of-function ...5:4 arity-checking-wrapper [113] 23.6% ------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [95] 100.0% [102] 874(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [110] 100.0% ------------------------------------------------------------------------------------------- atab-add-altn [94] 100.0% [103] 836(0.2%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [107] 100.0% ------------------------------------------------------------------------------------------- write-json* [97] 25.0% loop [104] 75.0% [104] 832(0.2%) 832(0.2%) loop .../share/racket/collects/json/main.rkt:132:2 loop [104] 75.0% ------------------------------------------------------------------------------------------- ??? [93] 100.0% [105] 558(0.1%) 284(0.1%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 chaperone-arity-match-checking [112] 49.2% ------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [95] 100.0% [106] 292(0.1%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:34 blame-add-context [111] 100.0% ------------------------------------------------------------------------------------------- atab-pick-alt [92] 0.7% override-at-pnts [103] 2.0% composed [172] 2.6% loop [199] 14.0% best-and-tied-at-points [98] 39.7% pred [29] 41.0% [107] 42289(8.6%) 256(0.1%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [115] 49.2% eval-prog [114] 45.5% ulp-difference [116] 3.3% flonums-between [118] 0.7% ...row-higher-order.rkt:375:33 [119] 0.6% ------------------------------------------------------------------------------------------- ??? [99] 33.7% loop [108] 66.3% [108] 2010(0.4%) 2010(0.4%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [108] 66.3% ------------------------------------------------------------------------------------------- ??? [99] 100.0% [109] 1092(0.2%) 1092(0.2%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------------- ??? [102] 100.0% [110] 874(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [117] 67.1% check-list [240] 32.9% ------------------------------------------------------------------------------------------- ??? [106] 100.0% [111] 292(0.1%) 292(0.1%) blame-add-context ...tract/private/blame.rkt:170:0 ------------------------------------------------------------------------------------------- do-chaperone-procedure [105] 100.0% [112] 274(0.1%) 0(0.0%) chaperone-arity-match-checking ...te/kw.rkt:2186:2 procedure-keywords [243] 100.0% ------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [101]100.0% [113] 264(0.1%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:443:0 procedure-keywords [243] 100.0% ------------------------------------------------------------------------------------------- sindices->spoints [11] 0.4% errors [107] 29.4% make-exacts* [47] 70.2% [114] 65479(13.4%) 32898(6.7%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [120] 36.3% f162 [165] 10.2% ??? [124] 1.6% ...row-higher-order.rkt:375:33 [119] 0.8% go [130] 0.4% ------------------------------------------------------------------------------------------- generic-sort/key [52] 1.6% ??? [20] 1.6% copying-mergesort [58] 5.4% errors [107] 42.5% loop [199] 48.9% [115] 49020(10.0%) 22672(4.6%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [199] 25.6% ??? [134] 9.9% ??? [121] 5.2% ??? [173] 3.4% ??? [122] 3.4% ??? [123] 2.2% ??? [126] 1.7% bf* [127] 1.7% ------------------------------------------------------------------------------------------- errors [107] 100.0% [116] 1390(0.3%) 282(0.1%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 set-member? [224] 20.8% list-member? [143] 19.8% ...sting/src/common.rkt:47:2 [142] 19.8% return/no-unsupplied [184] 19.4% ------------------------------------------------------------------------------------------- ??? [128] 24.7% ??? [88] 24.7% ??? [110] 50.5% [117] 1161(0.2%) 292(0.1%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [125] 50.2% ??? [128] 24.7% ------------------------------------------------------------------------------------------- errors [107] 100.0% [118] 292(0.1%) 0(0.0%) flonums-between ...te/flonum/flonum-bits.rkt:103:2 flonum->ordinal [129] 100.0% ------------------------------------------------------------------------------------------- sample-multi-bounded [136] 0.1% copying-mergesort [58] 0.2% errors [107] 0.2% pred [29] 0.2% eval-prog [114] 0.4% atab-pick-alt [92] 0.6% ??? [44] 0.9% f162 [165] 4.5% loop [199] 9.6% loop [131] 41.7% taylor-alt [41] 41.7% [119] 143018(29.2%) 1068(0.2%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 loop [131] 41.7% approximate [132] 41.7% ->flonum [133] 5.9% real->bigfloat [135] 3.1% table-ref [87] 2.4% ??? [167] 1.5% sample-multi-bounded [136] 0.9% ...sting/src/common.rkt:47:2 [142] 0.7% best-alt [137] 0.6% ->bf [213] 0.4% ??? [88] 0.2% ------------------------------------------------------------------------------------------- expression-cost [69] 8.7% eval-prog [114] 91.3% [120] 26074(5.3%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [183] 100.0% ------------------------------------------------------------------------------------------- ??? [115] 100.0% [121] 2556(0.5%) 1998(0.4%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 set-member? [224] 11.3% ...sting/src/common.rkt:47:2 [142] 10.5% ------------------------------------------------------------------------------------------- ??? [115] 100.0% [122] 1652(0.3%) 1652(0.3%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------- ??? [115] 100.0% [123] 1062(0.2%) 819(0.2%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [197] 22.9% ------------------------------------------------------------------------------------------- eval-prog [114] 100.0% [124] 1058(0.2%) 264(0.1%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [138] 75.0% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [117] 100.0% [125] 870(0.2%) 288(0.1%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [139] 33.9% reverse [231] 33.0% ------------------------------------------------------------------------------------------- ??? [115] 100.0% [126] 836(0.2%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [161] 69.4% ??? [167] 30.6% ------------------------------------------------------------------------------------------- ??? [115] 100.0% [127] 830(0.2%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [134] 100.0% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [117] 100.0% [128] 574(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [117] 100.0% ------------------------------------------------------------------------------------------- flonums-between [118] 100.0% [129] 292(0.1%) 292(0.1%) flonum->ordinal ...ate/flonum/flonum-bits.rkt:68:0 ------------------------------------------------------------------------------------------- eval-prog [114] 100.0% [130] 262(0.1%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [140] 100.0% ------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [119] 32.6% loop [131] 67.4% [131] 119346(24.3%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [131] 67.4% ...row-higher-order.rkt:375:33 [119] 32.6% ------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [119] 100.0% [132] 119346(24.3%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [141] 81.2% hash-ref! [183] 16.2% taylor [195] 1.2% f162 [165] 0.7% taylor-quotient [148] 0.5% taylor-sqrt [147] 0.2% ------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [119] 100.0% [133] 8422(1.7%) 5360(1.1%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [184] 16.2% ...sting/src/common.rkt:47:2 [142] 10.0% ^TYPE? [197] 3.6% list-member? [143] 3.4% set-member? [224] 3.2% ------------------------------------------------------------------------------------------- bf* [127] 14.6% ??? [115] 85.4% [134] 5678(1.2%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [144] 62.0% bfneg [145] 38.0% ------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [119] 100.0% [135] 4486(0.9%) 1606(0.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [153] 59.7% ??? [157] 4.6% ------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [119] 100.0% [136] 1378(0.3%) 809(0.2%) sample-multi-bounded ...esting/src/points.rkt:44:0 ...row-higher-order.rkt:375:33 [119] 20.7% random-exp [150] 20.6% ------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [119] 100.0% [137] 840(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [146] 100.0% ------------------------------------------------------------------------------------------- ??? [124] 100.0% [138] 794(0.2%) 794(0.2%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------------------- ??? [125] 100.0% [139] 295(0.1%) 0(0.0%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [149] 100.0% ------------------------------------------------------------------------------------------- go [130] 33.3% loop [140] 66.7% [140] 262(0.1%) 0(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [140] 66.7% stx-cdr [151] 33.3% ------------------------------------------------------------------------------------------- ??? [5] 16.6% approximate [132] 83.4% [141] 116210(23.7%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [183] 100.0% ------------------------------------------------------------------------------------------- ??? [156] 1.8% ??? [121] 3.4% ulp-difference [116] 3.5% table-ref [87] 3.8% ->flonum [133] 10.6% ...row-higher-order.rkt:375:33 [119] 13.5% simplify* [204] 14.6% expression-cost [69] 19.9% get-sigs [85] 28.9% [142] 7922(1.6%) 2561(0.5%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [154] 45.9% ??? [156] 16.4% dict-key-contract [158] 3.6% ??? [167] 1.8% ------------------------------------------------------------------------------------------- ulp-difference [116] 3.9% ->flonum [133] 4.0% *simplify-rules* [55] 4.2% one-iter [62] 87.9% [143] 7110(1.5%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [152] 100.0% ------------------------------------------------------------------------------------------- ??? [134] 100.0% [144] 3522(0.7%) 1070(0.2%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [153] 45.7% ??? [157] 16.0% ??? [159] 7.9% ------------------------------------------------------------------------------------------- ??? [134] 100.0% [145] 2156(0.4%) 777(0.2%) bfneg ...-lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [153] 64.0% ------------------------------------------------------------------------------------------- extract-alt [217] 23.3% best-alt [137] 76.7% [146] 1096(0.2%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [172] 100.0% ------------------------------------------------------------------------------------------- approximate [132] 33.0% loop [199] 33.2% taylor [195] 33.8% [147] 871(0.2%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 hash-ref! [183] 100.0% ------------------------------------------------------------------------------------------- approximate [132] 100.0% [148] 556(0.1%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 normalize-series [155] 100.0% ------------------------------------------------------------------------------------------- build-compound-type-name [139] 100.0% [149] 295(0.1%) 0(0.0%) contract-struct-name ...ract/private/prop.rkt:98:0 reverse [231] 100.0% ------------------------------------------------------------------------------------------- sample-multi-bounded [136] 100.0% [150] 284(0.1%) 284(0.1%) random-exp ...bie/alt-testing/src/common.rkt:253:0 ------------------------------------------------------------------------------------------- loop [140] 100.0% [151] 262(0.1%) 262(0.1%) stx-cdr ...et/collects/racket/private/stx.rkt:74:4 ------------------------------------------------------------------------------------------- list-member? [143] 100.0% [152] 7110(1.5%) 7110(1.5%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------------- bfneg [145] 24.3% bfmul [144] 28.4% real->bigfloat [135] 47.2% [153] 5664(1.2%) 5664(1.2%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------------- ??? [161] 15.2% ...sting/src/common.rkt:47:2 [142] 84.8% [154] 3639(0.7%) 826(0.2%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [161] 62.7% ??? [167] 11.1% ??? [164] 7.5% ------------------------------------------------------------------------------------------- taylor-quotient [148] 21.4% taylor [195] 22.4% taylor-invert [8] 56.2% [155] 2596(0.5%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [183] 88.6% simplify [160] 11.4% ------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [142] 100.0% [156] 1439(0.3%) 279(0.1%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 return/no-unsupplied [184] 40.6% assoc-ref [162] 20.1% ...sting/src/common.rkt:47:2 [142] 19.9% ------------------------------------------------------------------------------------------- real->bigfloat [135] 26.6% bfmul [144] 73.4% [157] 768(0.2%) 768(0.2%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [142] 100.0% [158] 283(0.1%) 283(0.1%) dict-key-contract ...collects/racket/dict.rkt:71:0 ------------------------------------------------------------------------------------------- bfmul [144] 100.0% [159] 279(0.1%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [163] 100.0% ------------------------------------------------------------------------------------------- ??? [190] 0.2% normalize-series [155] 0.3% taylor-invert [8] 0.5% loop [199] 0.5% ??? [2] 0.7% ??? [191] 0.7% ??? [3] 2.0% ??? [7] 2.2% hash-ref! [183] 92.2% [160] 117662(24.0%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f162 [165] 94.6% debug-print [201] 3.2% simplify-node [166] 1.0% debug [169] 0.5% simplify* [204] 0.5% loop [170] 0.2% ------------------------------------------------------------------------------------------- ??? [93] 8.5% ??? [126] 8.8% handle-the-hash [100] 39.6% ??? [154] 43.1% [161] 6572(1.3%) 2912(0.6%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [168] 26.3% ??? [154] 16.8% check-list [240] 4.4% ??? [173] 4.1% ??? [167] 4.0% ------------------------------------------------------------------------------------------- ??? [156] 100.0% [162] 290(0.1%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [242] 100.0% ------------------------------------------------------------------------------------------- ??? [159] 100.0% [163] 279(0.1%) 279(0.1%) assq ...et/collects/racket/private/list.rkt:187:13 ------------------------------------------------------------------------------------------- ??? [154] 100.0% [164] 274(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [171] 100.0% ------------------------------------------------------------------------------------------- expression->type [180] 0.0% mterm->expr [26] 0.0% composed [172] 0.1% rewriter [50] 0.1% approximate [132] 0.4% eval-prog [114] 0.8% simplify [160] 19.7% loop [199] 35.5% split-table [33] 43.3% [165] 207506(42.3%) 96216(19.6%) f162 .../collects/racket/match/compiler.rkt:548:40 loop [199] 80.5% ...row-higher-order.rkt:375:33 [119] 0.8% taylor [195] 0.4% get-sigs [85] 0.2% composed [172] 0.1% expression->type [180] 0.0% variable? [74] 0.0% simple-compose [225] 0.0% ------------------------------------------------------------------------------------------- gather-additive-terms [206] 9.5% simplify [160] 25.3% loop [199] 65.2% [166] 4610(0.9%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 gather-additive-terms [206] 47.4% gather-multiplicative-terms [212] 21.9% combine-mterms [174] 18.4% combine-aterms [179] 12.4% ------------------------------------------------------------------------------------------- ??? [126] 5.9% ??? [161] 6.1% ...sting/src/common.rkt:47:2 [142] 6.6% ??? [86] 13.4% ??? [154] 18.6% ...row-higher-order.rkt:375:33 [119] 49.3% [167] 4343(0.9%) 521(0.1%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ??? [86] 37.0% dict? [175] 20.0% contract? [178] 18.6% ^TYPE? [197] 12.4% ------------------------------------------------------------------------------------------- ??? [161] 100.0% [168] 1730(0.4%) 860(0.2%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [173] 34.1% check-list [240] 16.2% ------------------------------------------------------------------------------------------- loop [48] 18.9% iterate-egraph! [56] 19.5% make-exacts [42] 19.7% simplify [160] 42.0% [169] 1372(0.3%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [177] 60.0% get-setting [181] 21.2% return/no-unsupplied [184] 18.9% ------------------------------------------------------------------------------------------- simplify [160] 16.7% loop [170] 83.3% [170] 290(0.1%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 loop [170] 83.3% type-of [176] 16.7% ------------------------------------------------------------------------------------------- ??? [164] 100.0% [171] 274(0.1%) 0(0.0%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [182] 100.0% ------------------------------------------------------------------------------------------- argmins [146] 35.5% f162 [165] 64.5% [172] 3085(0.6%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 f162 [165] 55.3% errors [107] 35.5% free-variables [210] 9.1% ------------------------------------------------------------------------------------------- ??? [161] 9.5% handle-the-hash [100] 10.2% ??? [168] 20.8% ??? [115] 59.4% [173] 2842(0.6%) 261(0.1%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [185] 71.0% ??? [186] 19.8% ------------------------------------------------------------------------------------------- simplify-node [166] 100.0% [174] 1134(0.2%) 286(0.1%) combine-mterms ...esting/src/core/reduce.rkt:191:0 hash-ref! [183] 74.8% ------------------------------------------------------------------------------------------- ??? [167] 100.0% [175] 870(0.2%) 584(0.1%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [189] 32.9% ------------------------------------------------------------------------------------------- loop [170] 33.6% mterm->expr [26] 66.4% [176] 861(0.2%) 861(0.2%) type-of ...bie/alt-testing/src/type-check.rkt:38:0 ------------------------------------------------------------------------------------------- debug [169] 100.0% [177] 823(0.2%) 553(0.1%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 return/no-unsupplied [184] 32.8% ------------------------------------------------------------------------------------------- ??? [167] 100.0% [178] 809(0.2%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [187] 68.5% simple-flat-contract? [188] 31.5% ------------------------------------------------------------------------------------------- simplify-node [166] 100.0% [179] 572(0.1%) 289(0.1%) combine-aterms ...esting/src/core/reduce.rkt:183:0 hash-ref! [183] 49.4% ------------------------------------------------------------------------------------------- expression->type [180] 50.0% f162 [165] 50.0% [180] 294(0.1%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 expression->type [180] 50.0% f162 [165] 50.0% ------------------------------------------------------------------------------------------- debug [169] 100.0% [181] 290(0.1%) 290(0.1%) get-setting ...rbie/alt-testing/src/debug.rkt:96:0 ------------------------------------------------------------------------------------------- check-hash/c [171] 100.0% [182] 274(0.1%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [188] 100.0% ------------------------------------------------------------------------------------------- ??? [7] 0.0% combine-aterms [179] 0.0% simplify* [204] 0.1% combine-mterms [174] 0.1% ??? [5] 0.4% ??? [2] 0.4% update-leader! [72] 0.4% taylor-sqrt [147] 0.5% normalize-series [155] 0.6% ??? [192] 2.7% approximate [132] 3.0% ??? [191] 5.1% ??? [3] 6.2% ??? [141] 7.9% loop [199] 8.7% compile [120] 9.4% ??? [190] 15.3% ??? [10] 39.0% [183] 144288(29.4%) 7310(1.5%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [3] 39.6% ??? [190] 15.4% ??? [194] 8.7% bigfloat-hash [193] 8.1% ??? [2] 6.8% simplify [160] 6.8% ??? [191] 5.2% ??? [5] 3.4% ??? [192] 2.7% taylor [195] 1.0% ??? [7] 0.1% ------------------------------------------------------------------------------------------- debug [169] 8.5% ulp-difference [116] 8.9% cur-debug-level [177] 8.9% table-ref [87] 9.4% ??? [156] 19.3% ->flonum [133] 45.1% [184] 3036(0.6%) 1379(0.3%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [196] 27.9% reverse [231] 26.6% ------------------------------------------------------------------------------------------- ??? [173] 100.0% [185] 2019(0.4%) 568(0.1%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ^TYPE? [197] 57.3% ??? [198] 14.5% ------------------------------------------------------------------------------------------- ??? [173] 100.0% [186] 562(0.1%) 562(0.1%) ??? ...lects/racket/contract/private/orc.rkt:117:8 ------------------------------------------------------------------------------------------- contract? [178] 100.0% [187] 554(0.1%) 554(0.1%) coerce-contract/f ...ntract/private/guts.rkt:372:0 ------------------------------------------------------------------------------------------- contract? [178] 48.2% flat-contract? [182] 51.8% [188] 528(0.1%) 528(0.1%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------------- dict? [175] 100.0% [189] 286(0.1%) 286(0.1%) assoc? ...et/collects/racket/private/dict.rkt:13:0 ------------------------------------------------------------------------------------------- hash-ref! [183] 100.0% [190] 104428(21.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [183] 99.9% simplify [160] 0.1% ------------------------------------------------------------------------------------------- hash-ref! [183] 100.0% [191] 100412(20.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 hash-ref! [183] 99.2% simplify [160] 0.8% ------------------------------------------------------------------------------------------- hash-ref! [183] 100.0% [192] 61971(12.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [183] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [183] 100.0% [193] 22472(4.6%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [200] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [183] 100.0% [194] 19597(4.0%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [199] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [183] 6.9% f162 [165] 7.9% approximate [132] 12.5% loop [199] 22.8% taylor [195] 48.8% [195] 6035(1.2%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [195] 48.8% loop [199] 28.8% taylor-invert [8] 8.6% debug-print [201] 7.3% taylor-sqrt [147] 2.4% normalize-series [155] 0.9% ------------------------------------------------------------------------------------------- return/no-unsupplied [184] 21.2% match-e [66] 29.1% one-iter [62] 49.7% [196] 4002(0.8%) 4002(0.8%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------------- ??? [123] 10.9% ->flonum [133] 13.5% ??? [167] 24.0% ??? [185] 51.7% [197] 2240(0.5%) 2240(0.5%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------------- ??? [185] 100.0% [198] 294(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [240] 100.0% ------------------------------------------------------------------------------------------- errors-score [61] 0.0% gather-multiplicative-terms [212] 0.0% set-precompute! [205] 0.0% iterate-egraph! [56] 0.1% get-final-combination [28] 0.1% option-on-expr [4] 0.1% point-best-alt [96] 0.2% gather-additive-terms [206] 0.3% mk-enode-rec! [65] 0.3% loop [48] 0.4% taylor [195] 0.8% loop! [202] 0.8% ??? [115] 1.0% match-e [66] 2.9% ??? [194] 3.0% f162 [165] 28.8% loop [199] 60.9% [199] 254645(51.9%) 4511(0.9%) loop .../private/map.rkt:40:19 loop [199] 60.9% f162 [165] 22.3% option-on-expr [4] 5.7% hash-ref! [183] 3.0% ...row-higher-order.rkt:375:33 [119] 1.0% foldl [223] 0.8% loop! [202] 0.8% step [207] 0.7% taylor [195] 0.6% ??? [115] 0.4% errors [107] 0.4% gather-additive-terms [206] 0.3% simplify* [204] 0.3% simplify-node [166] 0.2% simplify [160] 0.2% make-multiplication-node [6] 0.2% mk-enode! [73] 0.2% keyword-apply [214] 0.1% mk-enode-rec! [65] 0.1% extract-alt [217] 0.1% ??? [209] 0.1% set-precompute! [205] 0.1% taylor-sqrt [147] 0.1% rloop [216] 0.0% gather-multiplicative-terms [212] 0.0% setfindf [211] 0.0% ->bf [213] 0.0% ??? [20] 0.0% free-variables [210] 0.0% ??? [208] 0.0% ------------------------------------------------------------------------------------------- bigfloat-hash [193] 100.0% [200] 22472(4.6%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [203] 98.9% bigfloat->sig+exp [218] 1.1% ------------------------------------------------------------------------------------------- make-exacts [42] 3.2% sidx->spoint [22] 3.6% simplify! [31] 3.7% prepare-points [34] 7.3% taylor [195] 14.7% loop [48] 17.7% simplify [160] 49.8% [201] 7614(1.6%) 7330(1.5%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 write-proc [215] 3.7% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [67] 17.1% loop [199] 33.0% one-iter [62] 50.0% [202] 40662(8.3%) 3760(0.8%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [219] 37.3% loop [199] 33.0% make-immutable-set [220] 14.6% ??? [222] 9.2% set-member? [224] 0.4% ------------------------------------------------------------------------------------------- bfcanonicalize [200] 100.0% [203] 22226(4.5%) 22226(4.5%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------------- simplify [160] 11.5% loop [199] 88.5% [204] 4918(1.0%) 2042(0.4%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [183] 35.0% ...sting/src/common.rkt:47:2 [142] 23.5% ------------------------------------------------------------------------------------------- loop [199] 100.0% [205] 3147(0.6%) 862(0.2%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [199] 54.1% ??? [221] 18.5% ------------------------------------------------------------------------------------------- simplify-node [166] 25.7% loop [199] 34.5% gather-additive-terms [206] 39.7% [206] 2620(0.5%) 0(0.0%) gather-additive-terms .../src/core/reduce.rkt:72:0 loop [199] 45.7% gather-additive-terms [206] 39.7% make-multiplication-node [6] 6.2% ??? [86] 5.6% simplify-node [166] 2.8% ------------------------------------------------------------------------------------------- loop [199] 100.0% [207] 2570(0.5%) 1714(0.3%) step .../racket/collects/racket/function.rkt:145:9 sort [227] 33.3% ------------------------------------------------------------------------------------------- loop [199] 17.0% err-lsts->split-indices [12] 83.0% [208] 1602(0.3%) 1602(0.3%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------------- loop [199] 100.0% [209] 1447(0.3%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 pattern-match [226] 79.8% foldl [223] 20.2% ------------------------------------------------------------------------------------------- composed [172] 19.5% loop [199] 40.1% mterm->expr [26] 40.4% [210] 1443(0.3%) 573(0.1%) free-variables ...t-testing/src/programs.rkt:102:0 constant? [229] 20.3% variable? [74] 20.1% ??? [86] 19.9% ------------------------------------------------------------------------------------------- loop [199] 100.0% [211] 1160(0.2%) 873(0.2%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 make-sequence [239] 24.8% ------------------------------------------------------------------------------------------- loop [199] 36.2% simplify-node [166] 63.8% [212] 1156(0.2%) 857(0.2%) gather-multiplicative-terms ...re/reduce.rkt:116:0 loop [199] 36.2% simple-compose [225] 25.8% ------------------------------------------------------------------------------------------- loop [199] 49.8% ...row-higher-order.rkt:375:33 [119] 50.2% [213] 1073(0.2%) 534(0.1%) ->bf ...s/herbie/alt-testing/src/programs.rkt:53:0 table-ref [87] 25.6% ??? [88] 24.7% ------------------------------------------------------------------------------------------- loop [199] 100.0% [214] 857(0.2%) 280(0.1%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [228] 67.3% ------------------------------------------------------------------------------------------- debug-print [201] 100.0% [215] 284(0.1%) 284(0.1%) write-proc ...alt-testing/src/alternative.rkt:22:9 ------------------------------------------------------------------------------------------- loop [199] 3.8% rloop [216] 96.2% [216] 274(0.1%) 274(0.1%) rloop ...ket/collects/racket/private/list.rkt:88:4 rloop [216] 96.2% ------------------------------------------------------------------------------------------- loop [199] 100.0% [217] 256(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [146] 100.0% ------------------------------------------------------------------------------------------- bfcanonicalize [200] 100.0% [218] 246(0.1%) 0(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:389:0 mpz->integer [230] 100.0% ------------------------------------------------------------------------------------------- adopt-enode! [82] 1.7% loop! [202] 98.3% [219] 17354(3.5%) 14494(3.0%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [235] 13.2% check-list [240] 3.2% ------------------------------------------------------------------------------------------- loop! [202] 100.0% [220] 12170(2.5%) 12170(2.5%) make-immutable-set .../private/set-types.rkt:948:0 ------------------------------------------------------------------------------------------- *simplify-rules* [55] 3.8% set-precompute! [205] 7.8% match-e [66] 88.4% [221] 7468(1.5%) 281(0.1%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [233] 64.8% do-procedure-reduce-keyword-arity [234] 31.4% ------------------------------------------------------------------------------------------- loop! [202] 100.0% [222] 7097(1.4%) 859(0.2%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [232] 52.0% reverse [231] 35.9% ------------------------------------------------------------------------------------------- ??? [209] 7.4% loop [199] 92.6% [223] 3940(0.8%) 1132(0.2%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [236] 49.7% check-fold [237] 21.5% ------------------------------------------------------------------------------------------- ->flonum [133] 6.8% table-ref [87] 7.0% adopt-enode! [82] 7.3% loop! [202] 7.4% ulp-difference [116] 7.4% ??? [121] 7.4% one-iter [62] 27.8% match-e [66] 29.1% [224] 3928(0.8%) 3928(0.8%) set-member? ...ts/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------------- f162 [165] 25.1% gather-multiplicative-terms [212] 25.7% make-multiplication-subsubnode [18] 49.2% [225] 1162(0.2%) 1162(0.2%) simple-compose ...s/racket/private/list.rkt:426:10 ------------------------------------------------------------------------------------------- ??? [209] 100.0% [226] 1154(0.2%) 864(0.2%) pattern-match ...testing/src/core/matcher.rkt:48:0 make-sequence [239] 25.1% ------------------------------------------------------------------------------------------- step [207] 100.0% [227] 856(0.2%) 856(0.2%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------------------- keyword-apply [214] 100.0% [228] 577(0.1%) 577(0.1%) loop ...cket/collects/racket/private/kw.rkt:518:13 ------------------------------------------------------------------------------------------- free-variables [210] 100.0% [229] 294(0.1%) 294(0.1%) constant? ...t-testing/src/syntax/syntax.rkt:660:0 ------------------------------------------------------------------------------------------- bigfloat->sig+exp [218] 100.0% [230] 246(0.1%) 0(0.0%) mpz->integer ...ath/private/bigfloat/gmp.rkt:115:0 size+limbs->integer [238] 100.0% ------------------------------------------------------------------------------------------- ??? [125] 2.2% contract-struct-name [149] 2.3% update-leader! [72] 4.3% ??? [84] 4.5% return/no-unsupplied [184] 6.2% list-cartesian-product [75] 6.5% table-ref [87] 8.5% one-iter [62] 8.8% ??? [222] 19.6% match-e [66] 37.2% [231] 13026(2.7%) 13026(2.7%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------------- update-leader! [72] 4.3% ??? [84] 41.7% ??? [222] 54.0% [232] 6830(1.4%) 3398(0.7%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [239] 29.1% pack-leader [241] 21.2% ------------------------------------------------------------------------------------------- ??? [221] 100.0% [233] 4842(1.0%) 3158(0.6%) do-curry ...cket/collects/racket/function.rkt:71:2 procedure-keywords [243] 17.3% make-keyword-procedure [244] 11.7% partially-applied-procedure-arity-mask [246] 5.8% ------------------------------------------------------------------------------------------- match-e [66] 49.6% ??? [221] 50.4% [234] 4654(0.9%) 4360(0.9%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [243] 6.3% ------------------------------------------------------------------------------------------- custom-set-union [219] 100.0% [235] 2297(0.5%) 1710(0.3%) choose-immutable ...et/private/set-types.rkt:151:0 check-list [240] 12.9% set-check-compatible [245] 12.7% ------------------------------------------------------------------------------------------- foldl [223] 100.0% [236] 1960(0.4%) 290(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [242] 85.2% ------------------------------------------------------------------------------------------- foldl [223] 100.0% [237] 848(0.2%) 848(0.2%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------------- mpz->integer [230] 100.0% [238] 246(0.1%) 246(0.1%) size+limbs->integer ...vate/bigfloat/gmp.rkt:103:0 ------------------------------------------------------------------------------------------- reduce-to-single! [71] 2.6% ??? [76] 2.6% setfindf [211] 2.6% one-iter [62] 2.6% pattern-match [226] 2.6% ??? [84] 2.6% merge-egraph-nodes! [67] 2.7% update-leader! [72] 5.1% list-cartesian-product [75] 15.3% update-en-expr [232] 17.8% match-e [66] 43.7% [239] 11171(2.3%) 10038(2.0%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [247] 10.1% ------------------------------------------------------------------------------------------- match-e [66] 8.9% ??? [168] 9.2% ??? [110] 9.5% ??? [161] 9.6% ??? [198] 9.6% choose-immutable [235] 9.7% custom-set-union [219] 18.5% err-lsts->split-indices [12] 25.0% [240] 3042(0.6%) 3042(0.6%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------------- one-iter [62] 12.2% update-leader! [72] 12.4% match-e [66] 12.7% update-en-expr [232] 62.8% [241] 2306(0.5%) 2306(0.5%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ------------------------------------------------------------------------------------------- assoc-ref [162] 14.8% merge2 [236] 85.2% [242] 1960(0.4%) 1960(0.4%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------------- arity-checking-wrapper [113] 15.8% chaperone-arity-match-checking [112] 16.4% do-procedure-reduce-keyword-arity [234] 17.7% do-curry [233] 50.0% [243] 1670(0.3%) 1670(0.3%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------------- ??? [99] 19.4% do-curry [233] 39.7% make-curried [78] 41.0% [244] 1430(0.3%) 1430(0.3%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------------- choose-immutable [235] 100.0% [245] 291(0.1%) 291(0.1%) set-check-compatible ...rivate/set-types.rkt:531:0 ------------------------------------------------------------------------------------------- do-curry [233] 100.0% [246] 282(0.1%) 282(0.1%) partially-applied-procedure-arity-mask ...rkt:58:2 ------------------------------------------------------------------------------------------- make-sequence [239] 100.0% [247] 1134(0.2%) 1134(0.2%) :hash-gen ...collects/racket/private/for.rkt:781:4 -------------------------------------------------------------------------------------------