Profiling results ----------------- Total cpu time observed: 549632ms (out of 549948ms) Number of samples taken: 1965 (once every 280ms) (Hiding functions with self<1.0% and local<2.0%: 20 of 264 hidden) ================================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ================================================================================= [1] 549632(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [11] 100.0% --------------------------------------------------------------------------------- loop [186] 100.0% [2] 179806(32.7%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [12] 87.3% loop [186] 5.8% sort-context-on-expr [14] 3.7% err-lsts->split-indices [15] 2.9% pick-errors [19] 0.1% --------------------------------------------------------------------------------- hash-ref! [164] 100.0% [3] 103800(18.9%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 ??? [13] 93.8% hash-ref! [164] 4.9% simplify [22] 1.3% --------------------------------------------------------------------------------- hash-ref! [164] 100.0% [4] 99042(18.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 ??? [13] 58.3% hash-ref! [164] 40.0% simplify [22] 1.8% --------------------------------------------------------------------------------- hash-ref! [164] 100.0% [5] 33740(6.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [158] 90.0% hash-ref! [164] 10.0% --------------------------------------------------------------------------------- loop [186] 100.0% [6] 4202(0.8%) 2227(0.4%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [186] 27.0% ??? [90] 13.4% eval-const-expr [18] 6.6% --------------------------------------------------------------------------------- taylor [208] 100.0% [7] 2538(0.5%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 normalize-series [16] 89.0% simplify [22] 11.0% --------------------------------------------------------------------------------- loop [186] 33.6% gather-additive-terms [196] 66.4% [8] 2526(0.5%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [17] 100.0% --------------------------------------------------------------------------------- hash-ref! [164] 100.0% [9] 287(0.1%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 normalize-series [16] 100.0% --------------------------------------------------------------------------------- loop [186] 100.0% [10] 281(0.1%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 normalize-series [16] 100.0% --------------------------------------------------------------------------------- ??? [1] 100.0% [11] 549632(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [20] 100.0% --------------------------------------------------------------------------------- option-on-expr [2] 100.0% [12] 157016(28.6%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [21] 100.0% --------------------------------------------------------------------------------- ??? [3] 41.4% ??? [4] 58.6% [13] 98750(18.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [164] 100.0% --------------------------------------------------------------------------------- option-on-expr [2] 100.0% [14] 6585(1.2%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [23] 100.0% --------------------------------------------------------------------------------- option-on-expr [2] 100.0% [15] 5234(1.0%) 2200(0.4%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [25] 31.6% check-list [244] 21.1% range [27] 5.3% --------------------------------------------------------------------------------- taylor-sqrt [10] 7.7% taylor-quotient [9] 7.8% taylor [208] 23.0% taylor-invert [7] 61.5% [16] 3670(0.7%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [164] 84.6% simplify [22] 15.4% --------------------------------------------------------------------------------- make-multiplication-node [8] 100.0% [17] 2526(0.5%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubnode [24] 66.6% group-by [26] 33.4% --------------------------------------------------------------------------------- set-precompute! [6] 100.0% [18] 278(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f8 [157] 100.0% --------------------------------------------------------------------------------- option-on-expr [2] 100.0% [19] 262(0.0%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [183] 100.0% --------------------------------------------------------------------------------- profile-thunk [11] 100.0% [20] 549632(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [28] 100.0% --------------------------------------------------------------------------------- f8 [157] 0.0% loop [21] 48.1% sindices->spoints [12] 51.9% [21] 157294(28.6%) 0(0.0%) loop .../private/map.rkt:54:19 sidx->spoint [29] 51.9% loop [21] 48.1% ulp-difference [141] 0.0% --------------------------------------------------------------------------------- taylor-invert [7] 0.3% ??? [170] 0.3% loop [186] 0.3% normalize-series [16] 0.5% ??? [172] 0.5% ??? [3] 1.3% ??? [4] 2.8% hash-ref! [164] 92.0% [22] 108310(19.7%) 284(0.1%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [157] 95.0% debug-print [224] 2.6% debug [65] 1.3% simplify-node [31] 0.5% loop [33] 0.3% --------------------------------------------------------------------------------- sort-context-on-expr [14] 100.0% [23] 6585(1.2%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [30] 100.0% --------------------------------------------------------------------------------- make-multiplication-subnode [17] 100.0% [24] 1682(0.3%) 0(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 make-multiplication-subsubsubnode [32] 83.7% partition [34] 16.3% --------------------------------------------------------------------------------- err-lsts->split-indices [15] 100.0% [25] 1652(0.3%) 1652(0.3%) ??? ...e/racket/collects/racket/function.rkt:93:12 --------------------------------------------------------------------------------- make-multiplication-subnode [17] 100.0% [26] 844(0.2%) 278(0.1%) group-by .../racket/collects/racket/list.rkt:816:0 sort [217] 34.2% do-hash-update [97] 32.8% --------------------------------------------------------------------------------- err-lsts->split-indices [15] 100.0% [27] 276(0.1%) 276(0.1%) range ...are/racket/collects/racket/list.rkt:571:6 --------------------------------------------------------------------------------- ??? [20] 100.0% [28] 549632(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [35] 97.7% prepare-points [49] 2.3% --------------------------------------------------------------------------------- loop [21] 100.0% [29] 157016(28.6%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [36] 100.0% --------------------------------------------------------------------------------- ??? [23] 100.0% [30] 6585(1.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [37] 87.4% ??? [184] 8.4% ...row-higher-order.rkt:375:33 [143] 4.2% --------------------------------------------------------------------------------- simplify [22] 7.4% gather-additive-terms [196] 9.9% loop [186] 82.7% [31] 5592(1.0%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 gather-additive-terms [196] 44.8% combine-mterms [38] 27.6% combine-aterms [40] 19.9% gather-multiplicative-terms [41] 7.6% --------------------------------------------------------------------------------- make-multiplication-subsubsubnode [32] 29.7% make-multiplication-subsubnode [24] 70.3% [32] 1407(0.3%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [39] 70.3% make-multiplication-subsubsubnode [32] 29.7% --------------------------------------------------------------------------------- simplify [22] 20.0% loop [33] 80.0% [33] 288(0.1%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 loop [33] 80.0% expression->type [45] 20.0% --------------------------------------------------------------------------------- make-multiplication-subsubnode [24] 100.0% [34] 275(0.1%) 0(0.0%) partition ...racket/collects/racket/list.rkt:556:0 reverse [223] 100.0% --------------------------------------------------------------------------------- ??? [28] 100.0% [35] 536860(97.7%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [42] 66.1% get-final-combination [43] 33.6% setup-alt-simplified [46] 0.1% --------------------------------------------------------------------------------- sidx->spoint [29] 100.0% [36] 157016(28.6%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [44] 100.0% --------------------------------------------------------------------------------- generic-sort/key [30] 38.3% copying-mergesort [37] 61.7% [37] 5758(1.0%) 244(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [37] 61.7% ??? [184] 34.8% ...row-higher-order.rkt:375:33 [143] 2.4% --------------------------------------------------------------------------------- simplify-node [31] 100.0% [38] 1962(0.4%) 555(0.1%) combine-mterms ...esting/src/core/reduce.rkt:191:0 hash-ref! [164] 57.4% reverse [223] 14.3% --------------------------------------------------------------------------------- make-multiplication-subsubsubnode [32]100.0% [39] 1407(0.3%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 expression->type [45] 39.8% free-variables [197] 39.5% f8 [157] 20.7% --------------------------------------------------------------------------------- simplify-node [31] 100.0% [40] 1116(0.2%) 0(0.0%) combine-aterms ...esting/src/core/reduce.rkt:183:0 hash-ref! [164] 75.0% reverse [223] 25.0% --------------------------------------------------------------------------------- loop [186] 25.4% simplify-node [31] 74.6% [41] 563(0.1%) 286(0.1%) gather-multiplicative-terms ...re/reduce.rkt:116:0 loop [186] 74.6% --------------------------------------------------------------------------------- run-improve [35] 100.0% [42] 355087(64.6%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [47] 63.5% gen-series! [50] 31.1% finalize-iter! [51] 3.7% choose-best-alt! [52] 0.9% gen-rewrites! [53] 0.6% localize! [54] 0.2% --------------------------------------------------------------------------------- run-improve [35] 100.0% [43] 180366(32.8%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [48] 99.8% loop [186] 0.2% --------------------------------------------------------------------------------- binary-search-floats [36] 100.0% [44] 157016(28.6%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [49] 90.1% errors [132] 9.7% ...row-higher-order.rkt:375:33 [143] 0.2% --------------------------------------------------------------------------------- loop [33] 6.3% f8 [157] 12.8% expression->type [45] 31.8% mterm->expr [39] 49.1% [45] 1140(0.2%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 ??? [106] 49.1% expression->type [45] 31.8% f8 [157] 19.1% --------------------------------------------------------------------------------- run-improve [35] 100.0% [46] 280(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [55] 100.0% --------------------------------------------------------------------------------- run-iter! [42] 100.0% [47] 225578(41.0%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [56] 100.0% --------------------------------------------------------------------------------- get-final-combination [43] 100.0% [48] 180086(32.8%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [157] 99.8% ??? [106] 0.2% --------------------------------------------------------------------------------- ??? [28] 8.2% pred [44] 91.1% [49] 155404(28.3%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 make-exacts* [63] 82.4% loop [64] 12.2% make-exacts [58] 3.8% ??? [60] 0.9% debug-print [224] 0.7% --------------------------------------------------------------------------------- run-iter! [42] 100.0% [50] 110282(20.1%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [57] 100.0% --------------------------------------------------------------------------------- run-iter! [42] 100.0% [51] 13070(2.4%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [106] 100.0% --------------------------------------------------------------------------------- run-iter! [42] 100.0% [52] 3340(0.6%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [106] 100.0% --------------------------------------------------------------------------------- run-iter! [42] 100.0% [53] 2258(0.4%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [59] 100.0% --------------------------------------------------------------------------------- run-iter! [42] 100.0% [54] 559(0.1%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [61] 100.0% --------------------------------------------------------------------------------- setup-alt-simplified [46] 100.0% [55] 280(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [62] 100.0% --------------------------------------------------------------------------------- simplify! [47] 100.0% [56] 225578(41.0%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [62] 100.0% --------------------------------------------------------------------------------- gen-series! [50] 100.0% [57] 110282(20.1%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [143] 100.0% --------------------------------------------------------------------------------- prepare-points [49] 100.0% [58] 5910(1.1%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [64] 61.9% make-exacts* [63] 33.3% debug [65] 4.8% --------------------------------------------------------------------------------- gen-rewrites! [53] 100.0% [59] 2258(0.4%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [66] 87.6% rewrite-expression-head [67] 12.4% --------------------------------------------------------------------------------- prepare-points [49] 100.0% [60] 1398(0.3%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ...row-higher-order.rkt:375:33 [143] 80.4% range-table-ref [68] 19.6% --------------------------------------------------------------------------------- localize! [54] 100.0% [61] 559(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [164] 100.0% --------------------------------------------------------------------------------- simplify-alt [55] 0.1% ??? [56] 99.9% [62] 225858(41.1%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [69] 100.0% --------------------------------------------------------------------------------- make-exacts [58] 1.5% prepare-points [49] 98.5% [63] 129972(23.6%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [139] 100.0% --------------------------------------------------------------------------------- make-exacts [58] 16.2% prepare-points [49] 83.8% [64] 22636(4.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [186] 97.6% debug-print [224] 2.4% --------------------------------------------------------------------------------- make-exacts [58] 12.5% taylor [208] 24.8% simplify [22] 62.8% [65] 2262(0.4%) 849(0.2%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [72] 37.5% get-setting [77] 12.6% assoc-ref [174] 12.4% --------------------------------------------------------------------------------- alt-rewrite-rm [59] 25.5% matcher [70] 74.5% [66] 1978(0.4%) 284(0.1%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [70] 74.5% *rules* [71] 22.6% --------------------------------------------------------------------------------- alt-rewrite-rm [59] 100.0% [67] 280(0.1%) 0(0.0%) rewrite-expression-head .../core/matcher.rkt:128:0 f8 [157] 100.0% --------------------------------------------------------------------------------- ??? [60] 100.0% [68] 274(0.0%) 274(0.0%) range-table-ref ...ng/src/range-analysis.rkt:182:0 --------------------------------------------------------------------------------- simplify [62] 100.0% [69] 225858(41.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [73] 92.5% loop [74] 7.0% mk-egraph [76] 0.4% debug-print [224] 0.1% --------------------------------------------------------------------------------- rewriter [66] 49.4% matcher [70] 50.6% [70] 1978(0.4%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [70] 50.6% rewriter [66] 49.4% --------------------------------------------------------------------------------- rewriter [66] 100.0% [71] 1694(0.3%) 566(0.1%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [75] 66.6% --------------------------------------------------------------------------------- debug [65] 100.0% [72] 850(0.2%) 282(0.1%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 get-setting [77] 33.7% hash-ref! [164] 33.2% --------------------------------------------------------------------------------- ??? [69] 100.0% [73] 208857(38.0%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [78] 98.0% loop [186] 2.0% --------------------------------------------------------------------------------- ??? [69] 100.0% [74] 15894(2.9%) 1134(0.2%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [79] 57.9% loop [80] 35.0% --------------------------------------------------------------------------------- *rules* [71] 100.0% [75] 1128(0.2%) 848(0.2%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ...sting/src/common.rkt:47:2 [159] 24.9% --------------------------------------------------------------------------------- ??? [69] 100.0% [76] 822(0.1%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [81] 100.0% --------------------------------------------------------------------------------- debug [65] 49.9% cur-debug-level [72] 50.1% [77] 570(0.1%) 284(0.1%) get-setting ...rbie/alt-testing/src/debug.rkt:96:0 ??? [106] 50.1% --------------------------------------------------------------------------------- iterate-egraph! [73] 100.0% [78] 204655(37.2%) 5325(1.0%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [82] 38.4% merge-egraph-nodes! [83] 15.2% loop! [192] 10.4% custom-set-member? [84] 9.4% mk-enode! [87] 9.3% substitute-e [85] 8.8% update-leader! [88] 3.6% filter [177] 0.7% reverse [223] 0.6% set-union [210] 0.4% pack-leader [234] 0.3% list-member? [162] 0.1% ??? [94] 0.1% --------------------------------------------------------------------------------- loop [74] 100.0% [79] 9197(1.7%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [86] 100.0% --------------------------------------------------------------------------------- loop [74] 100.0% [80] 5563(1.0%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [86] 100.0% --------------------------------------------------------------------------------- mk-egraph [76] 29.1% loop [186] 70.9% [81] 822(0.1%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [186] 100.0% --------------------------------------------------------------------------------- match-e [82] 23.7% one-iter [78] 76.3% [82] 78640(14.3%) 26596(4.8%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [82] 23.7% ??? [90] 7.3% loop [186] 6.2% reverse [223] 5.7% ??? [106] 5.2% make-sequence [233] 4.1% variable? [89] 3.9% do-procedure-reduce-keyword-arity [98] 3.5% list-cartesian-product [91] 3.2% set-union [210] 1.4% pack-leader [234] 1.2% filter [177] 1.1% check-list [244] 0.5% make-curried [95] 0.5% ??? [94] 0.5% --------------------------------------------------------------------------------- merge-egraph-nodes! [83] 5.0% one-iter [78] 95.0% [83] 31089(5.7%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [88] 74.3% loop! [192] 13.5% enode-merge! [92] 6.3% merge-egraph-nodes! [83] 5.0% make-sequence [233] 0.9% --------------------------------------------------------------------------------- one-iter [78] 100.0% [84] 19317(3.5%) 18474(3.4%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [93] 4.4% --------------------------------------------------------------------------------- substitute-e [85] 9.9% one-iter [78] 90.1% [85] 17982(3.3%) 280(0.1%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [87] 81.3% substitute-e [85] 9.9% ??? [106] 2.9% variable? [89] 2.6% reverse [223] 0.8% assoc [229] 0.5% --------------------------------------------------------------------------------- loop [80] 37.7% mk-min [79] 62.3% [86] 14760(2.7%) 1110(0.2%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [107] 60.5% ...sting/src/common.rkt:47:2 [159] 24.4% compile [144] 3.8% ??? [108] 1.9% --------------------------------------------------------------------------------- loop [186] 2.4% substitute-e [85] 42.4% one-iter [78] 55.2% [87] 34430(6.3%) 1970(0.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [96] 90.2% hash-has-key? [109] 3.2% loop [186] 0.8% --------------------------------------------------------------------------------- one-iter [78] 23.0% merge-egraph-nodes! [83] 77.0% [88] 31646(5.8%) 7850(1.4%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [97] 70.8% update-en-expr [225] 1.8% reverse [223] 0.9% --------------------------------------------------------------------------------- free-variables [197] 9.1% substitute-e [85] 12.2% match-e [82] 78.7% [89] 9226(1.7%) 272(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [106] 97.1% --------------------------------------------------------------------------------- set-precompute! [6] 8.0% match-e [82] 92.0% [90] 7018(1.3%) 284(0.1%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [99] 55.8% do-procedure-reduce-keyword-arity [98] 40.1% --------------------------------------------------------------------------------- list-cartesian-product [91] 19.9% match-e [82] 80.1% [91] 2786(0.5%) 2232(0.4%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [91] 19.9% make-sequence [233] 19.9% --------------------------------------------------------------------------------- merge-egraph-nodes! [83] 100.0% [92] 1966(0.4%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [100] 57.0% adopt-enode! [101] 43.0% --------------------------------------------------------------------------------- custom-set-member? [84] 100.0% [93] 842(0.2%) 842(0.2%) set-check-elem ...cket/private/set-types.rkt:329:0 --------------------------------------------------------------------------------- one-iter [78] 33.5% match-e [82] 66.5% [94] 840(0.2%) 560(0.1%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 make-sequence [233] 33.2% --------------------------------------------------------------------------------- match-e [82] 100.0% [95] 566(0.1%) 280(0.1%) make-curried ...collects/racket/function.rkt:130:9 make-keyword-procedure [136] 50.4% --------------------------------------------------------------------------------- mk-enode! [87] 100.0% [96] 31066(5.7%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [102] 100.0% --------------------------------------------------------------------------------- group-by [26] 1.2% update-leader! [88] 98.8% [97] 22682(4.1%) 277(0.1%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [103] 98.8% --------------------------------------------------------------------------------- ??? [90] 42.1% match-e [82] 57.9% [98] 6693(1.2%) 5854(1.1%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [104] 12.5% --------------------------------------------------------------------------------- ??? [90] 100.0% [99] 3919(0.7%) 2249(0.4%) do-curry ...cket/collects/racket/function.rkt:71:2 procedure-keywords [104] 28.3% make-keyword-procedure [136] 14.3% --------------------------------------------------------------------------------- enode-merge! [92] 100.0% [100] 1120(0.2%) 1120(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 --------------------------------------------------------------------------------- enode-merge! [92] 100.0% [101] 846(0.2%) 0(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [205] 100.0% --------------------------------------------------------------------------------- new-enode [96] 100.0% [102] 31066(5.7%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [105] 100.0% --------------------------------------------------------------------------------- do-hash-update [97] 100.0% [103] 22406(4.1%) 18194(3.3%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [225] 11.3% reverse [223] 6.2% make-sequence [233] 1.2% --------------------------------------------------------------------------------- do-procedure-reduce-keyword-arity [98] 43.1% do-curry [99] 56.9% [104] 1948(0.4%) 1948(0.4%) procedure-keywords .../racket/private/kw.rkt:534:2 --------------------------------------------------------------------------------- type-of-enode-expr [102] 100.0% [105] 31066(5.7%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [107] 47.8% ??? [108] 27.9% ...sting/src/common.rkt:47:2 [159] 13.4% ??? [106] 10.8% --------------------------------------------------------------------------------- gather-additive-terms [196] 0.6% split-table [48] 0.6% get-setting [77] 0.6% pattern-match [216] 1.2% expression->type [45] 1.2% f8 [157] 1.8% substitute-e [85] 2.4% free-variables [197] 3.0% ??? [207] 4.7% choose-best-alt! [52] 7.2% get-sigs [105] 7.2% variable? [89] 19.2% match-e [82] 22.3% finalize-iter! [51] 28.0% [106] 46656(8.5%) 2529(0.5%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [109] 58.2% atab-add-altns [110] 28.0% atab-pick-alt [112] 7.2% ??? [207] 0.6% split-atab [113] 0.6% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [143] 7.5% expression-cost [86] 34.7% get-sigs [105] 57.8% [107] 25724(4.7%) 5308(1.0%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [116] 65.3% reverse [223] 4.4% ...sting/src/common.rkt:47:2 [159] 4.3% check-list [244] 2.2% set-union [210] 2.1% dict? [228] 1.1% --------------------------------------------------------------------------------- expression-cost [86] 3.0% ->bf [156] 3.0% get-sigs [105] 94.0% [108] 9220(1.7%) 278(0.1%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [111] 73.0% get/build-late-neg-projection [140] 9.1% handle-the-hash [125] 8.9% ??? [114] 3.0% ??? [115] 3.0% --------------------------------------------------------------------------------- mk-enode! [87] 3.9% ??? [106] 96.1% [109] 28266(5.1%) 22692(4.1%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [116] 19.7% --------------------------------------------------------------------------------- ??? [106] 100.0% [110] 13070(2.4%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [117] 100.0% --------------------------------------------------------------------------------- ??? [108] 100.0% [111] 6730(1.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [118] 100.0% --------------------------------------------------------------------------------- ??? [106] 100.0% [112] 3340(0.6%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [119] 58.3% ...row-higher-order.rkt:375:33 [143] 33.3% write-json* [120] 8.4% --------------------------------------------------------------------------------- ??? [106] 100.0% [113] 280(0.1%) 0(0.0%) split-atab ...testing/src/core/alt-table.rkt:105:0 filter [177] 100.0% --------------------------------------------------------------------------------- ??? [108] 100.0% [114] 278(0.1%) 0(0.0%) ??? ...cts/racket/contract/private/guts.rkt:889:10 ??? [121] 100.0% --------------------------------------------------------------------------------- ??? [108] 100.0% [115] 274(0.0%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [122] 100.0% --------------------------------------------------------------------------------- hash-has-key? [109] 24.9% table-ref [107] 75.1% [116] 22370(4.1%) 11182(2.0%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [124] 31.3% handle-the-hash [125] 13.7% do-chaperone-procedure [127] 3.8% ??? [193] 1.3% --------------------------------------------------------------------------------- atab-add-altns [110] 100.0% [117] 13070(2.4%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [123] 95.7% override-at-pnts [128] 4.3% --------------------------------------------------------------------------------- ??? [111] 100.0% [118] 6730(1.2%) 3372(0.6%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [126] 45.8% ??? [131] 4.1% --------------------------------------------------------------------------------- atab-pick-alt [112] 100.0% [119] 1948(0.4%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [186] 100.0% --------------------------------------------------------------------------------- atab-pick-alt [112] 100.0% [120] 280(0.1%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [129] 100.0% --------------------------------------------------------------------------------- ??? [114] 100.0% [121] 278(0.1%) 0(0.0%) ??? ...ntract/private/arrow-higher-order.rkt:575:2 build-subcontract-late-negs [130] 100.0% --------------------------------------------------------------------------------- ??? [115] 100.0% [122] 274(0.0%) 274(0.0%) check-hash/c ...ket/contract/private/hash.rkt:86:0 --------------------------------------------------------------------------------- atab-add-altn [117] 100.0% [123] 12513(2.3%) 275(0.1%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [132] 97.8% --------------------------------------------------------------------------------- ??? [116] 100.0% [124] 7000(1.3%) 2804(0.5%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [134] 28.0% blame-add-missing-party [135] 20.3% make-keyword-procedure [136] 7.8% update-the-info [138] 3.9% --------------------------------------------------------------------------------- ??? [108] 21.1% ??? [116] 78.9% [125] 3886(0.7%) 271(0.0%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [193] 86.1% ??? [231] 7.0% --------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [118] 100.0% [126] 3082(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [133] 100.0% --------------------------------------------------------------------------------- ??? [116] 100.0% [127] 840(0.2%) 282(0.1%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [137] 66.4% --------------------------------------------------------------------------------- atab-add-altn [117] 100.0% [128] 556(0.1%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [132] 100.0% --------------------------------------------------------------------------------- write-json* [120] 25.0% loop [129] 75.0% [129] 280(0.1%) 280(0.1%) loop .../share/racket/collects/json/main.rkt:132:2 loop [129] 75.0% --------------------------------------------------------------------------------- ??? [121] 100.0% [130] 278(0.1%) 278(0.1%) build-subcontract-late-negs ...her-order.rkt:711:0 --------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [118] 100.0% [131] 277(0.1%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:44 do-blame-add-context [142] 100.0% --------------------------------------------------------------------------------- override-at-pnts [128] 1.3% composed [166] 3.3% best-and-tied-at-points [123] 29.3% loop [186] 29.6% pred [44] 36.5% [132] 41808(7.6%) 272(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [184] 47.7% eval-prog [139] 47.1% ...row-higher-order.rkt:375:33 [143] 2.5% ulp-difference [141] 2.0% --------------------------------------------------------------------------------- ??? [126] 100.0% [133] 3082(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [140] 81.7% check-list [244] 9.2% do-blame-add-context [142] 9.1% --------------------------------------------------------------------------------- loop [134] 33.9% ??? [124] 66.1% [134] 1960(0.4%) 1960(0.4%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [134] 33.9% --------------------------------------------------------------------------------- ??? [124] 100.0% [135] 1419(0.3%) 1419(0.3%) blame-add-missing-party ...private/blame.rkt:382:0 --------------------------------------------------------------------------------- make-curried [95] 20.5% ??? [124] 39.1% do-curry [99] 40.4% [136] 1390(0.3%) 1390(0.3%) make-keyword-procedure ...ket/private/kw.rkt:448:4 --------------------------------------------------------------------------------- do-chaperone-procedure [127] 100.0% [137] 558(0.1%) 558(0.1%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 --------------------------------------------------------------------------------- ??? [124] 100.0% [138] 274(0.0%) 274(0.0%) update-the-info ...ontract/private/blame.rkt:318:0 --------------------------------------------------------------------------------- errors [132] 13.1% make-exacts* [63] 86.7% [139] 149944(27.3%) 25462(4.6%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [144] 78.4% f8 [157] 3.9% ??? [147] 0.4% ...row-higher-order.rkt:375:33 [143] 0.4% --------------------------------------------------------------------------------- ??? [146] 12.5% ??? [108] 12.5% ??? [133] 75.0% [140] 3354(0.6%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [145] 87.5% ??? [146] 12.5% --------------------------------------------------------------------------------- loop [21] 25.1% errors [132] 74.9% [141] 1106(0.2%) 832(0.2%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 ...sting/src/common.rkt:47:2 [159] 24.8% --------------------------------------------------------------------------------- ??? [131] 49.7% ??? [133] 50.3% [142] 558(0.1%) 558(0.1%) do-blame-add-context ...ct/private/blame.rkt:192:0 --------------------------------------------------------------------------------- pred [44] 0.2% generic-sort/key [30] 0.2% copying-mergesort [37] 0.2% eval-prog [139] 0.4% errors [132] 0.8% atab-pick-alt [112] 0.8% ??? [60] 0.8% f8 [157] 4.2% loop [186] 9.7% loop [148] 41.3% taylor-alt [57] 41.3% [143] 133424(24.3%) 1968(0.4%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 loop [148] 41.3% approximate [149] 41.3% ->flonum [150] 6.8% real->bigfloat [151] 2.6% ??? [207] 1.7% table-ref [107] 1.4% ...sting/src/common.rkt:47:2 [159] 1.3% sample-multi-bounded [153] 0.8% best-alt [154] 0.8% ->bf [156] 0.2% --------------------------------------------------------------------------------- expression-cost [86] 0.5% eval-prog [139] 99.5% [144] 118108(21.5%) 266(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [164] 99.8% --------------------------------------------------------------------------------- get/build-late-neg-projection [140] 100.0% [145] 3354(0.6%) 1119(0.2%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [152] 58.3% reverse [223] 8.3% --------------------------------------------------------------------------------- get/build-late-neg-projection [140] 100.0% [146] 838(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [140] 100.0% --------------------------------------------------------------------------------- eval-prog [139] 100.0% [147] 556(0.1%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [155] 100.0% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [143] 27.0% loop [148] 73.0% [148] 110282(20.1%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [148] 73.0% ...row-higher-order.rkt:375:33 [143] 27.0% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [143] 100.0% [149] 110282(20.1%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [158] 68.1% hash-ref! [164] 30.6% taylor [208] 1.0% f8 [157] 0.3% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [143] 100.0% [150] 9108(1.7%) 3864(0.7%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [173] 33.1% ...sting/src/common.rkt:47:2 [159] 15.3% list-member? [162] 6.2% set-union [210] 3.0% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [143] 100.0% [151] 3461(0.6%) 1116(0.2%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [226] 59.7% ??? [232] 8.1% --------------------------------------------------------------------------------- contract-struct-name [161] 14.2% ??? [145] 85.8% [152] 1957(0.4%) 558(0.1%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [161] 56.7% check-list [244] 29.0% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [143] 100.0% [153] 1124(0.2%) 283(0.1%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [163] 74.8% --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [143] 100.0% [154] 1112(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [160] 100.0% --------------------------------------------------------------------------------- ??? [147] 100.0% [155] 556(0.1%) 556(0.1%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 --------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [143] 100.0% [156] 278(0.1%) 0(0.0%) ->bf ...s/herbie/alt-testing/src/programs.rkt:53:0 ??? [108] 100.0% --------------------------------------------------------------------------------- rewrite-expression-head [67] 0.0% approximate [149] 0.0% mterm->expr [39] 0.0% eval-const-expr [18] 0.1% expression->type [45] 0.1% composed [166] 0.1% hash-ref! [164] 0.2% taylor [208] 0.2% eval-prog [139] 0.5% simplify [22] 13.2% loop [186] 23.7% split-table [48] 61.7% [157] 285845(52.0%) 85272(15.5%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [186] 87.2% ...row-higher-order.rkt:375:33 [143] 0.5% taylor [208] 0.2% ??? [106] 0.2% composed [166] 0.1% expression->type [45] 0.0% loop [21] 0.0% --------------------------------------------------------------------------------- ??? [5] 31.0% approximate [149] 69.0% [158] 108870(19.8%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [164] 100.0% --------------------------------------------------------------------------------- ulp-difference [141] 2.1% simplify* [194] 2.2% flag-set? [75] 2.2% ??? [167] 4.4% table-ref [107] 8.7% ->flonum [150] 10.9% ...row-higher-order.rkt:375:33 [143] 13.2% expression-cost [86] 24.9% get-sigs [105] 31.5% [159] 12809(2.3%) 3611(0.7%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [165] 49.9% ??? [167] 17.4% ??? [207] 5.5% dict-key-contract [168] 2.2% --------------------------------------------------------------------------------- extract-alt [203] 20.1% best-alt [154] 79.9% [160] 1392(0.3%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [166] 100.0% --------------------------------------------------------------------------------- build-compound-type-name [152] 100.0% [161] 1389(0.3%) 561(0.1%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [152] 40.1% reverse [223] 19.5% --------------------------------------------------------------------------------- one-iter [78] 33.3% ->flonum [150] 66.7% [162] 843(0.2%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [178] 100.0% --------------------------------------------------------------------------------- random-exp [163] 50.0% sample-multi-bounded [153] 50.0% [163] 841(0.2%) 841(0.2%) random-exp ...bie/alt-testing/src/common.rkt:253:0 random-exp [163] 50.0% --------------------------------------------------------------------------------- combine-aterms [40] 0.0% combine-mterms [38] 0.1% localize-error [61] 0.1% cur-debug-level [72] 0.1% composed [198] 0.2% simplify* [194] 0.2% normalize-series [16] 0.4% ??? [3] 0.4% ??? [5] 0.5% approximate [149] 2.7% ??? [172] 3.6% ??? [4] 4.7% ??? [158] 6.1% ??? [170] 10.1% ??? [13] 16.5% compile [144] 22.0% loop [186] 29.7% [164] 227834(41.5%) 6458(1.2%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [171] 29.7% bigfloat-hash [169] 21.8% ??? [4] 16.8% ??? [170] 10.1% ??? [3] 5.3% simplify [22] 5.1% ??? [172] 3.7% ??? [5] 3.2% taylor [208] 0.7% f8 [157] 0.2% taylor-quotient [9] 0.0% --------------------------------------------------------------------------------- ??? [193] 24.0% ...sting/src/common.rkt:47:2 [159] 76.0% [165] 6398(1.2%) 840(0.2%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [193] 67.3% ??? [207] 21.8% --------------------------------------------------------------------------------- argmins [160] 31.0% f8 [157] 69.0% [166] 4484(0.8%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 f8 [157] 62.7% errors [132] 31.0% loop [175] 6.3% --------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [159] 100.0% [167] 2790(0.5%) 1114(0.2%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 ...sting/src/common.rkt:47:2 [159] 40.1% return/no-unsupplied [173] 10.0% assoc-ref [174] 10.0% --------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [159] 100.0% [168] 284(0.1%) 284(0.1%) dict-key-contract ...collects/racket/dict.rkt:71:0 --------------------------------------------------------------------------------- hash-ref! [164] 100.0% [169] 117008(21.3%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [176] 100.0% --------------------------------------------------------------------------------- hash-ref! [164] 100.0% [170] 96264(17.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [164] 99.9% simplify [22] 0.1% --------------------------------------------------------------------------------- hash-ref! [164] 100.0% [171] 92466(16.8%) 275(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [186] 99.9% --------------------------------------------------------------------------------- hash-ref! [164] 100.0% [172] 83592(15.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 hash-ref! [164] 99.0% simplify [22] 0.7% composed [198] 0.3% --------------------------------------------------------------------------------- ??? [167] 6.8% simplify* [194] 20.2% ->flonum [150] 73.0% [173] 4128(0.8%) 1106(0.2%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [177] 60.6% reverse [223] 12.6% --------------------------------------------------------------------------------- ??? [167] 49.9% debug [65] 50.1% [174] 558(0.1%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [229] 100.0% --------------------------------------------------------------------------------- composed [166] 33.3% loop [175] 66.7% [175] 282(0.1%) 0(0.0%) loop ...are/racket/collects/racket/list.rkt:418:34 loop [175] 66.7% member [178] 33.3% --------------------------------------------------------------------------------- bigfloat-hash [169] 100.0% [176] 117008(21.3%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [179] 99.5% bigfloat->sig+exp [180] 0.5% --------------------------------------------------------------------------------- split-atab [113] 5.6% match-e [82] 16.8% one-iter [78] 27.7% return/no-unsupplied [173] 50.0% [177] 5006(0.9%) 4726(0.9%) filter ...t/collects/racket/private/list.rkt:275:2 ??? [181] 5.6% --------------------------------------------------------------------------------- loop [175] 25.1% list-member? [162] 74.9% [178] 1126(0.2%) 1126(0.2%) member ...collects/racket/private/member.rkt:13:21 --------------------------------------------------------------------------------- bfcanonicalize [176] 100.0% [179] 116454(21.2%) 116454(21.2%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 --------------------------------------------------------------------------------- bfcanonicalize [176] 100.0% [180] 554(0.1%) 0(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:389:0 mpz->integer [182] 100.0% --------------------------------------------------------------------------------- filter [177] 100.0% [181] 280(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:302:4 ??? [183] 100.0% --------------------------------------------------------------------------------- bigfloat->sig+exp [180] 100.0% [182] 554(0.1%) 277(0.1%) mpz->integer ...ath/private/bigfloat/gmp.rkt:115:0 size+limbs->integer [185] 50.0% --------------------------------------------------------------------------------- pick-errors [19] 48.3% ??? [181] 51.7% [183] 542(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [184] 100.0% --------------------------------------------------------------------------------- ??? [183] 1.2% generic-sort/key [30] 1.2% copying-mergesort [37] 11.2% errors [132] 42.7% loop [186] 43.7% [184] 46702(8.5%) 22291(4.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [186] 25.3% bf* [187] 8.1% ??? [195] 6.2% ??? [188] 4.8% ??? [189] 3.0% ??? [190] 2.5% ??? [191] 1.9% ??? [231] 0.6% --------------------------------------------------------------------------------- mpz->integer [182] 100.0% [185] 278(0.1%) 278(0.1%) size+limbs->integer ...vate/bigfloat/gmp.rkt:103:0 --------------------------------------------------------------------------------- set-precompute! [6] 0.0% get-final-combination [43] 0.0% gather-multiplicative-terms [41] 0.0% iterate-egraph! [73] 0.1% mk-enode! [87] 0.1% point-best-alt [119] 0.2% mk-enode-rec! [81] 0.2% option-on-expr [2] 0.2% loop [64] 0.3% gather-additive-terms [196] 0.3% ??? [184] 0.6% loop! [192] 0.6% taylor [208] 0.8% match-e [82] 1.5% ??? [171] 5.7% f8 [157] 22.0% loop [186] 67.2% [186] 317778(57.8%) 5608(1.0%) loop .../private/map.rkt:40:19 loop [186] 67.2% f8 [157] 16.8% hash-ref! [164] 5.7% option-on-expr [2] 4.3% loop! [192] 0.6% ...row-higher-order.rkt:375:33 [143] 0.6% taylor [208] 0.6% simplify* [194] 0.5% errors [132] 0.4% gather-additive-terms [196] 0.3% composed [198] 0.3% keyword-apply [202] 0.3% foldl [199] 0.2% simplify-node [31] 0.2% step [200] 0.2% ??? [184] 0.2% mk-enode-rec! [81] 0.1% free-variables [197] 0.1% mk-enode! [87] 0.1% set-precompute! [6] 0.1% make-multiplication-node [8] 0.0% simplify [22] 0.0% ??? [201] 0.0% gather-multiplicative-terms [41] 0.0% extract-alt [203] 0.0% taylor-sqrt [10] 0.0% make-addition-node [204] 0.0% --------------------------------------------------------------------------------- ??? [184] 100.0% [187] 3779(0.7%) 276(0.1%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [195] 92.7% --------------------------------------------------------------------------------- ??? [184] 100.0% [188] 2222(0.4%) 2222(0.4%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 --------------------------------------------------------------------------------- ??? [184] 100.0% [189] 1396(0.3%) 1396(0.3%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 --------------------------------------------------------------------------------- ??? [184] 100.0% [190] 1175(0.2%) 1175(0.2%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 --------------------------------------------------------------------------------- ??? [184] 100.0% [191] 875(0.2%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [193] 100.0% --------------------------------------------------------------------------------- merge-egraph-nodes! [83] 14.0% loop [186] 27.5% one-iter [78] 58.5% [192] 25769(4.7%) 2508(0.5%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [205] 43.5% loop [186] 27.5% make-immutable-set [206] 15.2% ??? [211] 6.9% set-union [210] 1.6% --------------------------------------------------------------------------------- ??? [116] 2.7% ??? [191] 8.5% handle-the-hash [125] 32.3% ??? [165] 56.5% [193] 10344(1.9%) 3340(0.6%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [212] 32.3% ??? [165] 29.7% ??? [207] 5.7% --------------------------------------------------------------------------------- loop [186] 100.0% [194] 6741(1.2%) 1412(0.3%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [164] 54.2% return/no-unsupplied [173] 12.4% ??? [219] 4.2% ...sting/src/common.rkt:47:2 [159] 4.1% get-evaluator [221] 4.1% --------------------------------------------------------------------------------- ??? [184] 45.1% bf* [187] 54.9% [195] 6376(1.2%) 280(0.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [209] 68.2% ^TYPE? [214] 14.2% bfsqrt [215] 13.3% --------------------------------------------------------------------------------- simplify-node [31] 20.3% gather-additive-terms [196] 36.1% loop [186] 43.6% [196] 3064(0.6%) 0(0.0%) gather-additive-terms .../src/core/reduce.rkt:72:0 loop [186] 43.6% gather-additive-terms [196] 36.1% simplify-node [31] 12.7% make-multiplication-node [8] 5.9% ??? [106] 1.8% --------------------------------------------------------------------------------- mterm->expr [39] 22.1% loop [186] 77.9% [197] 2517(0.5%) 280(0.1%) free-variables ...t-testing/src/programs.rkt:102:0 ??? [106] 55.4% variable? [89] 33.5% --------------------------------------------------------------------------------- ??? [172] 14.6% loop [186] 85.4% [198] 1972(0.4%) 287(0.1%) composed ...ollects/racket/private/list.rkt:341:16 taylor [208] 57.1% hash-ref! [164] 28.3% --------------------------------------------------------------------------------- loop [186] 100.0% [199] 1390(0.3%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [213] 79.8% check-fold [220] 20.2% --------------------------------------------------------------------------------- loop [186] 100.0% [200] 844(0.2%) 562(0.1%) step .../racket/collects/racket/function.rkt:145:9 sort [217] 33.3% --------------------------------------------------------------------------------- loop [186] 100.0% [201] 838(0.2%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 pattern-match [216] 100.0% --------------------------------------------------------------------------------- loop [186] 100.0% [202] 837(0.2%) 281(0.1%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [218] 66.4% --------------------------------------------------------------------------------- loop [186] 100.0% [203] 280(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [160] 100.0% --------------------------------------------------------------------------------- loop [186] 100.0% [204] 276(0.1%) 0(0.0%) make-addition-node ...ng/src/core/reduce.rkt:208:0 make-addition-node* [222] 100.0% --------------------------------------------------------------------------------- adopt-enode! [101] 6.7% loop! [192] 93.3% [205] 12606(2.3%) 10651(1.9%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [230] 11.0% check-list [244] 4.5% --------------------------------------------------------------------------------- loop! [192] 100.0% [206] 7000(1.3%) 7000(1.3%) make-immutable-set .../private/set-types.rkt:948:0 --------------------------------------------------------------------------------- ??? [106] 4.2% ??? [193] 8.8% ...sting/src/common.rkt:47:2 [159] 12.6% ...row-higher-order.rkt:375:33 [143] 32.8% ??? [165] 41.5% [207] 6704(1.2%) 872(0.2%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [227] 37.4% ??? [106] 32.8% dict? [228] 16.8% --------------------------------------------------------------------------------- composed [198] 4.4% approximate [149] 5.6% f8 [157] 7.6% hash-ref! [164] 9.9% loop [186] 23.7% taylor [208] 48.7% [208] 6195(1.1%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [208] 48.7% loop [186] 32.7% taylor-invert [7] 7.4% f8 [157] 3.1% normalize-series [16] 2.6% debug-print [224] 1.8% debug [65] 1.1% --------------------------------------------------------------------------------- ??? [195] 100.0% [209] 4348(0.8%) 2387(0.4%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [226] 38.7% ??? [232] 6.4% --------------------------------------------------------------------------------- ->flonum [150] 7.1% table-ref [107] 14.1% one-iter [78] 21.4% loop! [192] 21.6% match-e [82] 35.8% [210] 3896(0.7%) 3896(0.7%) set-union ...ects/racket/private/generic.rkt:472:9 --------------------------------------------------------------------------------- loop! [192] 100.0% [211] 3662(0.7%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 reverse [223] 53.9% update-en-expr [225] 46.1% --------------------------------------------------------------------------------- ??? [193] 100.0% [212] 3344(0.6%) 2232(0.4%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [231] 24.9% check-list [244] 8.3% --------------------------------------------------------------------------------- foldl [199] 100.0% [213] 1109(0.2%) 560(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [229] 49.5% --------------------------------------------------------------------------------- ??? [195] 100.0% [214] 903(0.2%) 903(0.2%) ^TYPE? .../ffi/unsafe.rkt:1621:20 --------------------------------------------------------------------------------- ??? [195] 100.0% [215] 846(0.2%) 0(0.0%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [226] 67.0% ??? [232] 33.0% --------------------------------------------------------------------------------- pattern-match [216] 33.3% ??? [201] 66.7% [216] 838(0.2%) 280(0.1%) pattern-match ...testing/src/core/matcher.rkt:48:0 pattern-match [216] 33.3% ??? [106] 33.3% --------------------------------------------------------------------------------- step [200] 49.3% group-by [26] 50.7% [217] 570(0.1%) 570(0.1%) sort ...cket/collects/racket/private/list.rkt:43:2 --------------------------------------------------------------------------------- keyword-apply [202] 100.0% [218] 556(0.1%) 556(0.1%) loop ...cket/collects/racket/private/kw.rkt:518:13 --------------------------------------------------------------------------------- simplify* [194] 100.0% [219] 283(0.1%) 283(0.1%) ??? ...t-testing/src/function-definitions.rkt:56:2 --------------------------------------------------------------------------------- foldl [199] 100.0% [220] 281(0.1%) 281(0.1%) check-fold ...llects/racket/private/list.rkt:223:2 --------------------------------------------------------------------------------- simplify* [194] 100.0% [221] 276(0.1%) 276(0.1%) get-evaluator ...src/function-definitions.rkt:61:0 --------------------------------------------------------------------------------- make-addition-node [204] 100.0% [222] 276(0.1%) 276(0.1%) make-addition-node* ...g/src/core/reduce.rkt:222:0 --------------------------------------------------------------------------------- contract-struct-name [161] 2.1% partition [34] 2.1% ??? [145] 2.1% combine-aterms [40] 2.1% substitute-e [85] 2.1% combine-mterms [38] 2.1% update-leader! [88] 2.1% return/no-unsupplied [173] 4.0% table-ref [107] 8.5% one-iter [78] 8.6% ??? [103] 10.7% ??? [211] 15.0% match-e [82] 38.4% [223] 13125(2.4%) 13125(2.4%) reverse ...collects/racket/private/reverse.rkt:6:4 --------------------------------------------------------------------------------- ??? [69] 4.9% loop [64] 9.4% prepare-points [49] 18.9% taylor [208] 19.1% simplify [22] 47.9% [224] 5906(1.1%) 5906(1.1%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 --------------------------------------------------------------------------------- update-leader! [88] 11.6% ??? [211] 35.4% ??? [103] 53.0% [225] 4778(0.9%) 3081(0.6%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [233] 23.7% pack-leader [234] 11.8% --------------------------------------------------------------------------------- bfsqrt [215] 13.1% bfmul [209] 39.0% real->bigfloat [151] 47.9% [226] 4316(0.8%) 4316(0.8%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 --------------------------------------------------------------------------------- ??? [207] 100.0% [227] 2505(0.5%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [235] 66.6% coerce-contract/f [238] 33.4% --------------------------------------------------------------------------------- table-ref [107] 19.6% ??? [207] 80.4% [228] 1401(0.3%) 846(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [239] 39.6% --------------------------------------------------------------------------------- substitute-e [85] 20.5% merge2 [213] 39.4% assoc-ref [174] 40.1% [229] 1391(0.3%) 1391(0.3%) assoc ...t/collects/racket/private/list.rkt:196:13 --------------------------------------------------------------------------------- custom-set-union [205] 100.0% [230] 1389(0.3%) 270(0.0%) choose-immutable ...et/private/set-types.rkt:151:0 set-check-compatible [237] 60.6% check-list [244] 19.9% --------------------------------------------------------------------------------- handle-the-hash [125] 19.5% ??? [184] 20.3% ??? [212] 60.2% [231] 1386(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [236] 80.5% ??? [240] 19.5% --------------------------------------------------------------------------------- bfmul [209] 33.3% bfsqrt [215] 33.4% real->bigfloat [151] 33.4% [232] 836(0.2%) 836(0.2%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 --------------------------------------------------------------------------------- merge-egraph-nodes! [83] 4.6% ??? [94] 4.7% ??? [103] 4.8% list-cartesian-product [91] 9.4% update-en-expr [225] 19.3% match-e [82] 57.2% [233] 5883(1.1%) 5042(0.9%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [241] 14.3% --------------------------------------------------------------------------------- one-iter [78] 25.1% update-en-expr [225] 25.4% match-e [82] 49.5% [234] 2217(0.4%) 2217(0.4%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 --------------------------------------------------------------------------------- contract? [227] 100.0% [235] 1669(0.3%) 1669(0.3%) simple-flat-contract? ...ct/private/guts.rkt:141:0 --------------------------------------------------------------------------------- ??? [231] 100.0% [236] 1116(0.2%) 282(0.1%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [242] 74.8% --------------------------------------------------------------------------------- choose-immutable [230] 100.0% [237] 842(0.2%) 842(0.2%) set-check-compatible ...rivate/set-types.rkt:531:0 --------------------------------------------------------------------------------- contract? [227] 100.0% [238] 836(0.2%) 548(0.1%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [243] 34.4% --------------------------------------------------------------------------------- dict? [228] 100.0% [239] 554(0.1%) 554(0.1%) assoc? ...et/collects/racket/private/dict.rkt:13:0 --------------------------------------------------------------------------------- ??? [231] 100.0% [240] 271(0.0%) 271(0.0%) ??? ...lects/racket/contract/private/orc.rkt:117:8 --------------------------------------------------------------------------------- make-sequence [233] 100.0% [241] 842(0.2%) 842(0.2%) :hash-gen ...collects/racket/private/for.rkt:781:4 --------------------------------------------------------------------------------- ??? [236] 100.0% [242] 834(0.2%) 286(0.1%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [244] 65.8% --------------------------------------------------------------------------------- coerce-contract/f [238] 100.0% [243] 288(0.1%) 288(0.1%) coerce-simple-value ...ract/private/guts.rkt:385:0 --------------------------------------------------------------------------------- choose-immutable [230] 5.8% ??? [212] 5.9% ??? [133] 6.0% ??? [242] 11.5% table-ref [107] 11.8% custom-set-union [205] 11.9% build-compound-type-name [152] 11.9% match-e [82] 11.9% err-lsts->split-indices [15] 23.2% [244] 4758(0.9%) 4758(0.9%) check-list ...ollects/racket/private/for.rkt:690:2 ---------------------------------------------------------------------------------