Profiling results ----------------- Total cpu time observed: 879448ms (out of 880516ms) Number of samples taken: 3094 (once every 284ms) (Hiding functions with self<1.0% and local<2.0%: 24 of 262 hidden) ==================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ==================================================================================== [1] 879448(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [7] 100.0% ------------------------------------------------------------------------------------ loop [197] 100.0% [2] 47230(5.4%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [197] 70.7% sort-context-on-expr [8] 22.2% err-lsts->split-indices [10] 2.9% pick-errors [12] 1.2% sindices->spoints [13] 1.2% eval-prog [133] 0.6% ------------------------------------------------------------------------------------ hash-ref! [174] 100.0% [3] 18728(2.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [150] 84.4% hash-ref! [174] 15.6% ------------------------------------------------------------------------------------ loop [197] 100.0% [4] 7504(0.9%) 1118(0.1%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [197] 59.2% procedure-reduce-arity [178] 7.4% make-curried [14] 7.3% compose [15] 3.8% eval-const-expr [16] 3.7% make-sequence [221] 3.7% ------------------------------------------------------------------------------------ hash-ref! [174] 100.0% [5] 7283(0.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [174] 65.2% ??? [9] 31.0% simplify [157] 3.8% ------------------------------------------------------------------------------------ loop [197] 100.0% [6] 840(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [11] 100.0% ------------------------------------------------------------------------------------ ??? [1] 100.0% [7] 879448(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [17] 100.0% ------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [8] 10498(1.2%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [18] 100.0% ------------------------------------------------------------------------------------ ??? [5] 100.0% [9] 2257(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [174] 100.0% ------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [10] 1389(0.2%) 547(0.1%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [218] 20.3% check-list [205] 20.3% loop [197] 20.1% ------------------------------------------------------------------------------------ make-multiplication-node [6] 100.0% [11] 840(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubsubnode [20] 65.7% make-multiplication-subsubnode [21] 34.3% ------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [12] 557(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [19] 100.0% ------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [13] 552(0.1%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 ...row-higher-order.rkt:375:33 [132] 50.5% free-variables [217] 49.5% ------------------------------------------------------------------------------------ set-precompute! [4] 100.0% [14] 548(0.1%) 548(0.1%) make-curried .../collects/racket/function.rkt:91:9 ------------------------------------------------------------------------------------ set-precompute! [4] 100.0% [15] 282(0.0%) 282(0.0%) compose ...collects/racket/private/list.rkt:404:12 ------------------------------------------------------------------------------------ set-precompute! [4] 100.0% [16] 279(0.0%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f8 [168] 100.0% ------------------------------------------------------------------------------------ profile-thunk [7] 100.0% [17] 879448(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [22] 100.0% ------------------------------------------------------------------------------------ step [209] 5.1% sort-context-on-expr [8] 94.9% [18] 11062(1.3%) 564(0.1%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [23] 94.9% ------------------------------------------------------------------------------------ pick-errors [12] 33.7% loop [197] 66.3% [19] 1650(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [131] 100.0% ------------------------------------------------------------------------------------ make-multiplication-subnode [11] 100.0% [20] 552(0.1%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [24] 100.0% ------------------------------------------------------------------------------------ make-multiplication-subnode [11] 100.0% [21] 288(0.0%) 0(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 mterm->expr [24] 100.0% ------------------------------------------------------------------------------------ ??? [17] 100.0% [22] 879448(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [25] 89.1% prepare-points [32] 10.9% ------------------------------------------------------------------------------------ ??? [18] 100.0% [23] 10498(1.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [26] 81.5% ??? [131] 13.2% ...row-higher-order.rkt:375:33 [132] 5.3% ------------------------------------------------------------------------------------ make-multiplication-subsubnode [21] 34.3% make-multiplication-subsubsubnode [20] 65.7% [24] 840(0.1%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 f8 [168] 100.0% ------------------------------------------------------------------------------------ ??? [22] 100.0% [25] 783199(89.1%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [27] 93.0% get-final-combination [28] 6.2% setup-prog! [29] 0.7% setup-alt-simplified [30] 0.1% ??? [95] 0.0% ------------------------------------------------------------------------------------ generic-sort/key [23] 43.3% copying-mergesort [26] 56.7% [26] 8552(1.0%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [26] 56.7% ??? [131] 43.3% ------------------------------------------------------------------------------------ run-improve [25] 100.0% [27] 728466(82.8%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [31] 90.8% finalize-iter! [34] 4.5% gen-series! [35] 3.5% choose-best-alt! [36] 0.8% gen-rewrites! [37] 0.3% localize! [38] 0.1% ------------------------------------------------------------------------------------ run-improve [25] 100.0% [28] 48328(5.5%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [33] 97.7% extract-alt [40] 1.7% ...row-higher-order.rkt:375:33 [132] 0.6% ------------------------------------------------------------------------------------ run-improve [25] 100.0% [29] 5285(0.6%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [32] 100.0% ------------------------------------------------------------------------------------ run-improve [25] 100.0% [30] 842(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [39] 100.0% ------------------------------------------------------------------------------------ run-iter! [27] 100.0% [31] 661490(75.2%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [41] 100.0% debug-print [191] 0.0% ------------------------------------------------------------------------------------ setup-prog! [29] 5.2% ??? [22] 94.8% [32] 101534(11.5%) 394(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [47] 61.1% make-exacts [42] 35.2% make-exacts* [48] 3.3% ------------------------------------------------------------------------------------ get-final-combination [28] 100.0% [33] 47230(5.4%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [168] 100.0% ------------------------------------------------------------------------------------ run-iter! [27] 100.0% [34] 32449(3.7%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [95] 100.0% ------------------------------------------------------------------------------------ run-iter! [27] 100.0% [35] 25717(2.9%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [43] 100.0% ------------------------------------------------------------------------------------ run-iter! [27] 100.0% [36] 5738(0.7%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [95] 100.0% ------------------------------------------------------------------------------------ run-iter! [27] 100.0% [37] 2230(0.3%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [44] 100.0% ------------------------------------------------------------------------------------ run-iter! [27] 100.0% [38] 842(0.1%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [45] 100.0% ------------------------------------------------------------------------------------ setup-alt-simplified [30] 100.0% [39] 842(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [46] 100.0% ------------------------------------------------------------------------------------ get-final-combination [28] 100.0% [40] 818(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [153] 100.0% ------------------------------------------------------------------------------------ simplify! [31] 100.0% [41] 661210(75.2%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [46] 100.0% ------------------------------------------------------------------------------------ prepare-points [32] 100.0% [42] 35697(4.1%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [47] 80.9% make-exacts* [48] 19.1% ------------------------------------------------------------------------------------ gen-series! [35] 100.0% [43] 25717(2.9%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [132] 100.0% ------------------------------------------------------------------------------------ gen-rewrites! [37] 100.0% [44] 2230(0.3%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [49] 100.0% ------------------------------------------------------------------------------------ localize! [38] 100.0% [45] 842(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [174] 100.0% ------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [132] 0.0% simplify-alt [39] 0.1% ??? [41] 99.8% [46] 662332(75.3%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [50] 99.9% *simplify-rules* [53] 0.0% ------------------------------------------------------------------------------------ make-exacts [42] 31.7% prepare-points [32] 68.3% [47] 90960(10.3%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [197] 100.0% ------------------------------------------------------------------------------------ prepare-points [32] 33.0% make-exacts [42] 67.0% [48] 10180(1.2%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [133] 100.0% ------------------------------------------------------------------------------------ alt-rewrite-rm [44] 33.6% matcher [51] 66.4% [49] 2230(0.3%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [51] 66.4% *rules* [52] 18.2% f8 [168] 12.3% make-sequence [221] 3.2% ------------------------------------------------------------------------------------ simplify [46] 100.0% [50] 661777(75.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [54] 82.9% loop [55] 16.9% mk-egraph [56] 0.2% debug [58] 0.0% ------------------------------------------------------------------------------------ matcher [51] 50.0% rewriter [49] 50.0% [51] 2230(0.3%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [51] 50.0% rewriter [49] 50.0% ------------------------------------------------------------------------------------ rewriter [49] 100.0% [52] 1402(0.2%) 564(0.1%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [57] 39.8% ??? [74] 20.0% ------------------------------------------------------------------------------------ simplify [46] 100.0% [53] 279(0.0%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [57] 100.0% ------------------------------------------------------------------------------------ ??? [50] 100.0% [54] 548400(62.4%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [59] 98.6% loop [197] 1.4% ------------------------------------------------------------------------------------ ??? [50] 100.0% [55] 111996(12.7%) 3615(0.4%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 loop [60] 48.8% mk-min [61] 45.7% reverse [204] 1.2% make-sequence [221] 0.7% filter [207] 0.3% ------------------------------------------------------------------------------------ ??? [50] 100.0% [56] 1105(0.1%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [62] 100.0% ------------------------------------------------------------------------------------ *simplify-rules* [53] 33.4% *rules* [52] 66.6% [57] 836(0.1%) 558(0.1%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 dict-ref-contract [149] 33.3% ------------------------------------------------------------------------------------ ??? [50] 100.0% [58] 276(0.0%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [63] 100.0% ------------------------------------------------------------------------------------ iterate-egraph! [54] 100.0% [59] 540616(61.5%) 11091(1.3%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [64] 30.4% merge-egraph-nodes! [66] 19.2% mk-enode! [70] 16.8% substitute-e [67] 11.7% loop! [72] 9.5% custom-set-member? [68] 5.8% list-member? [151] 2.5% filter [207] 0.7% reverse [204] 0.4% dict-iterate-next [222] 0.2% update-leader! [71] 0.2% loop [69] 0.1% pack-leader [98] 0.1% ------------------------------------------------------------------------------------ loop [55] 100.0% [60] 54670(6.2%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [65] 100.0% ------------------------------------------------------------------------------------ loop [55] 100.0% [61] 51215(5.8%) 280(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [65] 99.5% ------------------------------------------------------------------------------------ loop [197] 31.5% mk-egraph [56] 68.5% [62] 1105(0.1%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [197] 100.0% ------------------------------------------------------------------------------------ debug [58] 100.0% [63] 276(0.0%) 276(0.0%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 ------------------------------------------------------------------------------------ match-e [64] 28.9% one-iter [59] 71.1% [64] 164197(18.7%) 44580(5.1%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [64] 28.9% loop [197] 9.1% variable? [73] 6.3% ??? [95] 6.2% ??? [74] 6.0% make-sequence [221] 5.1% list-cartesian-product [75] 3.9% reverse [204] 3.4% do-procedure-reduce-keyword-arity [81] 3.2% make-curried [77] 1.0% custom-in-set [235] 1.0% pack-leader [98] 0.9% check-list [205] 0.8% dict-iterate-next [222] 0.8% filter [207] 0.5% ------------------------------------------------------------------------------------ mk-min [61] 48.2% loop [60] 51.8% [65] 105605(12.0%) 2210(0.3%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [96] 57.0% dict-ref-contract [149] 24.6% compile [138] 15.0% ??? [97] 1.0% ------------------------------------------------------------------------------------ merge-egraph-nodes! [66] 7.3% one-iter [59] 92.7% [66] 103986(11.8%) 837(0.1%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [71] 71.1% loop! [72] 18.0% merge-egraph-nodes! [66] 7.3% enode-merge! [76] 3.0% ------------------------------------------------------------------------------------ substitute-e [67] 10.0% one-iter [59] 90.0% [67] 63354(7.2%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [70] 83.3% substitute-e [67] 10.0% ??? [95] 3.0% variable? [73] 2.5% assoc [229] 0.8% reverse [204] 0.2% ------------------------------------------------------------------------------------ one-iter [59] 100.0% [68] 31104(3.5%) 30828(3.5%) custom-set-member? ...t/private/set-types.rkt:45:0 ------------------------------------------------------------------------------------ one-iter [59] 0.5% loop [69] 99.5% [69] 558(0.1%) 558(0.1%) loop ...cket/collects/racket/private/hash.rkt:25:8 loop [69] 99.5% ------------------------------------------------------------------------------------ loop [197] 0.8% substitute-e [67] 36.5% one-iter [59] 62.7% [70] 144528(16.4%) 9242(1.1%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [78] 90.9% hash-has-key? [100] 2.5% ------------------------------------------------------------------------------------ one-iter [59] 1.1% merge-egraph-nodes! [66] 98.9% [71] 78366(8.9%) 36863(4.2%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [79] 41.6% update-en-expr [93] 6.7% reverse [204] 2.1% custom-set-union! [85] 2.1% hash-ref! [174] 0.4% ------------------------------------------------------------------------------------ merge-egraph-nodes! [66] 22.5% loop [197] 29.2% one-iter [59] 48.3% [72] 73758(8.4%) 11082(1.3%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [90] 39.5% loop [197] 30.5% make-immutable-set [80] 13.1% ??? [82] 6.9% dict-iterate-next [222] 0.6% ------------------------------------------------------------------------------------ free-variables [217] 0.9% substitute-e [67] 12.9% match-e [64] 86.2% [73] 30112(3.4%) 557(0.1%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [95] 98.2% ------------------------------------------------------------------------------------ *rules* [52] 2.2% match-e [64] 97.8% [74] 12530(1.4%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [81] 55.5% do-curry [83] 42.2% procedure-reduce-arity [178] 2.2% ------------------------------------------------------------------------------------ list-cartesian-product [75] 23.3% match-e [64] 76.7% [75] 7788(0.9%) 2780(0.3%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [221] 42.9% list-cartesian-product [75] 23.3% reverse [204] 3.4% ------------------------------------------------------------------------------------ merge-egraph-nodes! [66] 100.0% [76] 3076(0.3%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [84] 72.6% adopt-enode! [86] 27.4% ------------------------------------------------------------------------------------ match-e [64] 100.0% [77] 1960(0.2%) 1125(0.1%) make-curried ...collects/racket/function.rkt:130:9 make-keyword-procedure [124] 28.3% partially-applied-procedure-arity-mask [87] 14.3% ------------------------------------------------------------------------------------ mk-enode! [70] 100.0% [78] 131373(14.9%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [88] 99.6% ------------------------------------------------------------------------------------ update-leader! [71] 100.0% [79] 32614(3.7%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [89] 100.0% ------------------------------------------------------------------------------------ loop! [72] 100.0% [80] 18978(2.2%) 18417(2.1%) make-immutable-set .../private/set-types.rkt:948:0 stream? [91] 3.0% ------------------------------------------------------------------------------------ match-e [64] 49.1% ??? [74] 50.9% [81] 13664(1.6%) 11992(1.4%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [189] 12.2% ------------------------------------------------------------------------------------ loop! [72] 100.0% [82] 10085(1.1%) 834(0.1%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [93] 61.1% reverse [204] 30.6% ------------------------------------------------------------------------------------ ??? [74] 100.0% [83] 5291(0.6%) 3625(0.4%) do-curry ...cket/collects/racket/function.rkt:71:2 procedure-keywords [189] 20.9% make-keyword-procedure [124] 10.6% ------------------------------------------------------------------------------------ enode-merge! [76] 100.0% [84] 2232(0.3%) 2232(0.3%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------ update-leader! [71] 100.0% [85] 1652(0.2%) 1376(0.2%) custom-set-union! ...t/private/set-types.rkt:245:0 set-check-compatible [99] 16.7% ------------------------------------------------------------------------------------ enode-merge! [76] 100.0% [86] 844(0.1%) 284(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [90] 66.3% ------------------------------------------------------------------------------------ make-curried [77] 100.0% [87] 280(0.0%) 280(0.0%) partially-applied-procedure-arity-mask ...rkt:58:2 ------------------------------------------------------------------------------------ new-enode [78] 100.0% [88] 130820(14.9%) 1118(0.1%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [92] 98.7% make-sequence [221] 0.2% f8 [168] 0.2% ------------------------------------------------------------------------------------ do-hash-update [79] 100.0% [89] 32614(3.7%) 25076(2.9%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [93] 10.3% reverse [204] 8.6% make-sequence [221] 4.3% ------------------------------------------------------------------------------------ adopt-enode! [86] 1.7% loop! [72] 98.3% [90] 32519(3.7%) 26404(3.0%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [94] 15.4% check-list [205] 3.4% ------------------------------------------------------------------------------------ make-immutable-set [80] 100.0% [91] 560(0.1%) 560(0.1%) stream? ...t/collects/racket/private/for.rkt:493:2 ------------------------------------------------------------------------------------ f8 [168] 1.7% type-of-enode-expr [88] 98.3% [92] 131383(14.9%) 1128(0.1%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [96] 39.3% ??? [97] 25.3% ??? [95] 19.7% dict-ref-contract [149] 14.4% hash-has-key? [100] 0.4% ------------------------------------------------------------------------------------ ??? [89] 22.6% update-leader! [71] 35.7% ??? [82] 41.7% [93] 14785(1.7%) 9231(1.0%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [98] 24.5% make-sequence [221] 13.1% ------------------------------------------------------------------------------------ custom-set-union [90] 100.0% [94] 5012(0.6%) 3332(0.4%) choose-immutable ...et/private/set-types.rkt:151:0 check-list [205] 22.4% set-check-compatible [99] 11.1% ------------------------------------------------------------------------------------ run-improve [25] 0.2% setfindf [213] 0.2% ??? [183] 0.9% substitute-e [67] 3.9% choose-best-alt! [36] 4.7% match-e [64] 17.8% get-sigs [92] 21.2% variable? [73] 24.2% finalize-iter! [34] 26.3% [95] 122351(13.9%) 2782(0.3%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [100] 65.6% atab-add-altns [101] 26.5% atab-pick-alt [103] 4.7% ??? [183] 0.9% ------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [132] 1.0% get-sigs [92] 45.7% expression-cost [65] 53.3% [96] 112988(12.8%) 24334(2.8%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [105] 66.4% reverse [204] 3.2% return/no-unsupplied [200] 2.5% ??? [104] 2.2% dict-ref-contract [149] 2.0% dict-iterate-next [222] 1.2% check-list [205] 0.5% dict? [201] 0.5% ------------------------------------------------------------------------------------ expression-cost [65] 3.2% get-sigs [92] 96.8% [97] 34308(3.9%) 1404(0.2%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [102] 68.2% handle-the-hash [112] 16.3% get/build-late-neg-projection [134] 10.6% ------------------------------------------------------------------------------------ one-iter [59] 5.0% match-e [64] 30.1% update-en-expr [93] 64.9% [98] 5580(0.6%) 5580(0.6%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ------------------------------------------------------------------------------------ custom-set-union! [85] 33.3% choose-immutable [94] 66.7% [99] 832(0.1%) 832(0.1%) set-check-compatible ...rivate/set-types.rkt:531:0 ------------------------------------------------------------------------------------ get-sigs [92] 0.7% mk-enode! [70] 4.3% ??? [95] 95.1% [100] 84740(9.6%) 56894(6.5%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [105] 31.9% reverse [204] 1.0% ------------------------------------------------------------------------------------ ??? [95] 100.0% [101] 32726(3.7%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [106] 100.0% ------------------------------------------------------------------------------------ ??? [97] 100.0% [102] 23405(2.7%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [107] 100.0% ------------------------------------------------------------------------------------ ??? [95] 100.0% [103] 5738(0.7%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [108] 62.6% ...row-higher-order.rkt:375:33 [132] 27.7% write-json* [109] 4.9% errors [120] 4.8% ------------------------------------------------------------------------------------ table-ref [96] 100.0% [104] 2508(0.3%) 2508(0.3%) ??? ...cts/racket/contract/private/list.rkt:211:14 ------------------------------------------------------------------------------------ hash-has-key? [100] 26.5% table-ref [96] 73.5% [105] 102014(11.6%) 44601(5.1%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [110] 33.4% handle-the-hash [112] 15.0% ??? [163] 1.9% ??? [164] 1.6% arrow-higher-order:lnp [115] 1.6% do-chaperone-procedure [116] 1.3% check-list [205] 0.6% ------------------------------------------------------------------------------------ atab-add-altns [101] 100.0% [106] 32726(3.7%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [111] 85.7% override-at-pnts [114] 13.5% ------------------------------------------------------------------------------------ ??? [102] 100.0% [107] 23405(2.7%) 9170(1.0%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [113] 57.2% ??? [117] 2.4% ??? [119] 1.2% ------------------------------------------------------------------------------------ atab-pick-alt [103] 100.0% [108] 3590(0.4%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [197] 100.0% ------------------------------------------------------------------------------------ atab-pick-alt [103] 100.0% [109] 280(0.0%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [118] 100.0% ------------------------------------------------------------------------------------ ??? [105] 100.0% [110] 34044(3.9%) 16480(1.9%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [122] 20.5% blame-add-missing-party [123] 18.8% make-keyword-procedure [124] 7.4% update-the-info [125] 2.5% ??? [127] 2.4% ------------------------------------------------------------------------------------ atab-add-altn [106] 100.0% [111] 28050(3.2%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [120] 99.0% ------------------------------------------------------------------------------------ ??? [156] 1.3% ??? [97] 26.4% ??? [105] 72.3% [112] 21184(2.4%) 8093(0.9%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [163] 57.9% ??? [175] 3.9% ------------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [107] 100.0% [113] 13398(1.5%) 284(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [121] 97.9% ------------------------------------------------------------------------------------ atab-add-altn [106] 100.0% [114] 4404(0.5%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [120] 100.0% ------------------------------------------------------------------------------------ ??? [105] 100.0% [115] 1654(0.2%) 548(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ??? [126] 50.6% do-arity-checking [130] 16.2% ------------------------------------------------------------------------------------ ??? [105] 100.0% [116] 1376(0.2%) 836(0.1%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [128] 39.3% ------------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [107] 100.0% [117] 557(0.1%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:44 do-blame-add-context [135] 50.1% blame-add-context [129] 49.9% ------------------------------------------------------------------------------------ write-json* [109] 25.0% loop [118] 75.0% [118] 280(0.0%) 280(0.0%) loop .../share/racket/collects/json/main.rkt:132:2 loop [118] 75.0% ------------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [107] 100.0% [119] 280(0.0%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:34 do-blame-add-context [135] 100.0% ------------------------------------------------------------------------------------ atab-pick-alt [103] 0.4% composed [214] 3.5% override-at-pnts [114] 6.3% best-and-tied-at-points [111] 39.9% loop [197] 50.0% [120] 69646(7.9%) 568(0.1%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [131] 69.1% eval-prog [133] 24.1% ulp-difference [190] 2.8% ...row-higher-order.rkt:375:33 [132] 2.8% ------------------------------------------------------------------------------------ ??? [113] 100.0% [121] 13114(1.5%) 562(0.1%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [134] 78.6% do-blame-add-context [135] 8.5% reverse [204] 6.4% check-list [205] 2.2% ------------------------------------------------------------------------------------ ??? [110] 40.2% loop [122] 59.8% [122] 6982(0.8%) 6982(0.8%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [122] 59.8% ------------------------------------------------------------------------------------ ??? [110] 100.0% [123] 6410(0.7%) 6410(0.7%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------ make-curried [77] 15.3% do-curry [83] 15.5% ??? [110] 69.2% [124] 3623(0.4%) 3623(0.4%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------ ??? [110] 100.0% [125] 843(0.1%) 843(0.1%) update-the-info ...ontract/private/blame.rkt:318:0 ------------------------------------------------------------------------------------ arrow-higher-order:lnp [115] 100.0% [126] 838(0.1%) 838(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 ------------------------------------------------------------------------------------ ??? [110] 100.0% [127] 820(0.1%) 820(0.1%) ??? ...rivate/unconstrained-domain-arrow.rkt:19:10 ------------------------------------------------------------------------------------ do-chaperone-procedure [116] 100.0% [128] 540(0.1%) 540(0.1%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 ------------------------------------------------------------------------------------ ??? [117] 100.0% [129] 278(0.0%) 278(0.0%) blame-add-context ...tract/private/blame.rkt:170:0 ------------------------------------------------------------------------------------ arrow-higher-order:lnp [115] 100.0% [130] 268(0.0%) 268(0.0%) do-arity-checking ...ivate/arity-checking.rkt:12:0 ------------------------------------------------------------------------------------ generic-sort/key [23] 0.9% ??? [19] 1.1% copying-mergesort [26] 5.7% errors [120] 32.1% loop [197] 60.2% [131] 150210(17.1%) 79079(9.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [220] 14.4% loop [197] 11.0% ??? [141] 6.4% ??? [175] 5.5% bf* [211] 3.4% ??? [144] 2.1% ??? [145] 2.1% ??? [146] 1.9% ------------------------------------------------------------------------------------ ??? [194] 0.2% sindices->spoints [13] 0.5% get-final-combination [28] 0.5% generic-sort/key [23] 1.1% atab-pick-alt [103] 3.1% errors [120] 3.8% f8 [168] 6.5% loop [136] 25.0% taylor-alt [43] 25.0% loop [197] 34.4% [132] 51284(5.8%) 554(0.1%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 loop [136] 25.0% approximate [137] 25.0% ->flonum [140] 22.5% real->bigfloat [142] 13.0% ??? [183] 4.8% best-alt [147] 3.1% table-ref [96] 2.1% dict-ref-contract [149] 2.1% simplify [46] 0.5% ------------------------------------------------------------------------------------ option-on-expr [2] 1.0% make-exacts* [48] 36.6% errors [120] 60.4% [133] 27795(3.2%) 13794(1.6%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [138] 34.6% f8 [168] 12.9% parse-app [179] 2.9% ------------------------------------------------------------------------------------ ??? [143] 13.1% ??? [97] 13.1% ??? [121] 73.8% [134] 13954(1.6%) 1392(0.2%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [139] 74.9% ??? [143] 13.1% contract-struct-late-neg-projection [148] 4.0% ------------------------------------------------------------------------------------ ??? [117] 16.6% ??? [119] 16.7% ??? [121] 66.7% [135] 1677(0.2%) 1677(0.2%) do-blame-add-context ...ct/private/blame.rkt:192:0 ------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [132] 21.3% loop [136] 78.7% [136] 25717(2.9%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [136] 78.7% ...row-higher-order.rkt:375:33 [132] 21.3% ------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [132] 100.0% [137] 25717(2.9%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [174] 72.8% ??? [150] 17.4% taylor [176] 5.5% f8 [168] 3.2% taylor-quotient [154] 1.1% ------------------------------------------------------------------------------------ eval-prog [133] 37.8% expression-cost [65] 62.2% [138] 25448(2.9%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [174] 97.8% reverse [204] 2.2% ------------------------------------------------------------------------------------ get/build-late-neg-projection [134] 100.0% [139] 12004(1.4%) 2232(0.3%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [152] 76.7% reverse [204] 4.7% ------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [132] 100.0% [140] 11545(1.3%) 5374(0.6%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 dict-ref-contract [149] 21.6% return/no-unsupplied [200] 16.8% list-member? [151] 7.7% dict-iterate-next [222] 4.8% ??? [155] 2.6% ------------------------------------------------------------------------------------ ??? [131] 100.0% [141] 9610(1.1%) 6030(0.7%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 dict-ref-contract [149] 20.1% list-member? [151] 8.6% return/no-unsupplied [200] 8.5% ------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [132] 100.0% [142] 6674(0.8%) 1520(0.2%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [234] 77.2% ------------------------------------------------------------------------------------ get/build-late-neg-projection [134] 100.0% [143] 3649(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [134] 100.0% ------------------------------------------------------------------------------------ ??? [131] 100.0% [144] 3193(0.4%) 2598(0.3%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [230] 18.7% ------------------------------------------------------------------------------------ ??? [131] 100.0% [145] 3183(0.4%) 3183(0.4%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------ ??? [131] 100.0% [146] 2854(0.3%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [163] 100.0% ------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [132] 100.0% [147] 1590(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [153] 100.0% ------------------------------------------------------------------------------------ get/build-late-neg-projection [134] 100.0% [148] 558(0.1%) 558(0.1%) contract-struct-late-neg-projection ...p.rkt:121:0 ------------------------------------------------------------------------------------ flag-set? [57] 0.5% ...row-higher-order.rkt:375:33 [132] 2.1% ??? [159] 3.1% ??? [141] 3.6% table-ref [96] 4.2% ->flonum [140] 4.7% get-sigs [92] 34.8% expression-cost [65] 46.4% [149] 53178(6.0%) 7495(0.9%) dict-ref-contract ...ract/private/arr-i.rkt:976:19 ??? [156] 62.9% ??? [159] 18.4% ??? [183] 3.7% coerce-contract [161] 1.6% ------------------------------------------------------------------------------------ approximate [137] 19.3% ??? [3] 80.7% [150] 23204(2.6%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [174] 100.0% ------------------------------------------------------------------------------------ ??? [141] 5.4% ->flonum [140] 5.8% one-iter [59] 88.8% [151] 15356(1.7%) 273(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [158] 98.2% ------------------------------------------------------------------------------------ contract-struct-name [160] 18.1% ??? [139] 81.9% [152] 9212(1.0%) 2505(0.3%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [160] 68.3% check-list [205] 13.7% ------------------------------------------------------------------------------------ extract-alt [40] 33.9% best-alt [147] 66.1% [153] 2408(0.3%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [214] 100.0% ------------------------------------------------------------------------------------ taylor [176] 49.9% approximate [137] 50.1% [154] 560(0.1%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 normalize-series [162] 50.1% simplify [157] 49.9% ------------------------------------------------------------------------------------ ->flonum [140] 100.0% [155] 304(0.0%) 304(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 ------------------------------------------------------------------------------------ ??? [163] 26.7% dict-ref-contract [149] 73.3% [156] 33426(3.8%) 11676(1.3%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [163] 44.2% ??? [183] 20.9% ??? [164] 5.0% handle-the-hash [112] 0.8% ------------------------------------------------------------------------------------ ??? [5] 1.2% taylor-quotient [154] 1.2% loop [197] 2.3% taylor-invert [192] 2.3% hash-ref! [174] 91.9% [157] 24048(2.7%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [168] 93.0% loop [167] 3.5% simplify-node [166] 1.2% debug-print [191] 1.2% ------------------------------------------------------------------------------------ list-member? [151] 100.0% [158] 15083(1.7%) 15083(1.7%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------ dict-ref-contract [149] 100.0% [159] 11442(1.3%) 3630(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 dict-ref-contract [149] 29.2% assoc-ref [165] 21.9% return/no-unsupplied [200] 17.2% ------------------------------------------------------------------------------------ build-compound-type-name [152] 100.0% [160] 7546(0.9%) 3070(0.3%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [152] 38.8% reverse [204] 26.0% ------------------------------------------------------------------------------------ dict-ref-contract [149] 100.0% [161] 828(0.1%) 0(0.0%) coerce-contract ...contract/private/guts.rkt:307:0 coerce-contract/f [210] 100.0% ------------------------------------------------------------------------------------ taylor [176] 49.0% taylor-quotient [154] 51.0% [162] 550(0.1%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [174] 100.0% ------------------------------------------------------------------------------------ ??? [105] 4.8% ??? [146] 7.0% handle-the-hash [112] 30.1% ??? [156] 58.1% [163] 40772(4.6%) 9986(1.1%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [156] 43.8% ??? [169] 24.6% ??? [183] 4.3% check-list [205] 2.8% ------------------------------------------------------------------------------------ ??? [156] 50.0% ??? [105] 50.0% [164] 3345(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [170] 100.0% ------------------------------------------------------------------------------------ ??? [159] 100.0% [165] 2505(0.3%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [229] 100.0% ------------------------------------------------------------------------------------ simplify [157] 34.0% loop [197] 66.0% [166] 849(0.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 combine-aterms [171] 34.0% gather-multiplicative-terms [172] 33.3% combine-mterms [173] 32.7% ------------------------------------------------------------------------------------ simplify [157] 22.2% loop [167] 77.8% [167] 846(0.1%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 loop [167] 77.8% f8 [168] 22.2% ------------------------------------------------------------------------------------ free-variables [217] 0.1% composed [214] 0.2% mterm->expr [24] 0.3% type-of-enode-expr [88] 0.4% f8 [168] 0.4% eval-const-expr [16] 0.4% approximate [137] 0.4% rewriter [49] 0.7% taylor [176] 1.1% hash-ref! [174] 1.1% loop [167] 1.1% eval-prog [133] 1.4% simplify [157] 13.1% loop [197] 18.7% split-table [33] 60.5% [168] 75140(8.5%) 17612(2.0%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [197] 82.9% get-sigs [92] 2.1% taylor [176] 1.5% ...row-higher-order.rkt:375:33 [132] 1.3% f8 [168] 0.4% composed [214] 0.2% loop [180] 0.2% parse-app [179] 0.1% ------------------------------------------------------------------------------------ ??? [163] 100.0% [169] 10027(1.1%) 4151(0.5%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [175] 41.8% check-list [205] 16.8% ------------------------------------------------------------------------------------ ??? [164] 100.0% [170] 3345(0.4%) 560(0.1%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [177] 83.2% ------------------------------------------------------------------------------------ simplify-node [166] 100.0% [171] 288(0.0%) 0(0.0%) combine-aterms ...esting/src/core/reduce.rkt:183:0 hash-ref! [174] 100.0% ------------------------------------------------------------------------------------ simplify-node [166] 100.0% [172] 282(0.0%) 0(0.0%) gather-multiplicative-terms ...re/reduce.rkt:116:0 procedure-reduce-arity [178] 100.0% ------------------------------------------------------------------------------------ simplify-node [166] 100.0% [173] 278(0.0%) 0(0.0%) combine-mterms ...esting/src/core/reduce.rkt:191:0 ??? [181] 100.0% ------------------------------------------------------------------------------------ combine-aterms [171] 0.1% update-leader! [71] 0.6% ??? [9] 0.6% localize-error [45] 0.7% normalize-series [162] 0.7% ??? [5] 1.3% ??? [3] 1.9% approximate [137] 6.6% ??? [185] 6.9% ??? [182] 8.4% ??? [150] 8.9% ??? [186] 9.6% compile [138] 21.1% loop [197] 29.2% [174] 49515(5.6%) 14198(1.6%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [184] 31.0% ??? [186] 9.6% simplify [157] 8.7% ??? [3] 8.5% ??? [182] 8.4% bigfloat-hash [188] 7.2% ??? [185] 6.9% ??? [5] 2.2% f8 [168] 1.7% taylor [176] 0.5% ------------------------------------------------------------------------------------ handle-the-hash [112] 6.2% ??? [169] 31.4% ??? [131] 62.4% [175] 13338(1.5%) 2513(0.3%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [187] 79.1% ??? [195] 2.1% ------------------------------------------------------------------------------------ hash-ref! [174] 15.1% approximate [137] 15.4% taylor [176] 32.9% f8 [168] 36.7% [176] 3046(0.3%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [176] 32.9% debug-print [191] 21.0% taylor-invert [192] 13.7% taylor-exact [193] 13.5% f8 [168] 9.5% taylor-quotient [154] 4.6% ??? [194] 3.1% normalize-series [162] 1.8% ------------------------------------------------------------------------------------ check-hash/c [170] 100.0% [177] 2784(0.3%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [208] 100.0% ------------------------------------------------------------------------------------ ??? [74] 25.1% gather-multiplicative-terms [172] 25.3% set-precompute! [4] 49.6% [178] 1116(0.1%) 836(0.1%) procedure-reduce-arity ...t/private/kw.rkt:1823:11 procedure-keywords [189] 25.1% ------------------------------------------------------------------------------------ f8 [168] 26.4% eval-prog [133] 73.6% [179] 1080(0.1%) 802(0.1%) parse-app ...collects/racket/private/kw.rkt:1207:2 identifier? [196] 25.7% ------------------------------------------------------------------------------------ f8 [168] 0.5% loop [180] 99.5% [180] 281(0.0%) 0(0.0%) loop .../private/map.rkt:54:19 loop [180] 99.5% ulp-difference [190] 0.5% ------------------------------------------------------------------------------------ combine-mterms [173] 100.0% [181] 278(0.0%) 278(0.0%) ??? ...rbie/alt-testing/src/core/reduce.rkt:199:28 ------------------------------------------------------------------------------------ hash-ref! [174] 100.0% [182] 22391(2.5%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [174] 100.0% ------------------------------------------------------------------------------------ ??? [95] 5.1% ??? [163] 8.0% ...row-higher-order.rkt:375:33 [132] 11.1% dict-ref-contract [149] 11.3% ??? [156] 63.2% [183] 22053(2.5%) 5070(0.6%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [198] 45.5% dict? [201] 16.4% ^TYPE? [230] 8.8% ??? [95] 6.3% ------------------------------------------------------------------------------------ hash-ref! [174] 100.0% [184] 21818(2.5%) 1942(0.2%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [197] 97.1% ------------------------------------------------------------------------------------ hash-ref! [174] 100.0% [185] 17904(2.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [174] 100.0% ------------------------------------------------------------------------------------ hash-ref! [174] 100.0% [186] 16792(1.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [174] 100.0% ------------------------------------------------------------------------------------ ??? [175] 100.0% [187] 10544(1.2%) 4897(0.6%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [202] 31.8% ^TYPE? [230] 21.7% ------------------------------------------------------------------------------------ hash-ref! [174] 100.0% [188] 9618(1.1%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [199] 100.0% ------------------------------------------------------------------------------------ procedure-reduce-arity [178] 9.2% do-curry [83] 36.2% do-procedure-reduce-keyword-arity [81] 54.7% [189] 3056(0.3%) 3056(0.3%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------ loop [180] 12.7% errors [120] 87.3% [190] 2217(0.3%) 1674(0.2%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [200] 24.5% ------------------------------------------------------------------------------------ simplify! [31] 16.8% simplify [157] 16.8% taylor [176] 66.4% [191] 1666(0.2%) 1386(0.2%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 write-proc [203] 16.8% ------------------------------------------------------------------------------------ taylor [176] 100.0% [192] 558(0.1%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [157] 100.0% ------------------------------------------------------------------------------------ taylor [176] 100.0% [193] 550(0.1%) 0(0.0%) taylor-exact ...-testing/src/core/taylor.rkt:252:0 loop [197] 100.0% ------------------------------------------------------------------------------------ taylor [176] 100.0% [194] 282(0.0%) 0(0.0%) ??? ...t-testing/src/function-definitions.rkt:46:2 ...row-higher-order.rkt:375:33 [132] 100.0% ------------------------------------------------------------------------------------ ??? [175] 100.0% [195] 280(0.0%) 280(0.0%) ??? ...lects/racket/contract/private/orc.rkt:117:8 ------------------------------------------------------------------------------------ parse-app [179] 100.0% [196] 278(0.0%) 278(0.0%) identifier? ...ollects/racket/private/stx.rkt:13:4 ------------------------------------------------------------------------------------ err-lsts->split-indices [10] 0.0% set-precompute! [4] 0.1% iterate-egraph! [54] 0.1% taylor-exact [193] 0.1% mk-enode-rec! [62] 0.2% point-best-alt [108] 0.3% loop [47] 0.3% option-on-expr [2] 0.6% ??? [131] 1.2% loop! [72] 2.0% match-e [64] 4.9% ??? [184] 6.0% f8 [168] 6.5% loop [197] 77.7% [197] 260008(29.6%) 8608(1.0%) loop .../private/map.rkt:40:19 loop [197] 77.7% hash-ref! [174] 5.9% f8 [168] 4.7% loop! [72] 1.9% step [209] 1.4% foldl [212] 1.2% option-on-expr [2] 1.1% ...row-higher-order.rkt:375:33 [132] 1.0% errors [120] 0.9% keyword-apply [215] 0.8% ??? [131] 0.4% mk-enode! [70] 0.2% simplify [157] 0.1% set-precompute! [4] 0.1% mk-enode-rec! [62] 0.1% make-multiplication-node [6] 0.1% setfindf [213] 0.1% simplify-node [166] 0.1% free-variables [217] 0.0% rloop [219] 0.0% ??? [19] 0.0% composed [214] 0.0% bf* [211] 0.0% ??? [218] 0.0% ------------------------------------------------------------------------------------ ??? [183] 100.0% [198] 10045(1.1%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [210] 55.5% simple-flat-contract? [208] 44.5% ------------------------------------------------------------------------------------ bigfloat-hash [188] 100.0% [199] 9618(1.1%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [206] 100.0% ------------------------------------------------------------------------------------ ulp-difference [190] 6.8% ??? [141] 10.2% ->flonum [140] 24.2% ??? [159] 24.5% table-ref [96] 34.5% [200] 8035(0.9%) 3040(0.3%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [207] 48.6% reverse [204] 13.6% ------------------------------------------------------------------------------------ table-ref [96] 13.3% ??? [183] 86.7% [201] 4162(0.5%) 3058(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [216] 26.5% ------------------------------------------------------------------------------------ ??? [187] 100.0% [202] 3358(0.4%) 2510(0.3%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [205] 25.3% ------------------------------------------------------------------------------------ debug-print [191] 100.0% [203] 280(0.0%) 280(0.0%) write-proc ...alt-testing/src/alternative.rkt:22:9 ------------------------------------------------------------------------------------ list-cartesian-product [75] 1.0% substitute-e [67] 1.0% compile [138] 2.0% ??? [139] 2.1% hash-has-key? [100] 3.1% ??? [121] 3.1% return/no-unsupplied [200] 4.0% loop [55] 5.0% update-leader! [71] 6.1% one-iter [59] 7.2% contract-struct-name [160] 7.2% ??? [89] 10.2% ??? [82] 11.3% table-ref [96] 13.4% match-e [64] 23.3% [204] 27262(3.1%) 27262(3.1%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------ err-lsts->split-indices [10] 2.6% ??? [121] 2.7% table-ref [96] 5.3% ??? [105] 5.3% ??? [202] 7.9% custom-set-union [90] 10.3% choose-immutable [94] 10.5% ??? [163] 10.7% match-e [64] 13.2% build-compound-type-name [152] 15.7% ??? [169] 15.8% [205] 10688(1.2%) 10688(1.2%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------ bfcanonicalize [199] 100.0% [206] 9618(1.1%) 9618(1.1%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------ loop [55] 3.0% match-e [64] 14.9% one-iter [59] 40.9% return/no-unsupplied [200] 41.3% [207] 9464(1.1%) 9464(1.1%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------ flat-contract? [177] 38.4% contract? [198] 61.6% [208] 7254(0.8%) 7254(0.8%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------ loop [197] 100.0% [209] 6454(0.7%) 5324(0.6%) step .../racket/collects/racket/function.rkt:145:9 sort [227] 8.8% ??? [18] 8.7% ------------------------------------------------------------------------------------ coerce-contract [161] 12.9% contract? [198] 87.1% [210] 6404(0.7%) 3883(0.4%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [223] 39.4% ------------------------------------------------------------------------------------ loop [197] 5.1% ??? [131] 94.9% [211] 5412(0.6%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [220] 100.0% ------------------------------------------------------------------------------------ loop [197] 100.0% [212] 4492(0.5%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [224] 50.0% check-fold [225] 50.0% ------------------------------------------------------------------------------------ loop [197] 100.0% [213] 3613(0.4%) 2218(0.3%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 make-sequence [221] 23.1% ??? [95] 7.8% dict-iterate-next [222] 7.7% ------------------------------------------------------------------------------------ loop [197] 7.9% f8 [168] 23.7% argmins [153] 68.4% [214] 3520(0.4%) 278(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [120] 68.4% f8 [168] 23.7% ------------------------------------------------------------------------------------ loop [197] 100.0% [215] 2774(0.3%) 1388(0.2%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [226] 50.0% ------------------------------------------------------------------------------------ dict? [201] 100.0% [216] 1104(0.1%) 1104(0.1%) assoc? ...et/collects/racket/private/dict.rkt:13:0 ------------------------------------------------------------------------------------ sindices->spoints [13] 16.3% loop [197] 83.7% [217] 838(0.1%) 565(0.1%) free-variables ...t-testing/src/programs.rkt:102:0 f8 [168] 16.3% variable? [73] 16.3% ------------------------------------------------------------------------------------ loop [197] 49.8% err-lsts->split-indices [10] 50.2% [218] 562(0.1%) 562(0.1%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------ loop [197] 1.1% rloop [219] 98.9% [219] 272(0.0%) 272(0.0%) rloop ...ket/collects/racket/private/list.rkt:88:4 rloop [219] 98.9% ------------------------------------------------------------------------------------ bf* [211] 20.0% ??? [131] 80.0% [220] 27087(3.1%) 660(0.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [228] 83.3% bfsin [231] 11.8% ^TYPE? [230] 2.5% ------------------------------------------------------------------------------------ type-of-enode-expr [88] 1.4% set-precompute! [4] 1.4% rewriter [49] 1.4% setfindf [213] 4.1% loop [55] 4.1% ??? [89] 6.9% update-en-expr [93] 9.5% list-cartesian-product [75] 23.3% match-e [64] 46.6% [221] 20329(2.3%) 18377(2.1%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [232] 6.8% ??? [233] 2.8% ------------------------------------------------------------------------------------ setfindf [213] 5.3% loop! [72] 10.5% ->flonum [140] 10.5% one-iter [59] 20.9% match-e [64] 26.2% table-ref [96] 26.5% [222] 5236(0.6%) 5236(0.6%) dict-iterate-next ...ket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------ coerce-contract/f [210] 100.0% [223] 2520(0.3%) 2520(0.3%) coerce-simple-value ...ract/private/guts.rkt:385:0 ------------------------------------------------------------------------------------ foldl [212] 100.0% [224] 2248(0.3%) 282(0.0%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [229] 87.5% ------------------------------------------------------------------------------------ foldl [212] 100.0% [225] 2244(0.3%) 2244(0.3%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------ keyword-apply [215] 100.0% [226] 1386(0.2%) 1386(0.2%) loop ...cket/collects/racket/private/kw.rkt:518:13 ------------------------------------------------------------------------------------ step [209] 100.0% [227] 568(0.1%) 568(0.1%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------------ ??? [220] 100.0% [228] 22564(2.6%) 10108(1.1%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [234] 43.7% ??? [236] 6.4% ??? [237] 5.1% ------------------------------------------------------------------------------------ substitute-e [67] 23.8% merge2 [224] 33.5% assoc-ref [165] 42.7% [229] 5868(0.7%) 5868(0.7%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------ ??? [144] 10.8% ??? [220] 12.3% ??? [183] 35.2% ??? [187] 41.7% [230] 5495(0.6%) 5495(0.6%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------ ??? [220] 100.0% [231] 3186(0.4%) 730(0.1%) bfsin ...-lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [234] 77.1% ------------------------------------------------------------------------------------ make-sequence [221] 100.0% [232] 1388(0.2%) 1388(0.2%) :hash-gen ...collects/racket/private/for.rkt:781:4 ------------------------------------------------------------------------------------ make-sequence [221] 100.0% [233] 564(0.1%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:477:7 custom-in-set [235] 100.0% ------------------------------------------------------------------------------------ bfsin [231] 14.1% real->bigfloat [142] 29.5% bfdiv [228] 56.5% [234] 17476(2.0%) 17476(2.0%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------ ??? [233] 22.4% match-e [64] 77.6% [235] 2520(0.3%) 2520(0.3%) custom-in-set ...acket/private/set-types.rkt:580:0 ------------------------------------------------------------------------------------ bfdiv [228] 100.0% [236] 1450(0.2%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [238] 100.0% ------------------------------------------------------------------------------------ bfdiv [228] 100.0% [237] 1140(0.1%) 1140(0.1%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ------------------------------------------------------------------------------------ ??? [236] 100.0% [238] 1450(0.2%) 1450(0.2%) assq ...et/collects/racket/private/list.rkt:187:13 ------------------------------------------------------------------------------------