Profiling results ----------------- Total cpu time observed: 200934ms (out of 201764ms) Number of samples taken: 592 (once every 339ms) (Hiding functions with self<1.0% and local<2.0%: 9 of 200 hidden) ============================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================ ??? [56] 100.0% [1] 188644(93.9%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [12] 100.0% ---------------------------------------------------------------------------- ??? [56] 100.0% [2] 78926(39.3%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 for-loop [14] 82.8% get-final-combination [16] 15.5% loop [77] 1.2% prepare-points [78] 0.5% ---------------------------------------------------------------------------- ??? [131] 100.0% [3] 43418(21.6%) 336(0.2%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [15] 97.6% ---------------------------------------------------------------------------- loop [130] 100.0% [4] 31388(15.6%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:293:24 eval-errors [13] 98.9% map [104] 1.1% ---------------------------------------------------------------------------- loop [130] 100.0% [5] 28696(14.3%) 630(0.3%) ??? ...herbie/regime-testing/src/points.rkt:289:26 ??? [28] 84.2% ??? [45] 11.3% ulp-difference [33] 2.3% ---------------------------------------------------------------------------- ??? [131] 100.0% [6] 2262(1.1%) 0(0.0%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [17] 100.0% ---------------------------------------------------------------------------- copying-mergesort [178] 100.0% [7] 1610(0.8%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [28] 80.5% ??? [45] 19.5% ---------------------------------------------------------------------------- substitute-e [49] 22.9% match-e [32] 77.1% [8] 1398(0.7%) 0(0.0%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [46] 100.0% ---------------------------------------------------------------------------- loop [130] 100.0% [9] 708(0.4%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 map [104] 50.6% hash-ref! [119] 49.4% ---------------------------------------------------------------------------- hash-ref! [119] 100.0% [10] 632(0.3%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:322:33 for-loop [19] 100.0% ---------------------------------------------------------------------------- parse-loop12 [141] 100.0% [11] 334(0.2%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:99:13 make-multiplication-node [18] 100.0% ---------------------------------------------------------------------------- profile-thunk16 [1] 99.8% [12] 188936(94.0%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [56] 100.0% ---------------------------------------------------------------------------- ??? [56] 0.9% option-on-expr [138] 1.0% composed [97] 1.5% best-and-tied-at-points [93] 19.7% loop [130] 30.0% ??? [4] 46.3% [13] 66978(33.3%) 310(0.2%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [20] 99.5% ---------------------------------------------------------------------------- run-improve50 [2] 100.0% [14] 65378(32.5%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [21] 100.0% ---------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [15] 42388(21.1%) 1784(0.9%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [22] 63.1% for-loop [23] 32.0% ---------------------------------------------------------------------------- run-improve50 [2] 100.0% [16] 12258(6.1%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:266:0 split-table [24] 94.6% extract-alt [27] 5.4% ---------------------------------------------------------------------------- loop [6] 100.0% [17] 2262(1.1%) 0(0.0%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [25] 100.0% ---------------------------------------------------------------------------- for-loop [11] 33.3% parse-loop12 [141] 66.7% [18] 1004(0.5%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [26] 100.0% ---------------------------------------------------------------------------- ??? [10] 100.0% [19] 632(0.3%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:324:46 hash-ref! [119] 100.0% ---------------------------------------------------------------------------- eval-errors [13] 100.0% [20] 66668(33.2%) 2684(1.3%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [28] 81.6% ulp-difference [33] 8.0% ??? [45] 5.9% ??? [116] 0.5% ---------------------------------------------------------------------------- for-loop [14] 100.0% [21] 65378(32.5%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [29] 65.0% finalize-iter! [31] 26.8% gen-series! [34] 4.5% choose-best-alt! [36] 1.6% localize-error [37] 1.1% gen-rewrites! [38] 1.0% ---------------------------------------------------------------------------- one-iter [15] 100.0% [22] 26752(13.3%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [30] 84.9% match-e [32] 15.1% ---------------------------------------------------------------------------- for-loop [23] 48.8% one-iter [15] 51.2% [23] 13550(6.7%) 4070(2.0%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [23] 48.8% match-e [32] 35.0% ---------------------------------------------------------------------------- get-final-combination [16] 100.0% [24] 11600(5.8%) 0(0.0%) split-table ...e/regime-testing/src/glue.rkt:162:0 f137 [124] 100.0% ---------------------------------------------------------------------------- pass [17] 100.0% [25] 2262(1.1%) 0(0.0%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [35] 56.1% loop [40] 29.1% for-loop [42] 14.9% ---------------------------------------------------------------------------- make-multiplication-node [18] 100.0% [26] 1004(0.5%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [39] 65.7% group-by68 [41] 34.3% ---------------------------------------------------------------------------- get-final-combination [16] 100.0% [27] 658(0.3%) 0(0.0%) extract-alt ...ie/regime-testing/src/glue.rkt:55:0 loop [86] 100.0% ---------------------------------------------------------------------------- jloop [7] 1.1% loop [184] 2.6% ??? [5] 21.2% loop [130] 27.3% for-loop [20] 47.8% [28] 113926(56.7%) 1628(0.8%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [43] 86.3% ??? [45] 7.8% ??? [48] 4.4% ---------------------------------------------------------------------------- run-iter! [21] 100.0% [29] 42482(21.1%) 0(0.0%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [44] 100.0% ---------------------------------------------------------------------------- for-loop [22] 100.0% [30] 22706(11.3%) 0(0.0%) for-loop ...e-testing/src/core/simplify.rkt:148:10 loop! [139] 34.5% substitute-e [49] 19.7% merge-egraph-nodes! [50] 19.4% mk-enode! [60] 19.1% list-member? [84] 7.3% ---------------------------------------------------------------------------- run-iter! [21] 100.0% [31] 17538(8.7%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [46] 100.0% ---------------------------------------------------------------------------- for-loop [22] 18.7% for-loop [62] 21.1% for-loop [23] 60.2% [32] 13526(6.7%) 4312(2.1%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [47] 46.8% for-loop [62] 7.8% ??? [46] 7.8% variable? [8] 3.1% filter [186] 2.6% custom-in-set [55] 2.5% ---------------------------------------------------------------------------- ??? [5] 9.4% loop [130] 14.2% for-loop [20] 76.4% [33] 6950(3.5%) 2614(1.3%) ulp-difference ...egime-testing/src/float.rkt:19:0 return/no-unsupplied [177] 42.5% ??? [137] 19.9% ---------------------------------------------------------------------------- run-iter! [21] 100.0% [34] 2928(1.5%) 0(0.0%) gen-series! ...gime-testing/src/mainloop.rkt:129:0 for-loop [51] 100.0% ---------------------------------------------------------------------------- for-loop [25] 100.0% [35] 1268(0.6%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [52] 100.0% ---------------------------------------------------------------------------- run-iter! [21] 100.0% [36] 1042(0.5%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:115:0 ??? [46] 100.0% ---------------------------------------------------------------------------- run-iter! [21] 100.0% [37] 708(0.4%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [119] 100.0% ---------------------------------------------------------------------------- run-iter! [21] 100.0% [38] 680(0.3%) 0(0.0%) gen-rewrites! ...me-testing/src/mainloop.rkt:142:0 for-loop [53] 100.0% ---------------------------------------------------------------------------- make-multiplication-subnode [26] 100.0% [39] 660(0.3%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:242:3 mterm->expr [54] 100.0% ---------------------------------------------------------------------------- for-loop [25] 100.0% [40] 658(0.3%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [52] 100.0% ---------------------------------------------------------------------------- make-multiplication-subnode [26] 100.0% [41] 344(0.2%) 344(0.2%) group-by68 ...acket/collects/racket/list.rkt:749:0 ---------------------------------------------------------------------------- for-loop [25] 100.0% [42] 336(0.2%) 336(0.2%) for-loop ...e-testing/src/core/simplify.rkt:217:13 ---------------------------------------------------------------------------- ??? [28] 100.0% [43] 98358(49.0%) 55730(27.7%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [57] 23.0% ??? [59] 11.0% ??? [61] 7.2% ??? [185] 1.4% ---------------------------------------------------------------------------- simplify! [29] 100.0% [44] 42482(21.1%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [56] 100.0% ---------------------------------------------------------------------------- ??? [112] 1.1% jloop [7] 1.1% map [104] 1.2% loop [85] 2.2% ??? [68] 3.5% ??? [131] 3.9% for-loop [82] 3.9% ??? [5] 11.0% f137 [124] 12.7% for-loop [20] 13.3% loop [130] 15.1% ??? [28] 30.1% [45] 29536(14.7%) 3498(1.7%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [131] 72.9% approximate9 [65] 3.9% best-alt [69] 3.5% ??? [183] 3.5% ??? [132] 2.2% hash-ref! [119] 2.2% ---------------------------------------------------------------------------- f137 [124] 2.5% substitute-e [49] 2.5% ??? [183] 3.4% get-sigs [107] 3.9% choose-best-alt! [36] 4.1% variable? [8] 5.5% match-e [32] 8.2% finalize-iter! [31] 68.5% [46] 25380(12.6%) 3758(1.9%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [58] 64.7% hash-has-key? [81] 11.2% ??? [68] 4.1% atab-add-altns [70] 3.8% ??? [183] 1.4% ---------------------------------------------------------------------------- match-e [32] 100.0% [47] 7408(3.7%) 3318(1.7%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [62] 52.7% curry* [72] 6.9% curried [187] 2.2% ---------------------------------------------------------------------------- ??? [28] 100.0% [48] 5052(2.5%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [63] 100.0% ---------------------------------------------------------------------------- substitute-e [49] 17.6% for-loop [30] 82.4% [49] 4464(2.2%) 608(0.3%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [60] 64.8% substitute-e [49] 17.6% ??? [46] 6.0% variable? [8] 2.4% ---------------------------------------------------------------------------- merge-egraph-nodes! [50] 4.1% for-loop [66] 17.5% for-loop [30] 78.4% [50] 4396(2.2%) 370(0.2%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 for-loop [67] 30.7% for-loop [66] 25.7% update-leader! [71] 16.9% loop! [139] 14.3% merge-egraph-nodes! [50] 4.1% ---------------------------------------------------------------------------- gen-series! [34] 100.0% [51] 2928(1.5%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:135:7 taylor-alt [64] 100.0% ---------------------------------------------------------------------------- loop [40] 34.2% argmin [35] 65.8% [52] 1926(1.0%) 0(0.0%) for-loop .../regime-testing/src/programs.rkt:210:2 ??? [131] 66.6% ??? [132] 17.3% ...sting/src/common.rkt:48:2 [115] 16.1% ---------------------------------------------------------------------------- gen-rewrites! [38] 100.0% [53] 680(0.3%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:147:11 ??? [73] 100.0% ---------------------------------------------------------------------------- for-loop [39] 100.0% [54] 660(0.3%) 0(0.0%) mterm->expr ...e-testing/src/core/reduce.rkt:270:0 f137 [124] 100.0% ---------------------------------------------------------------------------- match-e [32] 100.0% [55] 336(0.2%) 336(0.2%) custom-in-set ...acket/private/set-types.rkt:577:0 ---------------------------------------------------------------------------- for-loop [44] 7.1% run [12] 43.8% [56] 199970(99.5%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 43.7% run-improve50 [2] 16.5% baseline-error [74] 12.6% oracle-error [75] 11.9% ??? [131] 9.4% loop [77] 2.8% prepare-points [78] 2.7% eval-errors [13] 0.2% loop [130] 0.1% ---------------------------------------------------------------------------- ??? [43] 100.0% [57] 22618(11.3%) 11782(5.9%) ??? ...regime-testing/src/syntax/syntax.rkt:156:17 ??? [137] 28.2% return/no-unsupplied [177] 18.2% list-member? [84] 1.5% ---------------------------------------------------------------------------- ??? [46] 100.0% [58] 16578(8.3%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [76] 100.0% ---------------------------------------------------------------------------- ??? [43] 100.0% [59] 10832(5.4%) 10832(5.4%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ---------------------------------------------------------------------------- mk-egraph [143] 4.1% mk-enode-rec! [156] 8.2% substitute-e [49] 35.1% for-loop [30] 52.6% [60] 8248(4.1%) 312(0.2%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [79] 92.0% hash-has-key? [81] 4.2% ---------------------------------------------------------------------------- ??? [43] 100.0% [61] 7094(3.5%) 1014(0.5%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfadd [80] 54.9% bfsqrt [83] 30.8% ---------------------------------------------------------------------------- match-e [32] 23.1% for-loop [47] 76.9% [62] 6154(3.1%) 350(0.2%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [32] 83.3% ??? [91] 11.0% ---------------------------------------------------------------------------- ??? [48] 100.0% [63] 5052(2.5%) 4020(2.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [96] 20.4% ---------------------------------------------------------------------------- for-loop [51] 100.0% [64] 2928(1.5%) 0(0.0%) taylor-alt ...ie/regime-testing/src/glue.rkt:134:0 for-loop [82] 100.0% ---------------------------------------------------------------------------- ??? [45] 100.0% [65] 2928(1.5%) 0(0.0%) approximate9 ...e-testing/src/core/taylor.rkt:12:0 loop [85] 66.9% taylor-sqrt [87] 22.8% f137 [124] 10.2% ---------------------------------------------------------------------------- merge-egraph-nodes! [50] 100.0% [66] 1684(0.8%) 0(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [50] 78.6% loop! [139] 21.4% ---------------------------------------------------------------------------- merge-egraph-nodes! [50] 100.0% [67] 1348(0.7%) 1348(0.7%) for-loop ...gime-testing/src/core/egraph.rkt:233:6 ---------------------------------------------------------------------------- ??? [46] 100.0% [68] 1042(0.5%) 0(0.0%) ??? .../regime-testing/src/core/alt-table.rkt:54:0 ??? [45] 100.0% ---------------------------------------------------------------------------- ??? [45] 100.0% [69] 1042(0.5%) 0(0.0%) best-alt ...erbie/regime-testing/src/glue.rkt:71:0 loop [86] 100.0% ---------------------------------------------------------------------------- ??? [46] 100.0% [70] 960(0.5%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:50:0 atab-add-altn [76] 100.0% ---------------------------------------------------------------------------- merge-egraph-nodes! [50] 100.0% [71] 958(0.5%) 0(0.0%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [88] 100.0% ---------------------------------------------------------------------------- for-loop [47] 100.0% [72] 692(0.3%) 0(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [89] 100.0% ---------------------------------------------------------------------------- for-loop [53] 100.0% [73] 680(0.3%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:88:0 rewriter [90] 100.0% ---------------------------------------------------------------------------- ??? [56] 100.0% [74] 48110(23.9%) 0(0.0%) baseline-error ...ime-testing/src/points.rkt:291:0 loop [130] 100.0% ---------------------------------------------------------------------------- ??? [56] 100.0% [75] 44726(22.3%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:286:0 for-loop [92] 100.0% ---------------------------------------------------------------------------- atab-add-altns [70] 5.5% for-loop [58] 94.5% [76] 17538(8.7%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [93] 98.2% ---------------------------------------------------------------------------- run-improve50 [2] 7.6% ??? [56] 92.4% [77] 12294(6.1%) 292(0.1%) loop ...herbie/regime-testing/src/points.rkt:238:2 loop [94] 43.9% make-exacts* [105] 31.2% loop [106] 22.4% ---------------------------------------------------------------------------- run-improve50 [2] 3.1% ??? [56] 96.9% [78] 11338(5.6%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 make-exacts* [105] 49.6% loop [106] 27.1% loop [94] 20.5% for-loop [103] 2.8% ---------------------------------------------------------------------------- mk-enode! [60] 100.0% [79] 7592(3.8%) 0(0.0%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [95] 100.0% ---------------------------------------------------------------------------- ??? [61] 100.0% [80] 3894(1.9%) 2180(1.1%) bfadd ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [96] 44.0% ---------------------------------------------------------------------------- mk-enode! [60] 10.2% ??? [46] 89.8% [81] 3358(1.7%) 1640(0.8%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [140] 51.2% ---------------------------------------------------------------------------- taylor-alt [64] 100.0% [82] 2928(1.5%) 0(0.0%) for-loop ...rbie/regime-testing/src/glue.rkt:139:6 ??? [45] 100.0% ---------------------------------------------------------------------------- ??? [61] 100.0% [83] 2186(1.1%) 1872(0.9%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [96] 14.4% ---------------------------------------------------------------------------- ??? [57] 16.7% for-loop [30] 83.3% [84] 2002(1.0%) 334(0.2%) list-member? ...llects/racket/private/set.rkt:24:0 loop [98] 83.3% ---------------------------------------------------------------------------- approximate9 [65] 100.0% [85] 1960(1.0%) 0(0.0%) loop ...ie/regime-testing/src/core/taylor.rkt:86:4 ??? [45] 100.0% ---------------------------------------------------------------------------- extract-alt [27] 38.7% best-alt [69] 61.3% [86] 1700(0.8%) 0(0.0%) loop ...herbie/regime-testing/src/common.rkt:154:2 composed [97] 100.0% ---------------------------------------------------------------------------- f137 [124] 31.0% approximate9 [65] 69.0% [87] 968(0.5%) 0(0.0%) taylor-sqrt ...e-testing/src/core/taylor.rkt:346:0 hash-ref! [119] 64.5% simplify [125] 35.5% ---------------------------------------------------------------------------- update-leader! [71] 100.0% [88] 958(0.5%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [99] 100.0% ---------------------------------------------------------------------------- curry* [72] 100.0% [89] 692(0.3%) 692(0.3%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ---------------------------------------------------------------------------- matcher [111] 50.0% ??? [73] 50.0% [90] 680(0.3%) 0(0.0%) rewriter ...ime-testing/src/core/matcher.rkt:131:2 for-loop [100] 50.0% *rules* [102] 25.6% f137 [124] 24.4% ---------------------------------------------------------------------------- for-loop [62] 100.0% [91] 676(0.3%) 326(0.2%) ??? ...bie/regime-testing/src/core/ematch.rkt:50:5 for-loop [101] 51.8% ---------------------------------------------------------------------------- oracle-error [75] 100.0% [92] 44726(22.3%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:288:2 loop [130] 64.2% map [104] 35.8% ---------------------------------------------------------------------------- atab-add-altn [76] 100.0% [93] 17226(8.6%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [13] 76.7% alt-errors [108] 17.8% for-loop [109] 5.6% ---------------------------------------------------------------------------- prepare-points [78] 30.1% loop [77] 69.9% [94] 7730(3.8%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 make-exacts* [105] 65.1% loop [106] 34.9% ---------------------------------------------------------------------------- new-enode [79] 100.0% [95] 7592(3.8%) 310(0.2%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [107] 95.9% ---------------------------------------------------------------------------- bfsqrt [83] 10.3% real->bigfloat [63] 33.7% bfadd [80] 56.0% [96] 3060(1.5%) 3060(1.5%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ---------------------------------------------------------------------------- loop [86] 100.0% [97] 1700(0.8%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 eval-errors [13] 60.7% alt-errors [108] 39.3% ---------------------------------------------------------------------------- list-member? [84] 100.0% [98] 1668(0.8%) 1668(0.8%) loop (unknown source) ---------------------------------------------------------------------------- for-loop [88] 100.0% [99] 958(0.5%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [110] 100.0% ---------------------------------------------------------------------------- rewriter [90] 100.0% [100] 680(0.3%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:134:10 matcher [111] 100.0% ---------------------------------------------------------------------------- ??? [91] 100.0% [101] 350(0.2%) 350(0.2%) for-loop ...egime-testing/src/core/ematch.rkt:51:7 ---------------------------------------------------------------------------- rewriter [90] 100.0% [102] 348(0.2%) 0(0.0%) *rules* ...gime-testing/src/syntax/rules.rkt:565:0 for-loop [155] 100.0% ---------------------------------------------------------------------------- prepare-points [78] 100.0% [103] 312(0.2%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [112] 100.0% ---------------------------------------------------------------------------- ??? [9] 2.0% ??? [4] 2.0% f137 [124] 5.5% for-loop [92] 90.5% [104] 17678(8.8%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [130] 92.5% parse-loop12 [141] 3.6% ??? [45] 2.0% simplify-node [117] 1.9% ---------------------------------------------------------------------------- loop [77] 26.5% loop [94] 34.7% prepare-points [78] 38.8% [105] 14496(7.2%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 loop [130] 80.0% eval-prog [113] 20.0% ---------------------------------------------------------------------------- loop [94] 31.6% loop [77] 32.3% prepare-points [78] 36.0% [106] 8532(4.2%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [130] 100.0% ---------------------------------------------------------------------------- type-of-enode-expr [95] 100.0% [107] 7282(3.6%) 0(0.0%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ??? [132] 46.3% ??? [131] 31.6% ??? [46] 13.5% ...sting/src/common.rkt:48:2 [115] 8.7% ---------------------------------------------------------------------------- composed [97] 14.2% loop [130] 20.7% best-and-tied-at-points [93] 65.1% [108] 4696(2.3%) 0(0.0%) alt-errors ...ime-testing/src/alternative.rkt:59:0 eval-prog [113] 100.0% ---------------------------------------------------------------------------- best-and-tied-at-points [93] 100.0% [109] 964(0.5%) 642(0.3%) for-loop ...-testing/src/core/alt-table.rkt:124:16 ??? [116] 33.4% ---------------------------------------------------------------------------- for-loop [99] 100.0% [110] 958(0.5%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [114] 100.0% ---------------------------------------------------------------------------- for-loop [118] 24.4% matcher [111] 25.6% for-loop [100] 50.0% [111] 680(0.3%) 0(0.0%) matcher ...gime-testing/src/core/matcher.rkt:167:2 rewriter [90] 50.0% matcher [111] 25.6% for-loop [118] 24.4% ---------------------------------------------------------------------------- for-loop [103] 100.0% [112] 312(0.2%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 ??? [45] 100.0% ---------------------------------------------------------------------------- point->alt [168] 4.1% loop [130] 4.2% make-exacts* [105] 35.1% alt-errors [108] 56.7% [113] 8284(4.1%) 1620(0.8%) eval-prog ...regime-testing/src/programs.rkt:150:0 f137 [124] 45.2% hash-ref! [119] 30.9% ??? [122] 4.3% ---------------------------------------------------------------------------- hash-update! [110] 100.0% [114] 958(0.5%) 0(0.0%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [120] 100.0% ---------------------------------------------------------------------------- for-loop [52] 32.8% get-sigs [107] 67.2% [115] 944(0.5%) 324(0.2%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [121] 65.7% ---------------------------------------------------------------------------- for-loop [109] 49.1% for-loop [20] 50.9% [116] 656(0.3%) 656(0.3%) ??? ...ket/collects/racket/private/for.rkt:1151:14 ---------------------------------------------------------------------------- map [104] 100.0% [117] 334(0.2%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 append-map [123] 100.0% ---------------------------------------------------------------------------- matcher [111] 100.0% [118] 332(0.2%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:183:21 matcher [111] 100.0% ---------------------------------------------------------------------------- ??? [9] 3.0% for-loop [19] 4.5% taylor-sqrt [87] 8.1% localize-error [37] 9.1% ??? [127] 15.8% ??? [45] 15.8% loop [130] 20.9% eval-prog [113] 22.8% [119] 5850(2.9%) 640(0.3%) hash-ref! ...racket/private/more-scheme.rkt:373:13 simplify [125] 23.9% ??? [126] 20.9% bigfloat-hash [128] 18.2% ??? [127] 15.8% parse-loop12 [141] 12.1% ??? [10] 4.5% ---------------------------------------------------------------------------- ??? [114] 100.0% [120] 958(0.5%) 636(0.3%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 update-en-expr [151] 33.6% ---------------------------------------------------------------------------- ...sting/src/common.rkt:48:2 [115] 100.0% [121] 620(0.3%) 0(0.0%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [137] 100.0% ---------------------------------------------------------------------------- eval-prog [113] 100.0% [122] 358(0.2%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [129] 100.0% ---------------------------------------------------------------------------- simplify-node [117] 100.0% [123] 334(0.2%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 f137 [124] 100.0% ---------------------------------------------------------------------------- loop [135] 0.2% append-map [123] 0.6% for-loop [158] 1.0% rewriter [90] 1.0% mterm->expr [54] 1.3% parse-loop12 [141] 1.3% approximate9 [65] 1.7% simplify [125] 5.5% eval-prog [113] 11.2% f137 [124] 11.6% split-table [24] 64.7% [124] 17236(8.6%) 324(0.2%) f137 .../collects/racket/match/compiler.rkt:507:40 loop [130] 49.7% option-on-expr [138] 14.9% f137 [124] 11.6% ??? [45] 11.2% map [104] 3.7% taylor-sqrt [87] 1.7% loop [135] 1.2% expression->type [144] 1.0% ??? [132] 1.0% ??? [46] 0.9% parse-loop12 [141] 0.6% ??? [131] 0.6% ---------------------------------------------------------------------------- taylor-sqrt [87] 11.7% hash-ref! [119] 88.3% [125] 2928(1.5%) 0(0.0%) simplify ...egime-testing/src/core/reduce.rkt:16:0 f137 [124] 54.8% parse-loop12 [141] 45.2% ---------------------------------------------------------------------------- hash-ref! [119] 100.0% [126] 2236(1.1%) 0(0.0%) ??? ...erbie/regime-testing/src/programs.rkt:194:5 loop [130] 100.0% ---------------------------------------------------------------------------- hash-ref! [119] 100.0% [127] 1960(1.0%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:44:15 hash-ref! [119] 100.0% ---------------------------------------------------------------------------- hash-ref! [119] 100.0% [128] 1918(1.0%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 sig+exp->bigfloat [133] 50.3% bfcanonicalize [134] 49.7% ---------------------------------------------------------------------------- ??? [122] 100.0% [129] 358(0.2%) 358(0.2%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ---------------------------------------------------------------------------- ??? [56] 0.0% loop [106] 0.1% make-exacts* [105] 0.2% parse-loop12 [141] 0.2% loop! [139] 1.0% ??? [126] 1.5% option-on-expr [138] 1.6% map [104] 3.3% for-loop [92] 3.9% f137 [124] 5.1% baseline-error [74] 8.2% loop [130] 74.8% [130] 132618(66.0%) 1708(0.9%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [130] 74.8% ??? [4] 5.5% option-on-expr [138] 5.1% ??? [5] 5.1% eval-errors [13] 4.0% ??? [28] 2.0% hash-ref! [119] 1.5% loop! [139] 1.0% ??? [45] 0.4% alt-errors [108] 0.4% parse-loop12 [141] 0.2% ulp-difference [33] 0.1% eval-prog [113] 0.0% ??? [9] 0.0% ---------------------------------------------------------------------------- f137 [124] 0.2% for-loop [52] 0.6% get-sigs [107] 1.1% ??? [131] 5.8% for-loop [136] 28.8% ??? [45] 30.5% ??? [56] 32.9% [131] 70644(35.2%) 11996(6.0%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [3] 30.3% for-loop [136] 28.8% return/no-unsupplied [177] 6.6% ??? [131] 5.8% ??? [137] 5.2% ??? [140] 2.4% ??? [45] 1.6% loop [6] 1.3% *simplify-rules* [145] 0.9% mk-egraph [143] 0.6% ---------------------------------------------------------------------------- f137 [124] 7.1% for-loop [52] 7.1% ??? [45] 14.0% get-sigs [107] 71.8% [132] 4688(2.3%) 668(0.3%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [142] 42.3% for-loop [162] 21.9% get/build-late-neg-projection [181] 7.6% ??? [166] 7.0% ??? [146] 7.0% ---------------------------------------------------------------------------- bigfloat-hash [128] 100.0% [133] 964(0.5%) 964(0.5%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ---------------------------------------------------------------------------- bigfloat-hash [128] 100.0% [134] 954(0.5%) 954(0.5%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ---------------------------------------------------------------------------- f137 [124] 100.0% [135] 646(0.3%) 0(0.0%) loop ...ie/regime-testing/src/core/reduce.rkt:18:2 expression->type [144] 51.4% f137 [124] 48.6% ---------------------------------------------------------------------------- ??? [131] 100.0% [136] 41726(20.8%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ??? [131] 100.0% ---------------------------------------------------------------------------- ??? [121] 5.1% ulp-difference [33] 11.5% ??? [131] 30.6% ??? [57] 52.8% [137] 12078(6.0%) 3082(1.5%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [147] 66.4% ??? [183] 8.1% ---------------------------------------------------------------------------- f137 [124] 26.1% loop [130] 73.9% [138] 11600(5.8%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [130] 43.2% sort-context-on-expr [148] 39.6% err-lsts->split-indices [154] 8.4% eval-errors [13] 5.9% pick-errors [157] 2.9% ---------------------------------------------------------------------------- for-loop [66] 1.9% merge-egraph-nodes! [50] 14.2% loop [130] 23.8% for-loop [30] 60.1% [139] 9560(4.8%) 1030(0.5%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 custom-set-union [149] 46.8% loop [130] 27.2% set [152] 11.3% update-en-expr [151] 9.4% ---------------------------------------------------------------------------- hash-has-key? [81] 32.1% ??? [131] 67.9% [140] 5354(2.7%) 2994(1.5%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [150] 44.1% ---------------------------------------------------------------------------- f137 [124] 3.1% loop [130] 3.8% map [104] 14.0% simplify [125] 19.8% hash-ref! [119] 26.6% parse-loop12 [141] 32.8% [141] 2666(1.3%) 644(0.3%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 parse-loop12 [141] 32.8% loop [130] 30.3% make-multiplication-node [18] 10.5% f137 [124] 7.2% parse-app [159] 5.8% for-loop [11] 3.1% ---------------------------------------------------------------------------- ??? [132] 100.0% [142] 1982(1.0%) 678(0.3%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [153] 65.8% ---------------------------------------------------------------------------- ??? [131] 100.0% [143] 1016(0.5%) 0(0.0%) mk-egraph ...ime-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [156] 66.9% mk-enode! [60] 33.1% ---------------------------------------------------------------------------- loop [135] 50.0% f137 [124] 50.0% [144] 664(0.3%) 332(0.2%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [158] 50.0% ---------------------------------------------------------------------------- ??? [131] 100.0% [145] 632(0.3%) 298(0.1%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 for-loop [155] 52.8% ---------------------------------------------------------------------------- ??? [132] 100.0% [146] 326(0.2%) 326(0.2%) ??? ...private/unconstrained-domain-arrow.rkt:69:2 ---------------------------------------------------------------------------- ??? [137] 100.0% [147] 8022(4.0%) 7300(3.6%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [165] 9.0% ---------------------------------------------------------------------------- option-on-expr [138] 100.0% [148] 4598(2.3%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [160] 100.0% ---------------------------------------------------------------------------- loop! [139] 100.0% [149] 4470(2.2%) 1040(0.5%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [161] 69.2% for-loop [167] 7.5% ---------------------------------------------------------------------------- ??? [140] 100.0% [150] 2360(1.2%) 1006(0.5%) for-loop ...acket/contract/private/list.rkt:743:12 for-loop [162] 43.3% ??? [166] 14.1% ---------------------------------------------------------------------------- for-loop [120] 15.2% loop! [139] 84.8% [151] 2122(1.1%) 2122(1.1%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ---------------------------------------------------------------------------- loop! [139] 100.0% [152] 1940(1.0%) 1940(1.0%) set ...collects/racket/private/set-types.rkt:981:0 ---------------------------------------------------------------------------- ??? [142] 100.0% [153] 1304(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [163] 100.0% ---------------------------------------------------------------------------- option-on-expr [138] 100.0% [154] 970(0.5%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [164] 100.0% ---------------------------------------------------------------------------- *simplify-rules* [145] 49.0% *rules* [102] 51.0% [155] 682(0.3%) 0(0.0%) for-loop ...ie/regime-testing/src/common.rkt:100:9 flag-set? [175] 51.0% ormap [169] 49.0% ---------------------------------------------------------------------------- mk-enode-rec! [156] 32.9% mk-egraph [143] 67.1% [156] 680(0.3%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode! [60] 67.1% mk-enode-rec! [156] 32.9% ---------------------------------------------------------------------------- option-on-expr [138] 100.0% [157] 336(0.2%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 point->alt [168] 100.0% ---------------------------------------------------------------------------- expression->type [144] 100.0% [158] 332(0.2%) 0(0.0%) for-loop ...regime-testing/src/type-check.rkt:52:5 f137 [124] 100.0% ---------------------------------------------------------------------------- parse-loop12 [141] 100.0% [159] 310(0.2%) 310(0.2%) parse-app .../collects/racket/private/kw.rkt:951:2 ---------------------------------------------------------------------------- sort-context-on-expr [148] 100.0% [160] 4598(2.3%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [170] 78.6% loop [184] 21.4% ---------------------------------------------------------------------------- custom-set-union [149] 100.0% [161] 3094(1.5%) 354(0.2%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [171] 88.6% ---------------------------------------------------------------------------- for-loop [150] 49.9% ??? [132] 50.1% [162] 2048(1.0%) 336(0.2%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [172] 83.6% ---------------------------------------------------------------------------- ??? [153] 100.0% [163] 1304(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [173] 100.0% ---------------------------------------------------------------------------- err-lsts->split-indices [154] 100.0% [164] 970(0.5%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [174] 100.0% ---------------------------------------------------------------------------- ??? [147] 100.0% [165] 722(0.4%) 722(0.4%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ---------------------------------------------------------------------------- ??? [132] 49.7% for-loop [150] 50.3% [166] 660(0.3%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [176] 100.0% ---------------------------------------------------------------------------- custom-set-union [149] 100.0% [167] 336(0.2%) 336(0.2%) for-loop ...cts/racket/private/set-types.rkt:152:2 ---------------------------------------------------------------------------- pick-errors [157] 100.0% [168] 336(0.2%) 0(0.0%) point->alt ...e-testing/src/core/regimes.rkt:188:0 eval-prog [113] 100.0% ---------------------------------------------------------------------------- for-loop [155] 100.0% [169] 334(0.2%) 0(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [175] 100.0% ---------------------------------------------------------------------------- ??? [160] 100.0% [170] 3614(1.8%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [178] 81.4% loop [184] 18.6% ---------------------------------------------------------------------------- for-loop [161] 100.0% [171] 2740(1.4%) 2740(1.4%) for-loop ...cts/racket/private/set-types.rkt:178:5 ---------------------------------------------------------------------------- for-loop [162] 100.0% [172] 1712(0.9%) 326(0.2%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [179] 81.0% ---------------------------------------------------------------------------- ??? [163] 100.0% [173] 1304(0.6%) 0(0.0%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [180] 76.1% get/build-late-neg-projection [181] 23.9% ---------------------------------------------------------------------------- add-splitpoint [164] 100.0% [174] 970(0.5%) 324(0.2%) for-loop ...ime-testing/src/core/regimes.rkt:255:4 for-loop [182] 66.6% ---------------------------------------------------------------------------- ormap [169] 49.0% for-loop [155] 51.0% [175] 682(0.3%) 334(0.2%) flag-set? ...ie/regime-testing/src/config.rkt:34:0 return/no-unsupplied [177] 51.0% ---------------------------------------------------------------------------- ??? [166] 100.0% [176] 660(0.3%) 660(0.3%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ---------------------------------------------------------------------------- flag-set? [175] 2.9% ulp-difference [33] 24.4% ??? [57] 34.2% ??? [131] 38.5% [177] 12076(6.0%) 11066(5.5%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [186] 8.4% ---------------------------------------------------------------------------- generic-sort/key [170] 44.5% copying-mergesort [178] 55.5% [178] 2942(1.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [178] 55.5% loop [184] 30.8% jloop [7] 13.7% ---------------------------------------------------------------------------- ??? [172] 100.0% [179] 1386(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [183] 74.0% ??? [185] 26.0% ---------------------------------------------------------------------------- for-loop [173] 100.0% [180] 992(0.5%) 992(0.5%) add-list-context ...ontract/private/list.rkt:752:0 ---------------------------------------------------------------------------- for-loop [173] 46.6% ??? [132] 53.4% [181] 670(0.3%) 358(0.2%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [188] 46.6% ---------------------------------------------------------------------------- for-loop [174] 100.0% [182] 646(0.3%) 346(0.2%) for-loop ...ime-testing/src/core/regimes.rkt:259:8 curried [187] 46.4% ---------------------------------------------------------------------------- ??? [46] 10.6% ??? [137] 28.8% ??? [179] 30.3% ??? [45] 30.3% [183] 3384(1.7%) 2000(1.0%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [46] 30.3% dict? [189] 10.6% ---------------------------------------------------------------------------- generic-sort/key [170] 22.5% ??? [160] 32.9% copying-mergesort [178] 44.6% [184] 2988(1.5%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [28] 100.0% ---------------------------------------------------------------------------- ??? [179] 20.8% ??? [43] 79.2% [185] 1728(0.9%) 1728(0.9%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ---------------------------------------------------------------------------- match-e [32] 26.1% return/no-unsupplied [177] 73.9% [186] 1366(0.7%) 1366(0.7%) filter ...t/collects/racket/private/list.rkt:256:2 ---------------------------------------------------------------------------- for-loop [182] 48.1% for-loop [47] 51.9% [187] 624(0.3%) 624(0.3%) curried ...cket/collects/racket/function.rkt:71:18 ---------------------------------------------------------------------------- get/build-late-neg-projection [181]100.0% [188] 312(0.2%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [190] 100.0% ---------------------------------------------------------------------------- ??? [183] 100.0% [189] 358(0.2%) 358(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 ---------------------------------------------------------------------------- contract-struct-name [191] 50.0% ??? [188] 50.0% [190] 312(0.2%) 312(0.2%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [191] 50.0% ---------------------------------------------------------------------------- build-compound-type-name [190] 100.0% [191] 312(0.2%) 0(0.0%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [190] 100.0% ----------------------------------------------------------------------------