Profiling results ----------------- Total cpu time observed: 2239654ms (out of 2245956ms) Number of samples taken: 6705 (once every 334ms) (Hiding functions with self<1.0% and local<2.0%: 23 of 304 hidden) ============================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================== ??? [70] 100.0% [1] 1865794(83.3%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [20] 100.0% ------------------------------------------------------------------------------ ??? [170] 100.0% [2] 1779434(79.5%) 1584(0.1%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [21] 98.8% debug-print [178] 0.0% ------------------------------------------------------------------------------ ??? [70] 100.0% [3] 1728750(77.2%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 for-loop [22] 98.0% get-final-combination [24] 1.5% setup-alt-simplified [25] 0.5% prepare-points [85] 0.0% ??? [113] 0.0% ------------------------------------------------------------------------------ ??? [170] 100.0% [4] 186562(8.3%) 0(0.0%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [23] 100.0% ------------------------------------------------------------------------------ map [106] 4.4% loop [202] 95.6% [5] 45378(2.0%) 292(0.0%) ??? ...herbie/regime-testing/src/points.rkt:289:26 ??? [151] 91.9% ??? [159] 4.1% ulp-difference [220] 3.4% ------------------------------------------------------------------------------ loop [202] 100.0% [6] 42588(1.9%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:293:24 eval-errors [144] 98.5% map [106] 0.8% loop [281] 0.7% ------------------------------------------------------------------------------ substitute-e [65] 19.2% match-e [52] 80.8% [7] 37884(1.7%) 1624(0.1%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [113] 95.7% ------------------------------------------------------------------------------ loop [202] 98.2% [8] 18646(0.8%) 5820(0.3%) for-loop ...me-testing/src/core/simplify.rkt:195:2 setfindf [26] 32.4% eval-const-expr [28] 17.3% compose [31] 8.8% curried [175] 6.7% ??? [234] 1.8% ??? [174] 1.7% ------------------------------------------------------------------------------ ??? [159] 100.0% [9] 6636(0.3%) 0(0.0%) approximate9 ...e-testing/src/core/taylor.rkt:12:0 loop [27] 85.3% f137 [152] 14.7% ------------------------------------------------------------------------------ hash-ref! [172] 100.0% [10] 4396(0.2%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:44:15 hash-ref! [172] 85.2% ??? [45] 14.8% ------------------------------------------------------------------------------ copying-mergesort [273] 100.0% [11] 2748(0.1%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [151] 100.0% ------------------------------------------------------------------------------ hash-ref! [172] 100.0% [12] 2656(0.1%) 314(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:285:26 for-loop [30] 88.2% ------------------------------------------------------------------------------ hash-ref! [172] 100.0% [13] 2650(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:295:23 for-loop [29] 100.0% ------------------------------------------------------------------------------ rewriter [91] 100.0% [14] 1308(0.1%) 0(0.0%) *rules* ...gime-testing/src/syntax/rules.rkt:565:0 for-loop [206] 100.0% ------------------------------------------------------------------------------ hash-ref! [172] 100.0% [15] 676(0.0%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:392:23 for-loop [32] 100.0% ------------------------------------------------------------------------------ hash-ref! [172] 100.0% [16] 364(0.0%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:483:23 for-loop [34] 100.0% ------------------------------------------------------------------------------ f137 [152] 100.0% [17] 338(0.0%) 0(0.0%) exprs-to-branch-on ...ng/src/core/regimes.rkt:42:0 for-loop [35] 100.0% ------------------------------------------------------------------------------ hash-ref! [172] 100.0% [18] 332(0.0%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:322:33 for-loop [36] 100.0% ------------------------------------------------------------------------------ f137 [152] 100.0% [19] 322(0.0%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 first-nonzero-exp [33] 100.0% ------------------------------------------------------------------------------ profile-thunk16 [1] 100.0% [20] 1866692(83.3%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [70] 100.0% ------------------------------------------------------------------------------ iterate-egraph!13 [2] 100.0% [21] 1757864(78.5%) 25126(1.1%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [38] 76.1% for-loop [39] 22.2% filter [264] 0.1% ------------------------------------------------------------------------------ run-improve50 [3] 100.0% [22] 1694370(75.7%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [37] 100.0% ------------------------------------------------------------------------------ loop [4] 100.0% [23] 186562(8.3%) 972(0.0%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [40] 99.1% ------------------------------------------------------------------------------ run-improve50 [3] 100.0% [24] 25594(1.1%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:266:0 split-table [41] 97.4% extract-alt [47] 2.6% ------------------------------------------------------------------------------ run-improve50 [3] 100.0% [25] 7788(0.3%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [42] 100.0% ------------------------------------------------------------------------------ for-loop [8] 100.0% [26] 6048(0.3%) 3372(0.2%) setfindf ...ie/regime-testing/src/common.rkt:187:0 for-loop [44] 33.1% custom-in-set [267] 6.0% ??? [113] 5.2% ------------------------------------------------------------------------------ approximate9 [9] 100.0% [27] 5660(0.3%) 0(0.0%) loop ...ie/regime-testing/src/core/taylor.rkt:86:4 hash-ref! [172] 59.3% ??? [159] 40.7% ------------------------------------------------------------------------------ for-loop [8] 100.0% [28] 3230(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f137 [152] 88.5% ??? [48] 11.5% ------------------------------------------------------------------------------ ??? [13] 100.0% [29] 2650(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:298:27 hash-ref! [172] 100.0% ------------------------------------------------------------------------------ ??? [12] 100.0% [30] 2342(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:285:52 hash-ref! [172] 62.7% ??? [45] 24.5% simplify [43] 12.8% ------------------------------------------------------------------------------ for-loop [8] 100.0% [31] 1638(0.1%) 1638(0.1%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------------ ??? [15] 100.0% [32] 676(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:396:33 for-loop [46] 100.0% ------------------------------------------------------------------------------ taylor-invert [19] 49.4% taylor-quotient [168] 50.6% [33] 652(0.0%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [172] 50.6% simplify [43] 49.4% ------------------------------------------------------------------------------ ??? [16] 100.0% [34] 364(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:487:35 parse-loop12 [191] 100.0% ------------------------------------------------------------------------------ exprs-to-branch-on [17] 100.0% [35] 338(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:44:27 all-critical-subexpressions [49] 100.0% ------------------------------------------------------------------------------ ??? [18] 100.0% [36] 332(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:324:46 hash-ref! [172] 100.0% ------------------------------------------------------------------------------ for-loop [22] 100.0% [37] 1694370(75.7%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [50] 95.7% finalize-iter! [54] 3.6% gen-series! [56] 0.4% gen-rewrites! [58] 0.2% localize-error [59] 0.1% ------------------------------------------------------------------------------ one-iter [21] 100.0% [38] 1337250(59.7%) 7632(0.3%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [51] 85.5% update-leader! [72] 7.7% match-e [52] 5.9% reduce-to-single! [57] 0.4% ------------------------------------------------------------------------------ for-loop [39] 48.6% one-iter [21] 51.4% [39] 389760(17.4%) 92936(4.1%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [39] 48.6% match-e [52] 37.7% ??? [86] 0.3% ------------------------------------------------------------------------------ pass [23] 100.0% [40] 184930(8.3%) 958(0.0%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [53] 66.8% loop [105] 27.1% for-loop [55] 5.3% make-sequence [236] 0.3% ------------------------------------------------------------------------------ get-final-combination [24] 100.0% [41] 24940(1.1%) 0(0.0%) split-table ...e/regime-testing/src/glue.rkt:162:0 f137 [152] 100.0% ------------------------------------------------------------------------------ setup-alt-simplified [25] 100.0% [42] 7788(0.3%) 0(0.0%) simplify-alt ...e/regime-testing/src/glue.rkt:76:0 ??? [170] 100.0% ------------------------------------------------------------------------------ for-loop [30] 6.0% first-nonzero-exp [33] 6.4% hash-ref! [172] 87.6% [43] 5002(0.2%) 0(0.0%) simplify ...egime-testing/src/core/reduce.rkt:16:0 f137 [152] 54.2% parse-loop12 [191] 20.4% simplify* [117] 19.1% simplify-node [119] 6.3% ------------------------------------------------------------------------------ setfindf [26] 100.0% [44] 2002(0.1%) 2002(0.1%) for-loop ...ie/regime-testing/src/common.rkt:188:2 ------------------------------------------------------------------------------ ??? [10] 39.9% for-loop [30] 60.1% [45] 1628(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:288:19 hash-ref! [172] 100.0% ------------------------------------------------------------------------------ for-loop [32] 100.0% [46] 676(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:398:39 hash-ref! [172] 100.0% ------------------------------------------------------------------------------ get-final-combination [24] 100.0% [47] 654(0.0%) 0(0.0%) extract-alt ...ie/regime-testing/src/glue.rkt:55:0 loop [194] 100.0% ------------------------------------------------------------------------------ eval-const-expr [28] 100.0% [48] 370(0.0%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [60] 100.0% ------------------------------------------------------------------------------ for-loop [35] 100.0% [49] 338(0.0%) 0(0.0%) all-critical-subexpressions ...re/regimes.rkt:58:0 for-loop [61] 100.0% ------------------------------------------------------------------------------ run-iter! [37] 100.0% [50] 1620788(72.4%) 0(0.0%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [62] 100.0% ------------------------------------------------------------------------------ for-loop [38] 100.0% [51] 1142856(51.0%) 4952(0.2%) for-loop ...e-testing/src/core/simplify.rkt:148:10 merge-egraph-nodes! [63] 35.5% mk-enode! [71] 27.3% substitute-e [65] 17.4% loop! [215] 16.7% list-member? [232] 2.7% ------------------------------------------------------------------------------ for-loop [38] 13.5% for-loop [73] 21.6% for-loop [39] 64.9% [52] 372778(16.6%) 154992(6.9%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [64] 43.0% for-loop [73] 7.7% ??? [113] 6.1% variable? [7] 3.5% list-cartesian-product [76] 2.1% loop [202] 0.9% custom-in-set [267] 0.9% curry* [79] 0.4% ------------------------------------------------------------------------------ for-loop [40] 100.0% [53] 123468(5.5%) 1692(0.1%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [114] 88.2% expression-cost [115] 10.4% ------------------------------------------------------------------------------ run-iter! [37] 100.0% [54] 61286(2.7%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [113] 100.0% ------------------------------------------------------------------------------ for-loop [40] 100.0% [55] 9796(0.4%) 9796(0.4%) for-loop ...e-testing/src/core/simplify.rkt:217:13 ------------------------------------------------------------------------------ run-iter! [37] 100.0% [56] 6636(0.3%) 0(0.0%) gen-series! ...gime-testing/src/mainloop.rkt:129:0 for-loop [66] 100.0% ------------------------------------------------------------------------------ for-loop [38] 100.0% [57] 5562(0.2%) 2292(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [68] 47.0% make-sequence [236] 6.0% for-loop [69] 5.8% ------------------------------------------------------------------------------ run-iter! [37] 100.0% [58] 2902(0.1%) 0(0.0%) gen-rewrites! ...me-testing/src/mainloop.rkt:142:0 for-loop [67] 100.0% ------------------------------------------------------------------------------ run-iter! [37] 100.0% [59] 1006(0.0%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [172] 67.2% ??? [253] 32.8% ------------------------------------------------------------------------------ ??? [48] 100.0% [60] 370(0.0%) 370(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 ------------------------------------------------------------------------------ all-critical-subexpressions [49] 100.0% [61] 338(0.0%) 0(0.0%) for-loop ...gime-testing/src/core/regimes.rkt:62:2 f137 [152] 100.0% ------------------------------------------------------------------------------ simplify! [50] 98.9% [62] 1638458(73.2%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [70] 100.0% debug-print [178] 0.0% ------------------------------------------------------------------------------ merge-egraph-nodes! [63] 2.0% for-loop [74] 4.8% for-loop [51] 93.2% [63] 405708(18.1%) 4958(0.2%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [72] 62.7% for-loop [75] 11.1% loop! [215] 9.6% for-loop [74] 9.4% enode-merge! [77] 2.6% merge-egraph-nodes! [63] 2.0% for-loop [206] 1.1% make-sequence [236] 0.2% ------------------------------------------------------------------------------ match-e [52] 100.0% [64] 206310(9.2%) 72322(3.2%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [73] 55.2% list-cartesian-product [76] 8.5% loop [202] 2.8% curry* [79] 0.8% foldl [223] 0.6% filter [264] 0.2% curried [175] 0.2% ------------------------------------------------------------------------------ substitute-e [65] 7.3% for-loop [51] 92.7% [65] 198854(8.9%) 8452(0.4%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [71] 85.9% substitute-e [65] 7.3% ??? [113] 2.4% variable? [7] 1.3% ------------------------------------------------------------------------------ gen-series! [56] 100.0% [66] 6636(0.3%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:135:7 taylor-alt [78] 100.0% ------------------------------------------------------------------------------ gen-rewrites! [58] 100.0% [67] 2902(0.1%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:147:11 ??? [80] 100.0% ------------------------------------------------------------------------------ reduce-to-single! [57] 100.0% [68] 2616(0.1%) 2616(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:326:8 ------------------------------------------------------------------------------ reduce-to-single! [57] 100.0% [69] 322(0.0%) 322(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:329:21 ------------------------------------------------------------------------------ for-loop [62] 25.2% run [20] 30.0% [70] 2215924(98.9%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [170] 39.6% profile-thunk16 [1] 29.9% run-improve50 [3] 26.9% oracle-error [83] 1.6% baseline-error [84] 1.5% prepare-points [85] 0.4% eval-errors [144] 0.0% loop [202] 0.0% ------------------------------------------------------------------------------ mk-egraph [188] 0.1% mk-enode-rec! [205] 1.8% substitute-e [65] 34.7% for-loop [51] 63.4% [71] 491788(22.0%) 48006(2.1%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [81] 88.4% hash-has-key? [123] 1.7% ------------------------------------------------------------------------------ for-loop [38] 28.0% merge-egraph-nodes! [63] 72.0% [72] 367022(16.4%) 18658(0.8%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [82] 92.7% custom-set-union! [89] 1.2% make-sequence [236] 0.4% update-en-expr [230] 0.4% hash-ref! [172] 0.1% ------------------------------------------------------------------------------ match-e [52] 29.6% for-loop [64] 70.4% [73] 165716(7.4%) 12766(0.6%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [52] 88.4% ??? [86] 5.0% ------------------------------------------------------------------------------ merge-egraph-nodes! [63] 100.0% [74] 57218(2.6%) 356(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [63] 67.3% loop! [215] 32.1% ------------------------------------------------------------------------------ merge-egraph-nodes! [63] 100.0% [75] 45186(2.0%) 37158(1.7%) for-loop ...gime-testing/src/core/egraph.rkt:233:6 update-en-expr [230] 17.8% ------------------------------------------------------------------------------ list-cartesian-product [76] 25.3% match-e [52] 25.5% for-loop [64] 49.3% [76] 30518(1.4%) 28178(1.3%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [76] 25.3% for-loop [92] 6.5% ------------------------------------------------------------------------------ merge-egraph-nodes! [63] 100.0% [77] 11192(0.5%) 1638(0.1%) enode-merge! ...e-testing/src/core/enode.rkt:129:0 adopt-enode! [87] 62.0% custom-set-intersect! [90] 23.4% ------------------------------------------------------------------------------ for-loop [66] 100.0% [78] 6636(0.3%) 0(0.0%) taylor-alt ...ie/regime-testing/src/glue.rkt:134:0 for-loop [88] 100.0% ------------------------------------------------------------------------------ match-e [52] 46.3% for-loop [64] 53.7% [79] 3668(0.2%) 1342(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [239] 63.4% ------------------------------------------------------------------------------ for-loop [67] 100.0% [80] 2902(0.1%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:88:0 rewriter [91] 89.4% loop [202] 10.6% ------------------------------------------------------------------------------ mk-enode! [71] 100.0% [81] 434962(19.4%) 2924(0.1%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [93] 98.4% set [231] 0.7% ------------------------------------------------------------------------------ update-leader! [72] 100.0% [82] 340186(15.2%) 7876(0.4%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [94] 97.6% update-en-expr [230] 0.1% ------------------------------------------------------------------------------ ??? [70] 100.0% [83] 66960(3.0%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:286:0 for-loop [95] 100.0% ------------------------------------------------------------------------------ ??? [70] 100.0% [84] 62974(2.8%) 0(0.0%) baseline-error ...ime-testing/src/points.rkt:291:0 loop [202] 100.0% ------------------------------------------------------------------------------ run-improve50 [3] 3.0% pred [278] 15.9% ??? [70] 81.1% [85] 21296(1.0%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 make-exacts* [107] 44.6% loop [96] 30.3% loop [108] 22.1% for-loop [100] 1.6% filter-points [102] 1.4% ------------------------------------------------------------------------------ for-loop [39] 24.0% for-loop [73] 76.0% [86] 10836(0.5%) 6240(0.3%) ??? ...bie/regime-testing/src/core/ematch.rkt:50:5 for-loop [97] 39.1% custom-in-set [267] 3.3% ------------------------------------------------------------------------------ enode-merge! [77] 100.0% [87] 6934(0.3%) 3932(0.2%) adopt-enode! ...e-testing/src/core/enode.rkt:105:0 custom-set-union [229] 43.3% ------------------------------------------------------------------------------ taylor-alt [78] 100.0% [88] 6636(0.3%) 0(0.0%) for-loop ...rbie/regime-testing/src/glue.rkt:139:6 ??? [159] 100.0% ------------------------------------------------------------------------------ update-leader! [72] 100.0% [89] 4554(0.2%) 1896(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [98] 58.4% ------------------------------------------------------------------------------ enode-merge! [77] 100.0% [90] 2620(0.1%) 2320(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 for-loop [101] 11.5% ------------------------------------------------------------------------------ ??? [80] 28.6% matcher [109] 71.4% [91] 2594(0.1%) 620(0.0%) rewriter ...ime-testing/src/core/matcher.rkt:131:2 for-loop [99] 71.4% *rules* [14] 12.7% expression->type [179] 10.5% ------------------------------------------------------------------------------ list-cartesian-product [76] 100.0% [92] 2340(0.1%) 2340(0.1%) for-loop ...egime-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------ new-enode [81] 100.0% [93] 428150(19.1%) 6952(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [103] 97.9% parse-loop12 [191] 0.5% ------------------------------------------------------------------------------ for-loop [82] 100.0% [94] 331992(14.8%) 2028(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [104] 99.4% ------------------------------------------------------------------------------ oracle-error [83] 100.0% [95] 66960(3.0%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:288:2 loop [202] 62.8% map [106] 36.7% loop [105] 0.4% ------------------------------------------------------------------------------ prepare-points [85] 100.0% [96] 6448(0.3%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 loop [108] 62.2% make-exacts* [107] 37.8% ------------------------------------------------------------------------------ ??? [86] 100.0% [97] 4236(0.2%) 986(0.0%) for-loop ...egime-testing/src/core/ematch.rkt:51:7 ??? [113] 76.7% ------------------------------------------------------------------------------ custom-set-union! [89] 100.0% [98] 2658(0.1%) 2658(0.1%) for-loop ...cts/racket/private/set-types.rkt:253:4 ------------------------------------------------------------------------------ rewriter [91] 100.0% [99] 2594(0.1%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:134:10 matcher [109] 100.0% ------------------------------------------------------------------------------ prepare-points [85] 100.0% [100] 348(0.0%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [110] 100.0% ------------------------------------------------------------------------------ custom-set-intersect! [90] 100.0% [101] 300(0.0%) 300(0.0%) for-loop ...cts/racket/private/set-types.rkt:272:4 ------------------------------------------------------------------------------ prepare-points [85] 100.0% [102] 300(0.0%) 0(0.0%) filter-points ...gime-testing/src/points.rkt:171:0 for-loop [111] 100.0% ------------------------------------------------------------------------------ type-of-enode-expr [93] 100.0% [103] 419232(18.7%) 9654(0.4%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ??? [122] 37.8% ??? [170] 33.0% ??? [113] 14.3% ...sting/src/common.rkt:48:2 [124] 12.6% ------------------------------------------------------------------------------ for-loop [94] 100.0% [104] 329964(14.7%) 3034(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [112] 99.1% ------------------------------------------------------------------------------ for-loop [95] 0.6% for-loop [40] 99.4% [105] 50376(2.2%) 956(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [114] 88.9% expression-cost [115] 9.2% ------------------------------------------------------------------------------ ??? [6] 1.2% ??? [118] 1.2% f137 [152] 10.6% for-loop [95] 87.0% [106] 28280(1.3%) 324(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [202] 81.1% ??? [5] 7.1% f137 [152] 7.0% ??? [159] 1.2% loop [251] 1.2% make-multiplication-node [120] 0.6% ??? [118] 0.4% simplify-node [119] 0.2% simplify* [117] 0.1% ------------------------------------------------------------------------------ loop [96] 20.5% prepare-points [85] 79.5% [107] 11928(0.5%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 loop [202] 63.7% eval-prog [150] 36.3% ------------------------------------------------------------------------------ loop [96] 46.0% prepare-points [85] 54.0% [108] 8720(0.4%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [202] 100.0% ------------------------------------------------------------------------------ for-loop [116] 16.5% matcher [109] 33.5% for-loop [99] 50.0% [109] 2594(0.1%) 0(0.0%) matcher ...gime-testing/src/core/matcher.rkt:167:2 rewriter [91] 50.0% matcher [109] 33.5% for-loop [116] 16.5% ------------------------------------------------------------------------------ for-loop [100] 100.0% [110] 348(0.0%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 ??? [159] 100.0% ------------------------------------------------------------------------------ filter-points [102] 100.0% [111] 300(0.0%) 300(0.0%) for-loop ...ie/regime-testing/src/points.rkt:174:4 ------------------------------------------------------------------------------ hash-update! [104] 100.0% [112] 326930(14.6%) 4952(0.2%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [121] 97.7% make-sequence [236] 0.8% ------------------------------------------------------------------------------ run-improve50 [3] 0.1% f137 [152] 0.1% setfindf [26] 0.1% for-loop [97] 1.5% ??? [261] 1.5% substitute-e [65] 5.6% variable? [7] 16.4% match-e [52] 19.0% get-sigs [103] 27.3% finalize-iter! [54] 27.4% [113] 220506(9.8%) 70374(3.1%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [123] 39.0% for-loop [125] 27.0% ??? [261] 0.9% ??? [127] 0.8% atab-add-altns [128] 0.5% ------------------------------------------------------------------------------ loop [105] 29.1% argmin [53] 70.9% [114] 153666(6.9%) 2632(0.1%) for-loop .../regime-testing/src/programs.rkt:210:2 ??? [170] 73.7% ...sting/src/common.rkt:48:2 [124] 22.0% ??? [122] 2.6% ------------------------------------------------------------------------------ loop [105] 26.5% argmin [53] 73.5% [115] 17530(0.8%) 672(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [126] 96.2% ------------------------------------------------------------------------------ matcher [109] 100.0% [116] 1928(0.1%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:183:21 matcher [109] 100.0% ------------------------------------------------------------------------------ map [106] 27.7% simplify [43] 72.3% [117] 1320(0.1%) 312(0.0%) simplify* ...gime-testing/src/core/reduce.rkt:31:0 return/no-unsupplied [248] 27.7% ??? [130] 25.0% hash-ref! [172] 23.6% ------------------------------------------------------------------------------ map [106] 48.3% loop [202] 51.7% [118] 1308(0.1%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 f137 [152] 48.3% hash-ref! [172] 46.4% map [106] 5.3% ------------------------------------------------------------------------------ simplify [43] 46.6% map [106] 53.4% [119] 674(0.0%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 f137 [152] 53.4% append-map [163] 46.6% ------------------------------------------------------------------------------ parse-loop12 [191] 48.0% map [106] 52.0% [120] 654(0.0%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [129] 100.0% ------------------------------------------------------------------------------ ??? [112] 100.0% [121] 319314(14.3%) 275208(12.3%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 update-en-expr [230] 13.8% ------------------------------------------------------------------------------ f137 [152] 0.4% ??? [159] 0.8% for-loop [114] 2.4% get-sigs [103] 96.4% [122] 164254(7.3%) 7012(0.3%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [131] 50.1% for-loop [132] 38.1% get/build-late-neg-projection [154] 5.3% ??? [221] 0.6% ??? [136] 0.4% ??? [217] 0.2% ------------------------------------------------------------------------------ mk-enode! [71] 8.9% ??? [113] 91.1% [123] 95188(4.3%) 28834(1.3%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [185] 64.7% ??? [190] 5.0% ------------------------------------------------------------------------------ ??? [159] 2.3% for-loop [114] 38.1% get-sigs [103] 59.6% [124] 88656(4.0%) 25416(1.1%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [134] 35.7% ??? [135] 34.8% ------------------------------------------------------------------------------ ??? [113] 100.0% [125] 60264(2.7%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [133] 100.0% ------------------------------------------------------------------------------ expression-cost [115] 100.0% [126] 16858(0.8%) 350(0.0%) compile ...e/regime-testing/src/programs.rkt:186:0 hash-ref! [172] 97.9% ------------------------------------------------------------------------------ ??? [113] 100.0% [127] 1752(0.1%) 0(0.0%) ??? .../regime-testing/src/core/alt-table.rkt:54:0 ??? [159] 100.0% ------------------------------------------------------------------------------ ??? [113] 100.0% [128] 1384(0.1%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:50:0 atab-add-altn [133] 100.0% ------------------------------------------------------------------------------ make-multiplication-node [120] 100.0% [129] 654(0.0%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 group-by68 [137] 52.0% for-loop [138] 48.0% ------------------------------------------------------------------------------ simplify* [117] 100.0% [130] 330(0.0%) 330(0.0%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ------------------------------------------------------------------------------ ??? [122] 100.0% [131] 82320(3.7%) 4958(0.2%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [139] 94.0% ------------------------------------------------------------------------------ for-loop [203] 21.1% ??? [122] 78.9% [132] 79414(3.5%) 12656(0.6%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [204] 80.7% ??? [234] 3.3% ------------------------------------------------------------------------------ atab-add-altns [128] 2.2% for-loop [125] 97.8% [133] 61648(2.8%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [140] 100.0% ------------------------------------------------------------------------------ for-loop [219] 7.9% ??? [204] 13.4% ...sting/src/common.rkt:48:2 [124] 78.7% [134] 31622(1.4%) 9400(0.4%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [204] 70.3% ??? [261] 9.6% ??? [221] 2.2% ------------------------------------------------------------------------------ ...sting/src/common.rkt:48:2 [124] 100.0% [135] 30888(1.4%) 10642(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [246] 29.4% return/no-unsupplied [248] 18.9% assoc-ref [141] 17.2% ------------------------------------------------------------------------------ ??? [122] 100.0% [136] 660(0.0%) 358(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:69:2 get-blame-party-info [143] 45.8% ------------------------------------------------------------------------------ make-multiplication-subnode [129] 100.0% [137] 340(0.0%) 340(0.0%) group-by68 ...acket/collects/racket/list.rkt:749:0 ------------------------------------------------------------------------------ make-multiplication-subnode [129] 100.0% [138] 314(0.0%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:242:3 mterm->expr [142] 100.0% ------------------------------------------------------------------------------ ??? [131] 100.0% [139] 77362(3.5%) 2360(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [145] 96.9% ------------------------------------------------------------------------------ atab-add-altn [133] 100.0% [140] 61648(2.8%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [144] 78.6% alt-errors [146] 15.5% for-loop [147] 5.9% ------------------------------------------------------------------------------ ??? [135] 100.0% [141] 5306(0.2%) 5306(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------ for-loop [138] 100.0% [142] 314(0.0%) 0(0.0%) mterm->expr ...e-testing/src/core/reduce.rkt:270:0 f137 [152] 100.0% ------------------------------------------------------------------------------ ??? [136] 100.0% [143] 302(0.0%) 302(0.0%) get-blame-party-info ...ate/arrow-common.rkt:136:0 ------------------------------------------------------------------------------ pred [278] 0.9% option-on-expr [218] 1.6% composed [208] 1.7% ??? [70] 1.8% loop [202] 20.8% ??? [6] 34.0% best-and-tied-at-points [140] 39.3% [144] 123336(5.5%) 322(0.0%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [148] 99.5% ------------------------------------------------------------------------------ ??? [139] 100.0% [145] 75002(3.3%) 4962(0.2%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [149] 93.4% ------------------------------------------------------------------------------ composed [208] 3.1% option-on-expr [218] 3.1% loop [202] 6.4% best-and-tied-at-points [140] 87.4% [146] 10934(0.5%) 0(0.0%) alt-errors ...ime-testing/src/alternative.rkt:59:0 eval-prog [150] 100.0% ------------------------------------------------------------------------------ best-and-tied-at-points [140] 100.0% [147] 3638(0.2%) 3306(0.1%) for-loop ...-testing/src/core/alt-table.rkt:124:16 ??? [155] 9.1% ------------------------------------------------------------------------------ eval-errors [144] 100.0% [148] 122706(5.5%) 4572(0.2%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [151] 88.1% ??? [159] 4.6% ulp-difference [220] 3.1% ??? [155] 0.5% ------------------------------------------------------------------------------ ??? [145] 100.0% [149] 70040(3.1%) 15686(0.7%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [153] 49.7% get/build-late-neg-projection [154] 27.9% ------------------------------------------------------------------------------ point->alt [259] 1.7% option-on-expr [218] 1.9% sindices->spoints [235] 3.4% loop [202] 4.9% pred [278] 8.6% make-exacts* [107] 22.6% alt-errors [146] 57.0% [150] 19198(0.9%) 2538(0.1%) eval-prog ...regime-testing/src/programs.rkt:150:0 f137 [152] 65.8% hash-ref! [172] 15.5% ??? [156] 3.8% go [157] 1.7% ------------------------------------------------------------------------------ ??? [269] 0.7% loop [279] 1.2% jloop [11] 1.4% loop [202] 18.5% ??? [5] 21.7% for-loop [148] 56.4% [151] 191746(8.6%) 3232(0.1%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [158] 88.3% ??? [159] 8.9% ??? [162] 0.9% ------------------------------------------------------------------------------ parse-loop12 [191] 0.1% for-loop [212] 0.1% simplify-node [119] 0.1% free-variables [271] 0.1% ??? [118] 0.1% for-loop [61] 0.2% mterm->expr [142] 0.4% append-map [163] 1.0% hash-ref! [172] 1.2% approximate9 [9] 1.3% simplify [43] 2.0% for-loop [195] 2.1% map [106] 3.0% eval-const-expr [28] 6.9% eval-prog [150] 7.8% f137 [152] 23.7% split-table [41] 50.0% [152] 41678(1.9%) 2560(0.1%) f137 .../collects/racket/match/compiler.rkt:507:40 loop [202] 41.4% f137 [152] 23.7% option-on-expr [218] 8.4% ??? [159] 7.5% ??? [170] 5.0% map [106] 5.0% append-map [163] 1.2% ??? [122] 0.9% taylor-quotient [168] 0.8% expression->type [179] 0.7% loop [164] 0.4% ??? [113] 0.4% exprs-to-branch-on [17] 0.2% taylor-invert [19] 0.1% parse-loop12 [191] 0.1% gather-multiplicative-terms [166] 0.1% taylor [167] 0.1% ------------------------------------------------------------------------------ for-loop [149] 100.0% [153] 34828(1.6%) 34828(1.6%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------ ??? [161] 12.3% ??? [122] 17.6% for-loop [149] 69.2% [154] 28224(1.3%) 6162(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [160] 67.9% ??? [161] 14.6% ------------------------------------------------------------------------------ for-loop [147] 34.2% for-loop [148] 65.8% [155] 972(0.0%) 972(0.0%) ??? ...ket/collects/racket/private/for.rkt:1151:14 ------------------------------------------------------------------------------ eval-prog [150] 100.0% [156] 724(0.0%) 360(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [165] 50.3% ------------------------------------------------------------------------------ eval-prog [150] 100.0% [157] 324(0.0%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [169] 100.0% ------------------------------------------------------------------------------ ??? [151] 100.0% [158] 169372(7.6%) 116704(5.2%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [171] 16.8% ??? [174] 7.9% ??? [189] 3.9% ??? [234] 1.1% bf* [180] 0.7% parse-loop12 [191] 0.2% for-loop [183] 0.2% ------------------------------------------------------------------------------ ??? [244] 0.7% map [106] 0.7% ??? [110] 0.7% loop [27] 1.6% loop [202] 2.1% ??? [192] 2.4% ??? [127] 3.4% ??? [5] 4.0% ??? [170] 5.1% for-loop [88] 5.1% for-loop [148] 11.9% f137 [152] 25.6% ??? [151] 36.0% [159] 46876(2.1%) 2884(0.1%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [170] 66.3% ??? [261] 7.8% approximate9 [9] 5.1% ...sting/src/common.rkt:48:2 [124] 4.4% hash-ref! [172] 4.0% best-alt [176] 3.4% ??? [122] 2.9% ------------------------------------------------------------------------------ get/build-late-neg-projection [154]100.0% [160] 21418(1.0%) 4632(0.2%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [173] 78.4% ------------------------------------------------------------------------------ get/build-late-neg-projection [154]100.0% [161] 7704(0.3%) 644(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [154] 91.6% ------------------------------------------------------------------------------ ??? [151] 100.0% [162] 1746(0.1%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [177] 100.0% ------------------------------------------------------------------------------ simplify-node [119] 32.2% f137 [152] 67.8% [163] 976(0.0%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 f137 [152] 56.3% parse-loop12 [191] 32.2% loop [182] 11.5% ------------------------------------------------------------------------------ f137 [152] 100.0% [164] 688(0.0%) 0(0.0%) loop ...ie/regime-testing/src/core/reduce.rkt:18:2 type-of [181] 52.6% expression->type [179] 47.4% ------------------------------------------------------------------------------ ??? [156] 100.0% [165] 364(0.0%) 364(0.0%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------ f137 [152] 100.0% [166] 360(0.0%) 0(0.0%) gather-multiplicative-terms ...re/reduce.rkt:116:0 curried [175] 100.0% ------------------------------------------------------------------------------ f137 [152] 100.0% [167] 332(0.0%) 0(0.0%) taylor ...regime-testing/src/core/taylor.rkt:163:0 debug-print [178] 100.0% ------------------------------------------------------------------------------ f137 [152] 100.0% [168] 330(0.0%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [33] 100.0% ------------------------------------------------------------------------------ go [157] 9.1% loop [169] 90.9% [169] 324(0.0%) 324(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [169] 90.9% ------------------------------------------------------------------------------ f137 [152] 0.0% simplify-alt [42] 0.2% ??? [159] 1.5% for-loop [114] 1.9% get-sigs [103] 2.3% ??? [170] 2.5% for-loop [184] 44.7% ??? [70] 46.5% [170] 2012742(89.9%) 78848(3.5%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [184] 44.7% iterate-egraph!13 [2] 43.1% loop [4] 3.7% ??? [185] 3.0% ??? [170] 2.5% return/no-unsupplied [248] 0.3% ??? [246] 0.3% mk-egraph [188] 0.2% ??? [159] 0.1% ??? [204] 0.1% *simplify-rules* [197] 0.0% ??? [199] 0.0% list-member? [232] 0.0% dict? [274] 0.0% ??? [201] 0.0% ??? [190] 0.0% ------------------------------------------------------------------------------ ??? [158] 100.0% [171] 28472(1.3%) 17796(0.8%) ??? ...regime-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [248] 21.4% ??? [246] 16.1% ------------------------------------------------------------------------------ simplify* [117] 0.3% for-loop [36] 0.3% for-loop [46] 0.4% localize-error [59] 0.5% update-leader! [72] 1.2% first-nonzero-exp [33] 1.2% ??? [45] 1.7% ??? [118] 2.0% for-loop [30] 2.1% for-loop [29] 2.6% ??? [10] 3.0% loop [27] 3.6% loop [202] 3.8% ??? [159] 5.7% eval-prog [150] 7.5% ??? [186] 26.8% compile [126] 35.6% [172] 26472(1.2%) 12240(0.5%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [186] 41.6% bigfloat-hash [193] 6.8% simplify [43] 4.7% ??? [10] 3.9% ??? [12] 3.8% ??? [192] 3.6% ??? [13] 2.6% parse-loop12 [191] 2.3% f137 [152] 2.0% ??? [15] 0.4% ??? [18] 0.3% ??? [16] 0.1% ------------------------------------------------------------------------------ contract-struct-name [187] 19.6% ??? [160] 80.4% [173] 16786(0.7%) 9564(0.4%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [187] 56.8% ------------------------------------------------------------------------------ for-loop [8] 2.4% ??? [158] 97.6% [174] 13780(0.6%) 13780(0.6%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------ gather-multiplicative-terms [166] 16.1% for-loop [64] 27.9% for-loop [8] 56.0% [175] 2240(0.1%) 2240(0.1%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------ ??? [159] 100.0% [176] 1752(0.1%) 0(0.0%) best-alt ...erbie/regime-testing/src/glue.rkt:71:0 loop [194] 60.5% argmins [198] 39.5% ------------------------------------------------------------------------------ ??? [162] 100.0% [177] 1746(0.1%) 1016(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [222] 41.8% ------------------------------------------------------------------------------ taylor [167] 19.6% for-loop [62] 39.2% iterate-egraph!13 [2] 41.2% [178] 1690(0.1%) 696(0.0%) debug-print .../regime-testing/src/debug.rkt:107:0 for-loop [196] 58.8% ------------------------------------------------------------------------------ loop [164] 6.2% f137 [152] 23.7% for-loop [195] 30.7% rewriter [91] 39.3% [179] 1306(0.1%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [195] 100.0% ------------------------------------------------------------------------------ ??? [158] 100.0% [180] 1148(0.1%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [189] 100.0% ------------------------------------------------------------------------------ loop [164] 100.0% [181] 362(0.0%) 362(0.0%) type-of .../regime-testing/src/type-check.rkt:38:0 ------------------------------------------------------------------------------ append-map [163] 100.0% [182] 338(0.0%) 338(0.0%) loop ...are/racket/collects/racket/list.rkt:414:34 ------------------------------------------------------------------------------ ??? [158] 100.0% [183] 318(0.0%) 0(0.0%) for-loop ...me-testing/src/syntax/syntax.rkt:531:2 ...higher-order.rkt:342:33 [200] 100.0% ------------------------------------------------------------------------------ ??? [170] 100.0% [184] 1876300(83.8%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ??? [170] 100.0% ------------------------------------------------------------------------------ hash-has-key? [123] 26.4% ??? [170] 73.6% [185] 233170(10.4%) 91888(4.1%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [203] 44.1% ??? [217] 14.1% ??? [204] 1.7% arrow-higher-order:lnp [211] 0.4% ------------------------------------------------------------------------------ hash-ref! [172] 100.0% [186] 14238(0.6%) 5630(0.3%) ??? ...erbie/regime-testing/src/programs.rkt:194:5 hash-ref! [172] 67.3% loop [202] 12.0% ------------------------------------------------------------------------------ build-compound-type-name [173] 100.0% [187] 11854(0.5%) 7222(0.3%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [173] 47.3% ------------------------------------------------------------------------------ ??? [170] 100.0% [188] 9282(0.4%) 0(0.0%) mk-egraph ...ime-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [205] 96.2% mk-enode! [71] 3.8% ------------------------------------------------------------------------------ bf* [180] 14.7% ??? [158] 85.3% [189] 7824(0.3%) 1034(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [207] 86.8% ------------------------------------------------------------------------------ ??? [170] 5.9% hash-has-key? [123] 94.1% [190] 5088(0.2%) 5088(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------ loop [202] 1.9% parse-loop12 [191] 1.9% for-loop [34] 1.9% append-map [163] 6.7% f137 [152] 7.6% ??? [158] 7.9% hash-ref! [172] 14.4% simplify [43] 15.9% type-of-enode-expr [93] 41.7% [191] 4710(0.2%) 2664(0.1%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [202] 16.3% for-loop [212] 7.6% f137 [152] 7.0% make-multiplication-node [120] 6.7% parse-loop12 [191] 1.9% ------------------------------------------------------------------------------ hash-ref! [172] 100.0% [192] 3356(0.1%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:67:15 ??? [159] 100.0% ------------------------------------------------------------------------------ hash-ref! [172] 100.0% [193] 2612(0.1%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 sig+exp->bigfloat [209] 60.0% bfcanonicalize [210] 40.0% ------------------------------------------------------------------------------ extract-alt [47] 38.2% best-alt [176] 61.8% [194] 1714(0.1%) 0(0.0%) loop ...herbie/regime-testing/src/common.rkt:154:2 composed [208] 100.0% ------------------------------------------------------------------------------ expression->type [179] 100.0% [195] 1306(0.1%) 0(0.0%) for-loop ...regime-testing/src/type-check.rkt:52:5 f137 [152] 69.3% expression->type [179] 30.7% ------------------------------------------------------------------------------ debug-print [178] 100.0% [196] 994(0.0%) 658(0.0%) for-loop ...bie/regime-testing/src/debug.rkt:113:2 write-proc [213] 33.8% ------------------------------------------------------------------------------ ??? [170] 100.0% [197] 994(0.0%) 304(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 for-loop [206] 69.4% ------------------------------------------------------------------------------ best-alt [176] 100.0% [198] 692(0.0%) 0(0.0%) argmins ...bie/regime-testing/src/common.rkt:153:0 composed [208] 100.0% ------------------------------------------------------------------------------ ??? [170] 100.0% [199] 676(0.0%) 330(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:60:15 ??? [222] 51.2% ------------------------------------------------------------------------------ for-loop [183] 100.0% [200] 318(0.0%) 0(0.0%) ...higher-order.rkt:342:33 (unknown source) ??? [204] 100.0% ------------------------------------------------------------------------------ ??? [170] 100.0% [201] 308(0.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:346:33 pattern-substitute [214] 100.0% ------------------------------------------------------------------------------ ??? [80] 0.0% loop [108] 0.0% ??? [70] 0.0% make-exacts* [107] 0.1% parse-loop12 [191] 0.2% ??? [186] 0.4% option-on-expr [218] 0.8% match-e [52] 1.3% for-loop [64] 1.3% map [106] 2.1% for-loop [95] 2.4% baseline-error [84] 3.9% f137 [152] 4.1% loop! [215] 9.7% loop [202] 72.6% [202] 349952(15.6%) 17472(0.8%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [202] 72.6% loop! [215] 9.3% option-on-expr [218] 4.1% ??? [5] 3.4% ??? [6] 2.7% eval-errors [144] 1.8% ??? [151] 1.1% for-loop [8] 1.0% hash-ref! [172] 0.4% foldl [223] 0.3% ??? [118] 0.1% parse-loop12 [191] 0.1% alt-errors [146] 0.1% eval-prog [150] 0.0% ulp-difference [220] 0.0% ??? [159] 0.0% ??? [269] 0.0% set-precompute! [227] 0.0% ------------------------------------------------------------------------------ ??? [185] 100.0% [203] 102862(4.6%) 56594(2.5%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [217] 24.8% for-loop [132] 16.3% ??? [221] 2.9% ??? [261] 0.3% ------------------------------------------------------------------------------ ...higher-order.rkt:342:33 [200] 0.3% ??? [185] 3.9% ??? [170] 4.4% ??? [134] 28.4% for-loop [132] 62.9% [204] 101912(4.6%) 18728(0.8%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [216] 61.9% for-loop [219] 9.4% ??? [134] 8.3% ??? [234] 2.0% ------------------------------------------------------------------------------ mk-enode-rec! [205] 39.9% mk-egraph [188] 60.1% [205] 8926(0.4%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode! [71] 60.1% mk-enode-rec! [205] 39.9% ------------------------------------------------------------------------------ *simplify-rules* [197] 9.6% *rules* [14] 18.2% merge-egraph-nodes! [63] 72.2% [206] 7196(0.3%) 4552(0.2%) for-loop ...ie/regime-testing/src/common.rkt:100:9 update-en-expr [230] 13.6% ormap [225] 9.6% loop [226] 8.8% flag-set? [241] 4.8% ------------------------------------------------------------------------------ ??? [189] 100.0% [207] 6790(0.3%) 4064(0.2%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [222] 40.1% ------------------------------------------------------------------------------ argmins [198] 28.8% loop [194] 71.2% [208] 2406(0.1%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 eval-errors [144] 86.0% alt-errors [146] 14.0% ------------------------------------------------------------------------------ bigfloat-hash [193] 100.0% [209] 1568(0.1%) 1258(0.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 integer->mpz [228] 19.8% ------------------------------------------------------------------------------ bigfloat-hash [193] 100.0% [210] 1044(0.0%) 1044(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ------------------------------------------------------------------------------ ??? [185] 100.0% [211] 904(0.0%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [224] 100.0% ------------------------------------------------------------------------------ parse-loop12 [191] 100.0% [212] 360(0.0%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:99:13 f137 [152] 100.0% ------------------------------------------------------------------------------ for-loop [196] 100.0% [213] 336(0.0%) 336(0.0%) write-proc ...ime-testing/src/alternative.rkt:22:9 ------------------------------------------------------------------------------ ??? [201] 33.3% pattern-substitute [214] 66.7% [214] 308(0.0%) 308(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [214] 66.7% ------------------------------------------------------------------------------ for-loop [74] 4.7% merge-egraph-nodes! [63] 14.9% loop [202] 28.1% for-loop [51] 52.2% [215] 264666(11.8%) 52196(2.3%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 custom-set-union [229] 40.2% loop [202] 30.7% set [231] 11.5% update-en-expr [230] 6.4% ------------------------------------------------------------------------------ ??? [204] 100.0% [216] 63096(2.8%) 4540(0.2%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [261] 85.6% ??? [234] 7.2% ------------------------------------------------------------------------------ ??? [122] 0.5% for-loop [203] 43.5% ??? [185] 56.0% [217] 58722(2.6%) 30692(1.4%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [233] 47.7% ------------------------------------------------------------------------------ f137 [152] 15.3% loop [202] 84.7% [218] 24602(1.1%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [202] 30.7% sindices->spoints [235] 28.8% sort-context-on-expr [237] 20.4% eval-errors [144] 8.1% err-lsts->split-indices [242] 5.0% pick-errors [243] 4.2% eval-prog [150] 1.5% alt-errors [146] 1.4% ------------------------------------------------------------------------------ ??? [204] 100.0% [219] 9574(0.4%) 4592(0.2%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [134] 52.0% ------------------------------------------------------------------------------ loop [202] 15.5% ??? [5] 24.3% for-loop [148] 60.2% [220] 6298(0.3%) 3452(0.2%) ulp-difference ...egime-testing/src/float.rkt:19:0 ??? [246] 29.6% return/no-unsupplied [248] 15.6% ------------------------------------------------------------------------------ ??? [134] 15.0% ??? [122] 21.0% for-loop [203] 64.0% [221] 4612(0.2%) 1320(0.1%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [238] 71.4% ------------------------------------------------------------------------------ ??? [199] 9.1% real->bigfloat [177] 19.2% bfmul [207] 71.7% [222] 3802(0.2%) 3802(0.2%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------ for-loop [64] 39.2% loop [202] 60.8% [223] 3338(0.1%) 1004(0.0%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [240] 60.7% ??? [244] 9.2% ------------------------------------------------------------------------------ arrow-higher-order:lnp [211] 100.0% [224] 904(0.0%) 598(0.0%) ??? ...et/contract/private/arity-checking.rkt:19:2 procedure-arity [239] 33.8% ------------------------------------------------------------------------------ for-loop [206] 100.0% [225] 694(0.0%) 0(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 list-member? [232] 51.9% flag-set? [241] 48.1% ------------------------------------------------------------------------------ for-loop [206] 100.0% [226] 630(0.0%) 0(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [241] 100.0% ------------------------------------------------------------------------------ loop [202] 100.0% [227] 334(0.0%) 0(0.0%) set-precompute! ...ing/src/core/simplify.rkt:193:0 make-sequence [236] 100.0% ------------------------------------------------------------------------------ sig+exp->bigfloat [209] 100.0% [228] 310(0.0%) 310(0.0%) integer->mpz ...math/private/bigfloat/gmp.rkt:87:0 ------------------------------------------------------------------------------ adopt-enode! [87] 2.6% loop! [215] 97.4% [229] 115182(5.1%) 33374(1.5%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [245] 62.1% for-loop [249] 8.9% ------------------------------------------------------------------------------ for-loop [82] 0.4% for-loop [206] 1.1% update-leader! [72] 1.5% for-loop [75] 9.1% loop! [215] 37.7% for-loop [121] 50.2% [230] 87918(3.9%) 83570(3.7%) update-en-expr ...esting/src/core/egraph.rkt:212:0 for-loop [254] 4.9% ------------------------------------------------------------------------------ new-enode [81] 5.2% loop! [215] 94.8% [231] 63028(2.8%) 63028(2.8%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------ ormap [225] 1.1% ??? [170] 2.0% for-loop [51] 96.8% [232] 31522(1.4%) 1336(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [247] 76.6% member [252] 19.1% ------------------------------------------------------------------------------ ??? [217] 100.0% [233] 28030(1.3%) 28030(1.3%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------ for-loop [8] 2.9% ??? [158] 16.7% ??? [204] 17.7% for-loop [132] 23.0% ??? [216] 39.8% [234] 11474(0.5%) 4602(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [250] 59.9% ------------------------------------------------------------------------------ option-on-expr [218] 100.0% [235] 7082(0.3%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [251] 86.3% eval-prog [150] 9.1% for-loop [260] 4.6% ------------------------------------------------------------------------------ reduce-to-single! [57] 5.1% set-precompute! [227] 5.1% for-loop [40] 9.7% merge-egraph-nodes! [63] 14.1% update-leader! [72] 25.1% ??? [112] 40.9% [236] 6518(0.3%) 5874(0.3%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [258] 9.9% ------------------------------------------------------------------------------ option-on-expr [218] 100.0% [237] 5010(0.2%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [253] 100.0% ------------------------------------------------------------------------------ ??? [221] 100.0% [238] 3292(0.1%) 996(0.0%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [255] 69.7% ------------------------------------------------------------------------------ ??? [224] 11.6% curry* [79] 88.4% [239] 2632(0.1%) 2632(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ------------------------------------------------------------------------------ foldl [223] 100.0% [240] 2026(0.1%) 2026(0.1%) merge2 .../regime-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------ ormap [225] 25.5% for-loop [206] 26.3% loop [226] 48.2% [241] 1308(0.1%) 662(0.0%) flag-set? ...ie/regime-testing/src/config.rkt:34:0 return/no-unsupplied [248] 25.5% ??? [246] 23.9% ------------------------------------------------------------------------------ option-on-expr [218] 100.0% [242] 1240(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [256] 100.0% ------------------------------------------------------------------------------ option-on-expr [218] 100.0% [243] 1036(0.0%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [257] 68.7% point->alt [259] 31.3% ------------------------------------------------------------------------------ foldl [223] 100.0% [244] 308(0.0%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:66:9 ??? [159] 100.0% ------------------------------------------------------------------------------ custom-set-union [229] 100.0% [245] 71578(3.2%) 21570(1.0%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [262] 69.9% ------------------------------------------------------------------------------ flag-set? [241] 1.2% ulp-difference [220] 7.1% ??? [171] 17.6% ??? [135] 34.8% ??? [170] 39.3% [246] 26138(1.2%) 4890(0.2%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [263] 65.1% ??? [261] 16.2% ------------------------------------------------------------------------------ list-member? [232] 100.0% [247] 24150(1.1%) 24150(1.1%) loop (unknown source) ------------------------------------------------------------------------------ flag-set? [241] 1.4% simplify* [117] 1.6% ulp-difference [220] 4.2% ??? [135] 25.1% ??? [171] 26.2% ??? [170] 41.4% [248] 23246(1.0%) 14962(0.7%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [264] 35.6% ------------------------------------------------------------------------------ custom-set-union [229] 100.0% [249] 10230(0.5%) 10230(0.5%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------ ??? [234] 100.0% [250] 6872(0.3%) 3932(0.2%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [268] 42.8% ------------------------------------------------------------------------------ map [106] 0.1% loop [251] 5.0% sindices->spoints [235] 94.9% [251] 6440(0.3%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 sidx->spoint [265] 94.9% loop [251] 5.0% ------------------------------------------------------------------------------ list-member? [232] 100.0% [252] 6036(0.3%) 6036(0.3%) member (unknown source) ------------------------------------------------------------------------------ localize-error [59] 6.2% sort-context-on-expr [237] 93.8% [253] 5340(0.2%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [266] 93.8% loop [279] 6.2% ------------------------------------------------------------------------------ update-en-expr [230] 100.0% [254] 4348(0.2%) 4348(0.2%) for-loop ...gime-testing/src/core/egraph.rkt:214:6 ------------------------------------------------------------------------------ check-hash/c [238] 100.0% [255] 2296(0.1%) 2296(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------ err-lsts->split-indices [242] 100.0% [256] 1240(0.1%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [270] 100.0% ------------------------------------------------------------------------------ pick-errors [243] 100.0% [257] 712(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:203:2 ??? [269] 100.0% ------------------------------------------------------------------------------ make-sequence [236] 100.0% [258] 644(0.0%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [267] 100.0% ------------------------------------------------------------------------------ pick-errors [243] 100.0% [259] 324(0.0%) 0(0.0%) point->alt ...e-testing/src/core/regimes.rkt:188:0 eval-prog [150] 100.0% ------------------------------------------------------------------------------ sindices->spoints [235] 100.0% [260] 324(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:137:2 free-variables [271] 100.0% ------------------------------------------------------------------------------ for-loop [203] 0.5% ??? [113] 2.8% ??? [159] 5.2% ??? [246] 6.0% ??? [134] 8.5% ??? [216] 76.1% [261] 70936(3.2%) 59292(2.6%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [113] 6.1% contract? [275] 5.7% dict? [274] 4.6% ------------------------------------------------------------------------------ for-loop [245] 100.0% [262] 50008(2.2%) 50008(2.2%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------ ??? [246] 100.0% [263] 17004(0.8%) 16330(0.7%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [277] 4.0% ------------------------------------------------------------------------------ for-loop [64] 3.8% one-iter [21] 10.5% return/no-unsupplied [248] 85.8% [264] 9660(0.4%) 9660(0.4%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------ loop [251] 100.0% [265] 6110(0.3%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [272] 83.4% pred [278] 16.6% ------------------------------------------------------------------------------ ??? [253] 100.0% [266] 5010(0.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [273] 86.6% loop [279] 13.4% ------------------------------------------------------------------------------ ??? [86] 7.2% setfindf [26] 7.3% ??? [258] 12.9% match-e [52] 72.6% [267] 4980(0.2%) 4980(0.2%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------ ??? [250] 100.0% [268] 2940(0.1%) 2940(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 ------------------------------------------------------------------------------ loop [202] 48.6% for-loop [257] 51.4% [269] 1386(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/regimes.rkt:194:2 ??? [151] 100.0% ------------------------------------------------------------------------------ add-splitpoint [256] 100.0% [270] 1240(0.1%) 302(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:255:4 for-loop [276] 75.6% ------------------------------------------------------------------------------ for-loop [260] 100.0% [271] 324(0.0%) 0(0.0%) free-variables ...e-testing/src/programs.rkt:102:0 f137 [152] 100.0% ------------------------------------------------------------------------------ sidx->spoint [265] 100.0% [272] 5096(0.2%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [278] 100.0% ------------------------------------------------------------------------------ generic-sort/key [266] 45.5% copying-mergesort [273] 54.5% [273] 4340(0.2%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [273] 54.5% loop [279] 29.6% jloop [11] 15.8% ------------------------------------------------------------------------------ ??? [170] 23.2% ??? [261] 76.8% [274] 4266(0.2%) 4266(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------ ??? [261] 100.0% [275] 4048(0.2%) 4048(0.2%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------ for-loop [270] 100.0% [276] 938(0.0%) 938(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:259:8 ------------------------------------------------------------------------------ ??? [263] 100.0% [277] 674(0.0%) 674(0.0%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------ sidx->spoint [265] 16.6% binary-search-floats [272] 83.4% [278] 6110(0.3%) 0(0.0%) pred ...regime-testing/src/core/regimes.rkt:151:17 prepare-points [85] 55.3% eval-prog [150] 27.1% eval-errors [144] 17.6% ------------------------------------------------------------------------------ ??? [253] 12.7% generic-sort/key [266] 25.8% copying-mergesort [273] 61.4% [279] 2592(0.1%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [151] 87.3% errors-score [280] 12.7% ------------------------------------------------------------------------------ loop [279] 100.0% [280] 330(0.0%) 0(0.0%) errors-score ...egime-testing/src/points.rkt:298:0 loop [281] 100.0% ------------------------------------------------------------------------------ ??? [6] 48.6% errors-score [280] 51.4% [281] 642(0.0%) 642(0.0%) loop ...hare/racket/collects/racket/list.rkt:551:2 ------------------------------------------------------------------------------