Profiling results ----------------- Total cpu time observed: 498032ms (out of 499476ms) Number of samples taken: 2679 (once every 186ms) (Hiding functions with self<1.0% and local<2.0%: 23 of 295 hidden) ============================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================== ??? [92] 100.0% [1] 412720(82.9%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [23] 100.0% ------------------------------------------------------------------------------ ??? [92] 100.0% [2] 392236(78.8%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 for-loop [24] 96.0% get-final-combination [29] 3.0% prepare-points [107] 0.9% setup-alt-simplified [44] 0.1% ------------------------------------------------------------------------------ ??? [225] 100.0% [3] 351400(70.6%) 690(0.1%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [25] 98.5% map-enodes [34] 1.3% debug7 [182] 0.0% ------------------------------------------------------------------------------ ??? [225] 100.0% [4] 52746(10.6%) 0(0.0%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [26] 100.0% ------------------------------------------------------------------------------ ??? [215] 100.0% [5] 27000(5.4%) 0(0.0%) approximate9 ...e-testing/src/core/taylor.rkt:12:0 loop [27] 83.7% f6 [180] 16.3% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [6] 17458(3.5%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:285:26 for-loop [28] 100.0% ------------------------------------------------------------------------------ f6 [180] 10.0% loop [192] 90.0% [7] 11808(2.4%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [33] 56.4% loop [192] 19.4% sort-context-on-expr [39] 13.2% err-lsts->split-indices [42] 6.0% eval-errors [159] 3.1% pick-errors [46] 1.4% eval-prog [164] 0.4% ------------------------------------------------------------------------------ simplify [171] 7.1% for-loop [208] 22.6% parse-loop12 [197] 26.8% map [184] 43.5% [8] 10790(2.2%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [30] 100.0% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [9] 8704(1.7%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:295:23 for-loop [31] 100.0% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [10] 8698(1.7%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:338:33 for-loop [32] 74.8% hash-ref! [165] 25.2% ------------------------------------------------------------------------------ substitute-e [83] 13.0% match-e [66] 87.0% [11] 6750(1.4%) 486(0.1%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [132] 92.8% ------------------------------------------------------------------------------ loop [192] 100.0% [12] 5068(1.0%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:293:24 eval-errors [159] 97.8% map [184] 2.2% ------------------------------------------------------------------------------ ??? [189] 13.1% f6 [180] 39.6% map [184] 47.3% [13] 4950(1.0%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [35] 75.8% simplify [171] 24.2% ------------------------------------------------------------------------------ map [184] 1.2% loop [192] 98.8% [14] 4130(0.8%) 252(0.1%) ??? ...herbie/regime-testing/src/points.rkt:289:26 ??? [196] 89.0% ulp-difference [239] 2.5% ??? [215] 2.4% ------------------------------------------------------------------------------ map-enodes [34] 4.1% loop [192] 95.9% [15] 3670(0.7%) 1366(0.3%) for-loop ...me-testing/src/core/simplify.rkt:195:2 setfindf [37] 44.9% eval-const-expr [43] 17.9% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [16] 3184(0.6%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:392:23 for-loop [36] 100.0% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [17] 1644(0.3%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:483:23 for-loop [38] 100.0% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [18] 1502(0.3%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:408:23 for-loop [40] 100.0% ------------------------------------------------------------------------------ append-map [190] 100.0% [19] 1178(0.2%) 102(0.0%) free-variables ...e-testing/src/programs.rkt:102:0 ??? [132] 91.3% ------------------------------------------------------------------------------ map [184] 100.0% [20] 1082(0.2%) 0(0.0%) ??? ...bie/regime-testing/src/core/reduce.rkt:61:5 for-loop [41] 100.0% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [21] 326(0.1%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:322:33 for-loop [45] 100.0% ------------------------------------------------------------------------------ copying-mergesort [87] 100.0% [22] 262(0.1%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [196] 100.0% ------------------------------------------------------------------------------ profile-thunk16 [1] 100.0% [23] 412770(82.9%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [92] 100.0% ------------------------------------------------------------------------------ run-improve50 [2] 100.0% [24] 376580(75.6%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [47] 100.0% ------------------------------------------------------------------------------ iterate-egraph!13 [3] 100.0% [25] 346192(69.5%) 3252(0.7%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [48] 74.5% for-loop [49] 24.3% ------------------------------------------------------------------------------ loop [4] 100.0% [26] 52746(10.6%) 0(0.0%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [50] 99.7% ------------------------------------------------------------------------------ approximate9 [5] 100.0% [27] 22604(4.5%) 0(0.0%) loop ...ie/regime-testing/src/core/taylor.rkt:86:4 ??? [215] 51.4% hash-ref! [165] 48.6% ------------------------------------------------------------------------------ ??? [6] 100.0% [28] 17458(3.5%) 306(0.1%) for-loop ...ime-testing/src/core/taylor.rkt:285:52 hash-ref! [165] 83.0% ??? [53] 15.3% ------------------------------------------------------------------------------ run-improve50 [2] 100.0% [29] 11908(2.4%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:266:0 split-table [51] 99.6% extract-alt [63] 0.4% ------------------------------------------------------------------------------ make-multiplication-node [8] 100.0% [30] 10790(2.2%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [52] 99.1% ------------------------------------------------------------------------------ ??? [9] 100.0% [31] 8704(1.7%) 350(0.1%) for-loop ...ime-testing/src/core/taylor.rkt:298:27 hash-ref! [165] 98.0% ------------------------------------------------------------------------------ ??? [10] 100.0% [32] 7740(1.6%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:341:46 hash-ref! [165] 100.0% ------------------------------------------------------------------------------ option-on-expr [7] 100.0% [33] 6664(1.3%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [207] 99.2% ------------------------------------------------------------------------------ iterate-egraph!13 [3] 100.0% [34] 4418(0.9%) 348(0.1%) map-enodes ...me-testing/src/core/egraph.rkt:140:0 loop [192] 88.7% for-loop [15] 3.4% ------------------------------------------------------------------------------ taylor-quotient [13] 100.0% [35] 3752(0.8%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [165] 100.0% ------------------------------------------------------------------------------ ??? [16] 100.0% [36] 3184(0.6%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:396:33 for-loop [54] 100.0% ------------------------------------------------------------------------------ for-loop [15] 100.0% [37] 1646(0.3%) 1294(0.3%) setfindf ...ie/regime-testing/src/common.rkt:187:0 for-loop [60] 15.3% ??? [132] 6.1% ------------------------------------------------------------------------------ ??? [17] 100.0% [38] 1644(0.3%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:487:35 parse-loop12 [197] 100.0% ------------------------------------------------------------------------------ option-on-expr [7] 100.0% [39] 1558(0.3%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [55] 100.0% ------------------------------------------------------------------------------ ??? [18] 100.0% [40] 1502(0.3%) 314(0.1%) for-loop ...ime-testing/src/core/taylor.rkt:411:30 for-loop [56] 79.1% ------------------------------------------------------------------------------ ??? [20] 100.0% [41] 1082(0.2%) 300(0.1%) for-loop ...egime-testing/src/core/reduce.rkt:62:7 pattern-match [57] 72.3% ------------------------------------------------------------------------------ option-on-expr [7] 100.0% [42] 712(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [58] 93.0% loop [192] 7.0% ------------------------------------------------------------------------------ for-loop [15] 100.0% [43] 658(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f6 [180] 100.0% ------------------------------------------------------------------------------ run-improve50 [2] 100.0% [44] 390(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [59] 100.0% ------------------------------------------------------------------------------ ??? [21] 100.0% [45] 326(0.1%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:324:46 simplify [171] 100.0% ------------------------------------------------------------------------------ option-on-expr [7] 100.0% [46] 168(0.0%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [61] 63.1% point->alt [62] 36.9% ------------------------------------------------------------------------------ for-loop [24] 100.0% [47] 376580(75.6%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [64] 86.9% gen-series! [68] 7.3% finalize-iter! [69] 3.9% gen-rewrites! [71] 1.0% localize-error [72] 0.5% choose-best-alt! [75] 0.4% ------------------------------------------------------------------------------ one-iter [25] 100.0% [48] 258074(51.8%) 1638(0.3%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [65] 88.5% match-e [66] 9.7% reduce-to-single! [73] 0.7% update-leader! [94] 0.5% ------------------------------------------------------------------------------ for-loop [49] 49.0% one-iter [25] 51.0% [49] 84108(16.9%) 18856(3.8%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [49] 49.0% match-e [66] 38.8% ------------------------------------------------------------------------------ pass [26] 100.0% [50] 52594(10.6%) 472(0.1%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [67] 68.2% loop [125] 25.6% for-loop [74] 3.2% filter [262] 1.3% make-sequence [211] 0.8% ------------------------------------------------------------------------------ get-final-combination [29] 100.0% [51] 11858(2.4%) 0(0.0%) split-table ...e/regime-testing/src/glue.rkt:162:0 f6 [180] 99.6% ??? [132] 0.4% ------------------------------------------------------------------------------ make-multiplication-subnode [30] 100.0% [52] 10690(2.1%) 358(0.1%) for-loop ...gime-testing/src/core/reduce.rkt:242:3 make-multiplication-subsubsubnode [70] 82.2% mterm->expr [85] 14.4% ------------------------------------------------------------------------------ for-loop [28] 100.0% [53] 5814(1.2%) 0(0.0%) ??? ...e/regime-testing/src/core/taylor.rkt:288:19 hash-ref! [165] 100.0% ------------------------------------------------------------------------------ for-loop [36] 100.0% [54] 3184(0.6%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:398:39 hash-ref! [165] 100.0% ------------------------------------------------------------------------------ sort-context-on-expr [39] 100.0% [55] 1558(0.3%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [76] 75.5% loop [102] 24.5% ------------------------------------------------------------------------------ for-loop [40] 100.0% [56] 1188(0.2%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:414:42 hash-ref! [165] 100.0% ------------------------------------------------------------------------------ for-loop [78] 27.2% for-loop [41] 72.8% [57] 782(0.2%) 356(0.1%) pattern-match ...testing/src/core/matcher.rkt:48:0 for-loop [78] 27.2% ??? [132] 27.2% ------------------------------------------------------------------------------ err-lsts->split-indices [42] 100.0% [58] 662(0.1%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [77] 100.0% ------------------------------------------------------------------------------ setup-alt-simplified [44] 100.0% [59] 390(0.1%) 0(0.0%) simplify-alt ...e/regime-testing/src/glue.rkt:76:0 ??? [225] 100.0% ------------------------------------------------------------------------------ setfindf [37] 100.0% [60] 252(0.1%) 252(0.1%) for-loop ...ie/regime-testing/src/common.rkt:188:2 ------------------------------------------------------------------------------ pick-errors [46] 100.0% [61] 106(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:203:2 ??? [79] 100.0% ------------------------------------------------------------------------------ pick-errors [46] 100.0% [62] 62(0.0%) 0(0.0%) point->alt ...e-testing/src/core/regimes.rkt:188:0 eval-prog [164] 100.0% ------------------------------------------------------------------------------ get-final-combination [29] 100.0% [63] 50(0.0%) 0(0.0%) extract-alt ...ie/regime-testing/src/glue.rkt:55:0 loop [241] 100.0% ------------------------------------------------------------------------------ run-iter! [47] 100.0% [64] 327288(65.7%) 328(0.1%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [80] 99.9% ------------------------------------------------------------------------------ for-loop [48] 100.0% [65] 228312(45.8%) 500(0.1%) for-loop ...e-testing/src/core/simplify.rkt:148:10 merge-egraph-nodes! [81] 36.8% mk-enode! [93] 30.1% substitute-e [83] 16.7% loop! [195] 13.9% list-member? [237] 2.4% ------------------------------------------------------------------------------ for-loop [48] 18.6% for-loop [95] 24.8% for-loop [49] 56.7% [66] 90276(18.1%) 30566(6.1%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [82] 51.4% for-loop [95] 7.8% ??? [132] 5.9% variable? [11] 2.5% loop [192] 1.8% custom-in-set [229] 0.9% list-cartesian-product [98] 0.9% curry* [90] 0.1% ------------------------------------------------------------------------------ for-loop [50] 100.0% [67] 35866(7.2%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [134] 95.3% expression-cost [135] 4.7% ------------------------------------------------------------------------------ run-iter! [47] 100.0% [68] 27348(5.5%) 0(0.0%) gen-series! ...gime-testing/src/mainloop.rkt:129:0 for-loop [84] 100.0% ------------------------------------------------------------------------------ run-iter! [47] 100.0% [69] 14674(2.9%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [132] 100.0% ------------------------------------------------------------------------------ make-multiplication-subsubsubnode [70] 1.9% for-loop [52] 98.1% [70] 8792(1.8%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [85] 98.1% make-multiplication-subsubsubnode [70] 1.9% ------------------------------------------------------------------------------ run-iter! [47] 100.0% [71] 3852(0.8%) 0(0.0%) gen-rewrites! ...me-testing/src/mainloop.rkt:142:0 for-loop [86] 100.0% ------------------------------------------------------------------------------ run-iter! [47] 100.0% [72] 1850(0.4%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [165] 100.0% ------------------------------------------------------------------------------ for-loop [48] 100.0% [73] 1774(0.4%) 1094(0.2%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [88] 38.3% ------------------------------------------------------------------------------ for-loop [50] 100.0% [74] 1700(0.3%) 1700(0.3%) for-loop ...e-testing/src/core/simplify.rkt:217:13 ------------------------------------------------------------------------------ run-iter! [47] 100.0% [75] 1568(0.3%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:115:0 ??? [132] 100.0% ------------------------------------------------------------------------------ ??? [55] 100.0% [76] 1176(0.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [87] 70.1% loop [102] 29.9% ------------------------------------------------------------------------------ add-splitpoint [58] 100.0% [77] 662(0.1%) 50(0.0%) for-loop ...ime-testing/src/core/regimes.rkt:255:4 for-loop [89] 84.6% loop [91] 7.9% ------------------------------------------------------------------------------ pattern-match [57] 100.0% [78] 426(0.1%) 0(0.0%) for-loop ...gime-testing/src/core/matcher.rkt:66:9 pattern-match [57] 100.0% ------------------------------------------------------------------------------ loop [192] 49.5% for-loop [61] 50.5% [79] 210(0.0%) 0(0.0%) ??? ...e/regime-testing/src/core/regimes.rkt:194:2 ??? [196] 100.0% ------------------------------------------------------------------------------ simplify! [64] 97.2% [80] 336426(67.6%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [92] 100.0% ------------------------------------------------------------------------------ for-loop [99] 2.8% merge-egraph-nodes! [81] 6.1% for-loop [65] 91.1% [81] 83934(16.9%) 2168(0.4%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [94] 61.1% for-loop [97] 12.6% loop! [195] 8.8% merge-egraph-nodes! [81] 6.1% for-loop [99] 4.0% enode-merge! [101] 3.3% make-sequence [211] 0.8% for-loop [130] 0.6% ------------------------------------------------------------------------------ match-e [66] 100.0% [82] 58920(11.8%) 20242(4.1%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [95] 50.6% list-cartesian-product [98] 11.2% loop [192] 5.0% filter [262] 0.7% foldl [198] 0.5% curried [199] 0.1% ------------------------------------------------------------------------------ substitute-e [83] 7.1% for-loop [65] 92.9% [83] 38096(7.6%) 1368(0.3%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [93] 85.9% substitute-e [83] 7.1% ??? [132] 3.4% variable? [11] 1.0% ------------------------------------------------------------------------------ gen-series! [68] 100.0% [84] 27348(5.5%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:135:7 taylor-alt [96] 100.0% ------------------------------------------------------------------------------ for-loop [52] 14.9% make-multiplication-subsubsubnode [70] 85.1% [85] 10332(2.1%) 298(0.1%) mterm->expr ...e-testing/src/core/reduce.rkt:270:0 f6 [180] 97.1% ------------------------------------------------------------------------------ gen-rewrites! [71] 100.0% [86] 3852(0.8%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:147:11 ??? [100] 100.0% ------------------------------------------------------------------------------ copying-mergesort [87] 48.8% generic-sort/key [76] 51.2% [87] 824(0.2%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [87] 48.8% loop [102] 43.2% jloop [22] 7.9% ------------------------------------------------------------------------------ reduce-to-single! [73] 100.0% [88] 680(0.1%) 680(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:326:8 ------------------------------------------------------------------------------ for-loop [77] 100.0% [89] 560(0.1%) 560(0.1%) for-loop ...ime-testing/src/core/regimes.rkt:259:8 ------------------------------------------------------------------------------ match-e [66] 100.0% [90] 100(0.0%) 0(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [103] 100.0% ------------------------------------------------------------------------------ for-loop [77] 4.3% loop [91] 95.7% [91] 52(0.0%) 52(0.0%) loop ...hare/racket/collects/racket/list.rkt:154:2 loop [91] 95.7% ------------------------------------------------------------------------------ for-loop [80] 23.9% run [23] 30.7% [92] 494940(99.4%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [225] 38.1% profile-thunk16 [1] 30.7% run-improve50 [2] 28.8% prepare-points [107] 0.8% oracle-error [108] 0.8% eval-errors [159] 0.0% loop [192] 0.0% ------------------------------------------------------------------------------ mk-egraph [238] 0.2% mk-enode-rec! [253] 2.8% substitute-e [83] 31.3% for-loop [65] 65.7% [93] 104560(21.0%) 7312(1.5%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [104] 91.7% hash-has-key? [142] 1.3% ------------------------------------------------------------------------------ for-loop [48] 2.3% merge-egraph-nodes! [81] 97.7% [94] 57638(11.6%) 3670(0.7%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [105] 88.7% update-en-expr [205] 1.0% hash-ref! [165] 1.0% make-sequence [211] 0.4% ------------------------------------------------------------------------------ match-e [66] 27.9% for-loop [82] 72.1% [95] 45198(9.1%) 3830(0.8%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [66] 90.2% ??? [111] 3.1% ------------------------------------------------------------------------------ for-loop [84] 100.0% [96] 27348(5.5%) 0(0.0%) taylor-alt ...ie/regime-testing/src/glue.rkt:134:0 for-loop [106] 100.0% ------------------------------------------------------------------------------ merge-egraph-nodes! [81] 100.0% [97] 10758(2.2%) 6162(1.2%) for-loop ...gime-testing/src/core/egraph.rkt:233:6 update-en-expr [205] 42.7% ------------------------------------------------------------------------------ match-e [66] 10.2% list-cartesian-product [98] 29.4% for-loop [82] 60.4% [98] 9206(1.8%) 8794(1.8%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [98] 29.4% for-loop [113] 4.5% ------------------------------------------------------------------------------ merge-egraph-nodes! [81] 100.0% [99] 5734(1.2%) 0(0.0%) for-loop ...ime-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [81] 81.3% loop! [195] 18.7% ------------------------------------------------------------------------------ for-loop [86] 100.0% [100] 3852(0.8%) 0(0.0%) ??? ...bie/regime-testing/src/alternative.rkt:88:0 rewriter [109] 100.0% ------------------------------------------------------------------------------ merge-egraph-nodes! [81] 100.0% [101] 3240(0.7%) 100(0.0%) enode-merge! ...e-testing/src/core/enode.rkt:129:0 adopt-enode! [110] 74.0% custom-set-intersect! [112] 22.9% ------------------------------------------------------------------------------ generic-sort/key [76] 27.2% ??? [55] 29.5% copying-mergesort [87] 43.4% [102] 1296(0.3%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [196] 87.7% ??? [215] 12.3% ------------------------------------------------------------------------------ curry* [90] 100.0% [103] 100(0.0%) 100(0.0%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ------------------------------------------------------------------------------ mk-enode! [93] 100.0% [104] 95870(19.2%) 282(0.1%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [114] 99.3% set [206] 0.4% ------------------------------------------------------------------------------ update-leader! [94] 100.0% [105] 51098(10.3%) 704(0.1%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [115] 98.6% ------------------------------------------------------------------------------ taylor-alt [96] 100.0% [106] 27348(5.5%) 0(0.0%) for-loop ...rbie/regime-testing/src/glue.rkt:139:6 ??? [215] 100.0% ------------------------------------------------------------------------------ run-improve50 [2] 19.3% pred [236] 33.5% ??? [92] 47.2% [107] 17372(3.5%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 loop [126] 44.0% make-exacts* [127] 34.6% loop [118] 20.7% for-loop [122] 0.3% debug-print [242] 0.3% ------------------------------------------------------------------------------ ??? [92] 100.0% [108] 7250(1.5%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:286:0 for-loop [116] 99.3% loop [192] 0.7% ------------------------------------------------------------------------------ ??? [100] 30.9% matcher [128] 69.1% [109] 3852(0.8%) 0(0.0%) rewriter ...ime-testing/src/core/matcher.rkt:131:2 for-loop [117] 69.9% expression->type [119] 11.4% f6 [180] 10.5% *rules* [120] 8.1% ------------------------------------------------------------------------------ enode-merge! [101] 100.0% [110] 2398(0.5%) 1000(0.2%) adopt-enode! ...e-testing/src/core/enode.rkt:105:0 custom-set-union [204] 58.3% ------------------------------------------------------------------------------ for-loop [95] 100.0% [111] 1578(0.3%) 1256(0.3%) ??? ...bie/regime-testing/src/core/ematch.rkt:50:5 for-loop [121] 20.4% ------------------------------------------------------------------------------ enode-merge! [101] 100.0% [112] 742(0.1%) 742(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------ list-cartesian-product [98] 100.0% [113] 412(0.1%) 412(0.1%) for-loop ...egime-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------ new-enode [104] 100.0% [114] 95234(19.1%) 1266(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [123] 98.7% ------------------------------------------------------------------------------ for-loop [105] 100.0% [115] 50394(10.1%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [124] 100.0% ------------------------------------------------------------------------------ oracle-error [108] 100.0% [116] 7200(1.4%) 50(0.0%) for-loop ...ie/regime-testing/src/points.rkt:288:2 loop [192] 62.9% map [184] 35.7% loop [125] 0.7% ------------------------------------------------------------------------------ rewriter [109] 100.0% [117] 3852(0.8%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:134:10 matcher [128] 100.0% ------------------------------------------------------------------------------ prepare-points [107] 100.0% [118] 3602(0.7%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 loop [126] 55.0% make-exacts* [127] 45.0% ------------------------------------------------------------------------------ for-loop [129] 6.8% loop [186] 6.8% rewriter [109] 32.6% f6 [180] 53.7% [119] 2544(0.5%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [129] 100.0% ------------------------------------------------------------------------------ rewriter [109] 100.0% [120] 1228(0.2%) 0(0.0%) *rules* ...gime-testing/src/syntax/rules.rkt:565:0 for-loop [130] 100.0% ------------------------------------------------------------------------------ ??? [111] 100.0% [121] 322(0.1%) 322(0.1%) for-loop ...egime-testing/src/core/ematch.rkt:51:7 ------------------------------------------------------------------------------ prepare-points [107] 100.0% [122] 52(0.0%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [131] 100.0% ------------------------------------------------------------------------------ type-of-enode-expr [114] 100.0% [123] 93968(18.9%) 1686(0.3%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ??? [225] 37.5% ??? [140] 35.6% ??? [132] 13.5% ...sting/src/common.rkt:48:2 [141] 11.6% ------------------------------------------------------------------------------ for-loop [115] 100.0% [124] 50394(10.1%) 210(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [133] 99.6% ------------------------------------------------------------------------------ for-loop [116] 0.4% for-loop [50] 99.6% [125] 13516(2.7%) 370(0.1%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [134] 91.2% expression-cost [135] 6.1% ------------------------------------------------------------------------------ loop [118] 20.6% prepare-points [107] 79.4% [126] 9630(1.9%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [192] 94.4% ??? [196] 5.6% ------------------------------------------------------------------------------ loop [118] 21.2% prepare-points [107] 78.8% [127] 7640(1.5%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 loop [192] 92.3% eval-prog [164] 7.7% ------------------------------------------------------------------------------ for-loop [136] 20.8% matcher [128] 29.2% for-loop [117] 50.0% [128] 3852(0.8%) 0(0.0%) matcher ...gime-testing/src/core/matcher.rkt:167:2 rewriter [109] 49.6% matcher [128] 29.2% for-loop [136] 20.8% for-loop [138] 0.4% ------------------------------------------------------------------------------ expression->type [119] 100.0% [129] 2544(0.5%) 0(0.0%) for-loop ...regime-testing/src/type-check.rkt:52:5 f6 [180] 79.2% ??? [248] 14.0% expression->type [119] 6.8% ------------------------------------------------------------------------------ merge-egraph-nodes! [81] 32.5% *rules* [120] 67.5% [130] 1820(0.4%) 952(0.2%) for-loop ...ie/regime-testing/src/common.rkt:100:9 loop [137] 23.8% flag-set? [146] 18.4% update-en-expr [205] 5.5% ------------------------------------------------------------------------------ for-loop [122] 100.0% [131] 52(0.0%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 ??? [215] 100.0% ------------------------------------------------------------------------------ split-table [51] 0.1% pattern-substitute [147] 0.2% setfindf [37] 0.2% pattern-match [57] 0.8% ??? [258] 1.3% free-variables [19] 2.0% choose-best-alt! [75] 2.9% f6 [180] 5.2% substitute-e [83] 5.8% variable? [11] 11.8% match-e [66] 19.2% get-sigs [123] 23.9% finalize-iter! [69] 26.6% [132] 53168(10.7%) 16606(3.3%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [142] 38.7% for-loop [143] 26.5% ??? [145] 2.9% ??? [258] 0.6% split-atab [148] 0.1% ------------------------------------------------------------------------------ hash-update! [124] 100.0% [133] 50184(10.1%) 960(0.2%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [139] 98.1% ------------------------------------------------------------------------------ loop [125] 26.5% argmin [67] 73.5% [134] 46514(9.3%) 1148(0.2%) for-loop .../regime-testing/src/programs.rkt:210:2 ??? [225] 68.1% ...sting/src/common.rkt:48:2 [141] 27.4% ??? [140] 2.1% ------------------------------------------------------------------------------ loop [125] 32.9% argmin [67] 67.1% [135] 2498(0.5%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [144] 100.0% ------------------------------------------------------------------------------ matcher [128] 100.0% [136] 2428(0.5%) 0(0.0%) for-loop ...me-testing/src/core/matcher.rkt:183:21 matcher [128] 100.0% ------------------------------------------------------------------------------ for-loop [130] 100.0% [137] 434(0.1%) 0(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 curried [199] 76.5% flag-set? [146] 23.5% ------------------------------------------------------------------------------ matcher [128] 100.0% [138] 100(0.0%) 0(0.0%) for-loop ...ime-testing/src/core/matcher.rkt:159:6 pattern-substitute [147] 100.0% ------------------------------------------------------------------------------ ??? [133] 100.0% [139] 49224(9.9%) 41818(8.4%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 update-en-expr [205] 15.0% ------------------------------------------------------------------------------ ??? [215] 0.1% for-loop [134] 2.4% f6 [180] 14.3% get-sigs [123] 83.2% [140] 40286(8.1%) 2816(0.6%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [150] 46.8% for-loop [149] 39.0% get/build-late-neg-projection [167] 3.8% ??? [261] 3.2% ??? [259] 0.1% ------------------------------------------------------------------------------ ??? [215] 0.4% f6 [180] 8.3% get-sigs [123] 42.0% for-loop [134] 49.2% [141] 25844(5.2%) 8856(1.8%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [152] 33.3% ??? [153] 31.3% ------------------------------------------------------------------------------ mk-enode! [93] 6.1% ??? [132] 93.9% [142] 22430(4.5%) 5714(1.1%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [234] 65.8% ??? [240] 8.7% ------------------------------------------------------------------------------ ??? [132] 100.0% [143] 14624(2.9%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [151] 100.0% ------------------------------------------------------------------------------ expression-cost [135] 100.0% [144] 2498(0.5%) 0(0.0%) compile ...e/regime-testing/src/programs.rkt:186:0 hash-ref! [165] 100.0% ------------------------------------------------------------------------------ ??? [132] 100.0% [145] 1568(0.3%) 0(0.0%) ??? .../regime-testing/src/core/alt-table.rkt:54:0 ??? [215] 100.0% ------------------------------------------------------------------------------ loop [137] 23.4% for-loop [130] 76.6% [146] 436(0.1%) 102(0.0%) flag-set? ...ie/regime-testing/src/config.rkt:34:0 return/no-unsupplied [250] 76.6% ------------------------------------------------------------------------------ for-loop [138] 33.3% pattern-substitute [147] 66.7% [147] 100(0.0%) 0(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [147] 66.7% ??? [132] 33.3% ------------------------------------------------------------------------------ ??? [132] 100.0% [148] 50(0.0%) 0(0.0%) split-atab ...-testing/src/core/alt-table.rkt:74:0 for-loop [154] 100.0% ------------------------------------------------------------------------------ for-loop [246] 19.5% ??? [140] 80.5% [149] 19528(3.9%) 3042(0.6%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [235] 82.7% ??? [263] 1.8% ------------------------------------------------------------------------------ ??? [140] 100.0% [150] 18860(3.8%) 984(0.2%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [155] 94.8% ------------------------------------------------------------------------------ for-loop [143] 99.7% [151] 14674(2.9%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [156] 85.5% override-at-pnts [157] 10.5% loop [158] 2.1% loop [192] 2.0% ------------------------------------------------------------------------------ for-loop [252] 9.3% ??? [235] 15.9% ...sting/src/common.rkt:48:2 [141] 74.8% [152] 8596(1.7%) 1542(0.3%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [235] 55.6% ??? [261] 19.2% ??? [258] 16.2% ------------------------------------------------------------------------------ ...sting/src/common.rkt:48:2 [141] 100.0% [153] 8096(1.6%) 3226(0.6%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [248] 30.2% return/no-unsupplied [250] 15.1% assoc-ref [187] 14.9% ------------------------------------------------------------------------------ split-atab [148] 100.0% [154] 50(0.0%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:75:2 loop [158] 100.0% ------------------------------------------------------------------------------ ??? [150] 100.0% [155] 17876(3.6%) 600(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [160] 96.6% ------------------------------------------------------------------------------ atab-add-altn [151] 100.0% [156] 12540(2.5%) 150(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [159] 73.0% alt-errors [161] 25.8% ------------------------------------------------------------------------------ atab-add-altn [151] 100.0% [157] 1538(0.3%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:145:0 eval-errors [159] 100.0% ------------------------------------------------------------------------------ for-loop [154] 14.0% atab-add-altn [151] 86.0% [158] 358(0.1%) 308(0.1%) loop ...egime-testing/src/core/alt-table.rkt:182:2 loop [201] 14.0% ------------------------------------------------------------------------------ ??? [92] 1.2% pred [236] 1.3% option-on-expr [7] 1.7% composed [251] 3.8% override-at-pnts [157] 7.2% loop [192] 19.1% ??? [12] 23.1% best-and-tied-at-points [156] 42.7% [159] 21458(4.3%) 0(0.0%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [162] 99.7% *bit-width* [264] 0.3% ------------------------------------------------------------------------------ ??? [155] 100.0% [160] 17276(3.5%) 1024(0.2%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [163] 94.1% ------------------------------------------------------------------------------ loop [192] 10.3% composed [251] 11.1% best-and-tied-at-points [156] 78.6% [161] 4118(0.8%) 0(0.0%) alt-errors ...ime-testing/src/alternative.rkt:59:0 eval-prog [164] 100.0% ------------------------------------------------------------------------------ eval-errors [159] 100.0% [162] 21402(4.3%) 1742(0.3%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [196] 77.4% ulp-difference [239] 10.0% ??? [215] 3.7% ------------------------------------------------------------------------------ ??? [160] 100.0% [163] 16252(3.3%) 1652(0.3%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [166] 54.1% get/build-late-neg-projection [167] 35.7% ------------------------------------------------------------------------------ option-on-expr [7] 0.9% point->alt [62] 1.1% loop [192] 1.9% pred [236] 8.9% make-exacts* [127] 10.9% alt-errors [161] 76.2% [164] 5402(1.1%) 1128(0.2%) eval-prog ...regime-testing/src/programs.rkt:150:0 f6 [180] 54.2% hash-ref! [165] 19.2% new-lambda [168] 2.8% ??? [215] 1.0% go [169] 1.0% ??? [170] 0.9% ------------------------------------------------------------------------------ for-loop [56] 0.3% for-loop [210] 0.4% simplify* [209] 0.8% eval-prog [164] 0.9% ??? [10] 0.9% for-loop [54] 1.1% update-leader! [94] 1.8% ??? [53] 2.2% loop [192] 2.4% ??? [189] 2.9% localize-error [72] 2.9% for-loop [32] 3.1% ??? [175] 3.9% compile [144] 4.0% for-loop [31] 6.2% first-nonzero-exp [35] 7.0% loop [27] 8.8% ??? [172] 10.4% ??? [215] 17.5% for-loop [28] 21.1% [165] 31622(6.3%) 4638(0.9%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [6] 23.7% simplify [171] 19.9% ??? [172] 10.4% ??? [173] 8.8% ??? [9] 6.4% ??? [175] 6.3% f6 [180] 6.2% parse-loop12 [197] 4.0% ??? [10] 4.0% ??? [18] 1.3% ??? [16] 1.1% ??? [17] 0.4% bigfloat-hash [177] 0.3% ??? [21] 0.1% ------------------------------------------------------------------------------ for-loop [163] 100.0% [166] 8798(1.8%) 8798(1.8%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------ ??? [176] 8.6% ??? [140] 12.4% for-loop [163] 79.0% [167] 7342(1.5%) 380(0.1%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [174] 85.0% ??? [176] 8.6% ------------------------------------------------------------------------------ eval-prog [164] 100.0% [168] 152(0.0%) 152(0.0%) new-lambda ...ollects/racket/private/kw.rkt:679:11 ------------------------------------------------------------------------------ eval-prog [164] 100.0% [169] 52(0.0%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [178] 100.0% ------------------------------------------------------------------------------ eval-prog [164] 100.0% [170] 50(0.0%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [179] 100.0% ------------------------------------------------------------------------------ for-loop [45] 1.3% ??? [215] 1.4% loop [192] 1.4% taylor-quotient [13] 4.8% hash-ref! [165] 88.3% [171] 25130(5.0%) 0(0.0%) simplify ...egime-testing/src/core/reduce.rkt:16:0 f6 [180] 73.2% parse-loop12 [197] 12.8% simplify-node [188] 6.7% debug7 [182] 4.3% make-multiplication-node [8] 3.0% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [172] 18142(3.6%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:44:15 hash-ref! [165] 100.0% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [173] 10992(2.2%) 0(0.0%) ??? ...ie/regime-testing/src/core/taylor.rkt:67:15 ??? [215] 100.0% ------------------------------------------------------------------------------ get/build-late-neg-projection [167] 100.0% [174] 6678(1.3%) 1716(0.3%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [181] 74.3% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [175] 2766(0.6%) 0(0.0%) ??? ...erbie/regime-testing/src/programs.rkt:194:5 hash-ref! [165] 62.5% loop [192] 37.5% ------------------------------------------------------------------------------ get/build-late-neg-projection [167] 100.0% [176] 1260(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [167] 100.0% ------------------------------------------------------------------------------ hash-ref! [165] 100.0% [177] 274(0.1%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [183] 100.0% ------------------------------------------------------------------------------ go [169] 100.0% [178] 52(0.0%) 52(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 ------------------------------------------------------------------------------ ??? [170] 100.0% [179] 50(0.0%) 50(0.0%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------ ??? [189] 0.3% parse-loop12 [197] 0.4% composed [251] 0.8% loop [186] 1.1% simplify-node [188] 1.5% eval-const-expr [43] 1.6% eval-prog [164] 2.1% append-map [190] 2.4% rewriter [109] 2.5% for-loop [129] 3.5% approximate9 [5] 4.0% hash-ref! [165] 4.8% mterm->expr [85] 8.4% simplify [171] 9.2% f6 [180] 14.3% map [184] 16.8% split-table [51] 26.2% [180] 42442(8.5%) 1526(0.3%) f6 ...et/collects/racket/match/compiler.rkt:507:40 map [184] 30.8% loop [192] 23.6% f6 [180] 14.3% ??? [140] 5.5% append-map [190] 4.7% ??? [225] 4.3% ...sting/src/common.rkt:48:2 [141] 3.5% option-on-expr [7] 2.7% ??? [132] 2.0% ??? [215] 1.9% expression->type [119] 1.6% loop [186] 1.3% taylor-quotient [13] 1.2% composed [251] 0.8% parse-loop12 [197] 0.2% taylor [191] 0.1% compose [214] 0.0% ------------------------------------------------------------------------------ contract-struct-name [185] 24.3% ??? [174] 75.7% [181] 4962(1.0%) 2192(0.4%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [185] 73.7% ------------------------------------------------------------------------------ iterate-egraph!13 [3] 8.5% simplify [171] 91.5% [182] 1180(0.2%) 824(0.2%) debug7 ...erbie/regime-testing/src/debug.rkt:102:0 assoc-ref [187] 30.2% ------------------------------------------------------------------------------ bigfloat-hash [177] 100.0% [183] 274(0.1%) 274(0.1%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ------------------------------------------------------------------------------ ??? [12] 0.5% for-loop [116] 11.9% f6 [180] 87.6% [184] 21628(4.3%) 644(0.1%) map ...acket/collects/racket/private/map.rkt:20:13 f6 [180] 48.7% loop [192] 18.8% simplify-node [188] 7.3% ??? [189] 5.7% taylor-quotient [13] 5.6% make-multiplication-node [8] 5.5% simplify* [209] 2.3% parse-loop12 [197] 2.2% ??? [20] 1.9% ??? [14] 0.2% ------------------------------------------------------------------------------ build-compound-type-name [181] 100.0% [185] 4540(0.9%) 2770(0.6%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [181] 46.1% ------------------------------------------------------------------------------ f6 [180] 100.0% [186] 3632(0.7%) 0(0.0%) loop ...ie/regime-testing/src/core/reduce.rkt:18:2 f6 [180] 90.4% expression->type [119] 9.6% ------------------------------------------------------------------------------ debug7 [182] 22.8% ??? [153] 77.2% [187] 1560(0.3%) 1560(0.3%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------ simplify [171] 31.8% map [184] 68.2% [188] 5328(1.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 f6 [180] 51.7% append-map [190] 48.3% ------------------------------------------------------------------------------ loop [192] 39.8% map [184] 60.2% [189] 3860(0.8%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [165] 39.8% f6 [180] 35.3% taylor-quotient [13] 16.8% taylor [191] 8.1% ------------------------------------------------------------------------------ parse-loop12 [197] 1.6% simplify-node [188] 16.4% append-map [190] 17.4% f6 [180] 64.7% [190] 7324(1.5%) 886(0.2%) append-map ...acket/collects/racket/list.rkt:565:2 parse-loop12 [197] 49.6% f6 [180] 23.4% append-map [190] 17.4% free-variables [19] 4.3% loop [193] 2.8% ------------------------------------------------------------------------------ ??? [189] 31.6% f6 [180] 68.4% [191] 988(0.2%) 0(0.0%) taylor ...regime-testing/src/core/taylor.rkt:163:0 loop [192] 36.6% debug-print [242] 31.8% ??? [194] 31.6% ------------------------------------------------------------------------------ oracle-error [108] 0.0% err-lsts->split-indices [42] 0.0% ??? [92] 0.0% atab-add-altn [151] 0.4% map-enodes [34] 0.4% taylor [191] 0.5% for-loop [116] 0.7% option-on-expr [7] 0.7% make-exacts* [127] 0.8% map [184] 0.9% parse-loop12 [197] 0.9% ??? [175] 1.3% loop [126] 1.6% match-e [66] 3.1% for-loop [82] 3.2% f6 [180] 4.9% loop! [195] 11.1% loop [192] 68.0% [192] 76834(15.4%) 5370(1.1%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [192] 68.0% loop! [195] 10.6% option-on-expr [7] 4.9% ??? [196] 2.8% foldl [198] 1.4% hash-ref! [165] 1.3% ??? [12] 1.0% eval-errors [159] 1.0% ??? [14] 0.9% curried [199] 0.8% parse-loop12 [197] 0.7% simplify [171] 0.5% loop [201] 0.4% for-loop [15] 0.3% ??? [189] 0.2% alt-errors [161] 0.2% set-precompute! [200] 0.1% ??? [216] 0.1% ??? [215] 0.1% eval-prog [164] 0.0% partial-sum [202] 0.0% ulp-difference [239] 0.0% ??? [79] 0.0% ------------------------------------------------------------------------------ loop [193] 7.3% append-map [190] 92.7% [193] 354(0.1%) 354(0.1%) loop ...are/racket/collects/racket/list.rkt:414:34 loop [193] 7.3% ------------------------------------------------------------------------------ taylor [191] 100.0% [194] 312(0.1%) 312(0.1%) ??? ...e-testing/src/function-definitions.rkt:46:2 ------------------------------------------------------------------------------ for-loop [99] 2.2% merge-egraph-nodes! [81] 15.2% loop [192] 29.9% for-loop [65] 52.7% [195] 41928(8.4%) 10846(2.2%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 custom-set-union [204] 37.6% loop [192] 33.2% set [206] 13.2% update-en-expr [205] 2.2% ------------------------------------------------------------------------------ ??? [79] 0.5% jloop [22] 0.6% loop [126] 1.3% loop [102] 2.8% ??? [14] 9.0% for-loop [162] 40.5% loop [192] 45.3% [196] 40928(8.2%) 1102(0.2%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [203] 92.9% ??? [215] 3.9% ??? [213] 0.4% ------------------------------------------------------------------------------ f6 [180] 2.1% loop [192] 3.5% for-loop [38] 8.2% map [184] 10.9% simplify [171] 12.4% hash-ref! [165] 14.8% parse-loop12 [197] 20.0% append-map [190] 28.1% [197] 12466(2.5%) 2910(0.6%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 parse-loop12 [197] 20.0% for-loop [208] 19.1% loop [192] 15.9% make-multiplication-node [8] 9.4% for-loop [210] 8.2% f6 [180] 7.0% simplify* [209] 3.7% loop [207] 2.5% append-map [190] 1.6% ------------------------------------------------------------------------------ for-loop [82] 25.0% loop [192] 75.0% [198] 1688(0.3%) 388(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [212] 77.0% ------------------------------------------------------------------------------ for-loop [82] 11.4% loop [137] 25.2% loop [192] 63.5% [199] 1320(0.3%) 1320(0.3%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------ loop [192] 100.0% [200] 400(0.1%) 300(0.1%) set-precompute! ...ing/src/core/simplify.rkt:193:0 make-sequence [211] 25.0% ------------------------------------------------------------------------------ loop [192] 1.5% loop [158] 3.7% loop [201] 94.8% [201] 338(0.1%) 338(0.1%) loop ...ket/collects/racket/private/list.rkt:82:16 loop [201] 94.8% ------------------------------------------------------------------------------ loop [192] 100.0% [202] 50(0.0%) 0(0.0%) partial-sum ...-testing/src/core/regimes.rkt:213:0 compose [214] 100.0% ------------------------------------------------------------------------------ ??? [196] 100.0% [203] 38002(7.6%) 12478(2.5%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [216] 41.6% ??? [219] 17.2% ??? [220] 7.7% ??? [263] 0.7% ------------------------------------------------------------------------------ adopt-enode! [110] 7.8% loop! [195] 92.2% [204] 17890(3.6%) 4622(0.9%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [217] 65.9% for-loop [221] 8.3% ------------------------------------------------------------------------------ for-loop [130] 0.7% update-leader! [94] 4.1% loop! [195] 12.6% for-loop [97] 31.6% for-loop [139] 51.0% [205] 14534(2.9%) 14434(2.9%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------------ new-enode [104] 3.1% loop! [195] 96.9% [206] 11440(2.3%) 11440(2.3%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------ parse-loop12 [197] 0.1% loop [207] 5.3% sindices->spoints [33] 94.7% [207] 6924(1.4%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 sidx->spoint [218] 94.7% loop [207] 5.3% ??? [215] 0.1% ------------------------------------------------------------------------------ parse-loop12 [197] 100.0% [208] 2436(0.5%) 0(0.0%) for-loop ...gime-testing/src/core/reduce.rkt:99:13 make-multiplication-node [8] 100.0% ------------------------------------------------------------------------------ parse-loop12 [197] 24.3% map [184] 75.7% [209] 1904(0.4%) 646(0.1%) simplify* ...gime-testing/src/core/reduce.rkt:31:0 hash-ref! [165] 41.8% ??? [223] 24.3% ------------------------------------------------------------------------------ parse-loop12 [197] 100.0% [210] 1644(0.3%) 0(0.0%) for-loop ...ime-testing/src/core/taylor.rkt:490:59 hash-ref! [165] 100.0% ------------------------------------------------------------------------------ set-precompute! [200] 7.0% update-leader! [94] 17.5% for-loop [50] 29.2% merge-egraph-nodes! [81] 46.2% [211] 1436(0.3%) 940(0.2%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [222] 34.5% ------------------------------------------------------------------------------ foldl [198] 100.0% [212] 1300(0.3%) 1300(0.3%) merge2 .../regime-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------ ??? [196] 100.0% [213] 170(0.0%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [224] 100.0% ------------------------------------------------------------------------------ partial-sum [202] 32.9% f6 [180] 67.1% [214] 152(0.0%) 152(0.0%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------------ ??? [131] 0.2% eval-prog [164] 0.2% ??? [14] 0.3% loop [102] 0.5% loop [207] 0.9% loop [192] 0.9% for-loop [162] 2.3% ??? [145] 4.1% ??? [196] 4.7% f6 [180] 6.5% ??? [173] 10.7% loop [27] 11.3% ??? [225] 28.4% for-loop [106] 28.8% [215] 34386(6.9%) 306(0.1%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [225] 41.0% approximate9 [5] 28.3% hash-ref! [165] 21.9% best-alt [228] 4.1% ??? [258] 2.8% simplify [171] 0.5% ...sting/src/common.rkt:48:2 [141] 0.3% ??? [140] 0.2% ------------------------------------------------------------------------------ loop [192] 7.1% ??? [203] 92.9% [216] 17032(3.4%) 16278(3.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfadd [230] 3.2% bftan [231] 1.2% ------------------------------------------------------------------------------ custom-set-union [204] 100.0% [217] 11782(2.4%) 2796(0.6%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [226] 76.3% ------------------------------------------------------------------------------ loop [207] 100.0% [218] 6612(1.3%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [227] 67.6% pred [236] 31.6% bit-difference [232] 0.8% ------------------------------------------------------------------------------ ??? [203] 100.0% [219] 6520(1.3%) 4142(0.8%) ??? ...regime-testing/src/syntax/syntax.rkt:156:17 ??? [248] 23.0% return/no-unsupplied [250] 11.9% list-member? [237] 1.6% ------------------------------------------------------------------------------ ??? [203] 100.0% [220] 2924(0.6%) 2924(0.6%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------ custom-set-union [204] 100.0% [221] 1486(0.3%) 1486(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------ make-sequence [211] 100.0% [222] 496(0.1%) 152(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [229] 69.4% ------------------------------------------------------------------------------ simplify* [209] 100.0% [223] 462(0.1%) 0(0.0%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [260] 100.0% ------------------------------------------------------------------------------ ??? [213] 100.0% [224] 170(0.0%) 170(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ------------------------------------------------------------------------------ simplify-alt [59] 0.0% f6 [180] 0.5% for-loop [134] 2.4% get-sigs [123] 2.7% ??? [215] 3.9% ??? [225] 7.0% for-loop [233] 39.6% ??? [92] 43.7% [225] 441134(88.6%) 24714(5.0%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [233] 39.8% iterate-egraph!13 [3] 38.6% ??? [225] 7.0% loop [4] 4.8% ??? [234] 3.5% ??? [215] 2.9% ??? [248] 0.4% mk-egraph [238] 0.3% return/no-unsupplied [250] 0.1% ??? [235] 0.1% debug-print [242] 0.0% ??? [240] 0.0% list-member? [237] 0.0% loop [245] 0.0% dict? [268] 0.0% ------------------------------------------------------------------------------ for-loop [217] 100.0% [226] 8986(1.8%) 8986(1.8%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------ sidx->spoint [218] 100.0% [227] 4470(0.9%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [236] 100.0% ------------------------------------------------------------------------------ ??? [215] 100.0% [228] 1568(0.3%) 0(0.0%) best-alt ...erbie/regime-testing/src/glue.rkt:71:0 loop [241] 71.8% argmins [243] 28.2% ------------------------------------------------------------------------------ ??? [222] 29.5% match-e [66] 70.5% [229] 1168(0.2%) 1168(0.2%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------ ??? [216] 100.0% [230] 542(0.1%) 432(0.1%) bfadd ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [244] 20.3% ------------------------------------------------------------------------------ ??? [216] 100.0% [231] 212(0.0%) 154(0.0%) bftan ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [244] 27.4% ------------------------------------------------------------------------------ sidx->spoint [218] 100.0% [232] 50(0.0%) 0(0.0%) bit-difference ...egime-testing/src/float.rkt:51:0 ulp-difference [239] 100.0% ------------------------------------------------------------------------------ ??? [225] 100.0% [233] 370204(74.3%) 162(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ??? [225] 99.7% ------------------------------------------------------------------------------ hash-has-key? [142] 25.2% ??? [225] 74.8% [234] 58696(11.8%) 25534(5.1%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [246] 45.0% ??? [259] 11.2% ------------------------------------------------------------------------------ ??? [225] 3.6% ??? [152] 29.0% for-loop [149] 67.4% [235] 23954(4.8%) 2040(0.4%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [247] 66.3% for-loop [252] 13.7% ??? [152] 11.4% ------------------------------------------------------------------------------ sidx->spoint [218] 31.9% binary-search-floats [227] 68.1% [236] 6562(1.3%) 0(0.0%) pred ...regime-testing/src/core/regimes.rkt:151:17 prepare-points [107] 88.6% eval-prog [164] 7.3% eval-errors [159] 4.1% ------------------------------------------------------------------------------ ??? [225] 1.1% ??? [219] 1.8% for-loop [65] 97.1% [237] 5550(1.1%) 326(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [249] 82.4% member [254] 11.7% ------------------------------------------------------------------------------ ??? [225] 100.0% [238] 3152(0.6%) 0(0.0%) mk-egraph ...ime-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [253] 91.9% mk-enode! [93] 8.1% ------------------------------------------------------------------------------ bit-difference [232] 2.1% loop [192] 4.2% ??? [14] 4.3% for-loop [162] 89.4% [239] 2384(0.5%) 1212(0.2%) ulp-difference ...egime-testing/src/float.rkt:19:0 ??? [248] 36.5% return/no-unsupplied [250] 12.7% ------------------------------------------------------------------------------ ??? [225] 12.5% hash-has-key? [142] 87.5% [240] 2230(0.4%) 2230(0.4%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------ extract-alt [63] 4.3% best-alt [228] 95.7% [241] 1176(0.2%) 0(0.0%) loop ...herbie/regime-testing/src/common.rkt:154:2 composed [251] 71.4% errors-score [255] 28.6% ------------------------------------------------------------------------------ prepare-points [107] 7.1% taylor [191] 44.4% ??? [225] 48.6% [242] 708(0.1%) 394(0.1%) debug-print .../regime-testing/src/debug.rkt:107:0 for-loop [256] 44.4% ------------------------------------------------------------------------------ best-alt [228] 100.0% [243] 442(0.1%) 0(0.0%) argmins ...bie/regime-testing/src/common.rkt:153:0 composed [251] 100.0% ------------------------------------------------------------------------------ bftan [231] 34.5% bfadd [230] 65.5% [244] 168(0.0%) 168(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------ ??? [225] 100.0% [245] 52(0.0%) 0(0.0%) loop .../herbie/regime-testing/src/points.rkt:66:6 random-exp [257] 100.0% ------------------------------------------------------------------------------ ??? [234] 100.0% [246] 26388(5.3%) 13138(2.6%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [259] 29.5% for-loop [149] 14.4% ??? [261] 6.3% ------------------------------------------------------------------------------ ??? [235] 100.0% [247] 15888(3.2%) 632(0.1%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [258] 90.1% ??? [263] 5.9% ------------------------------------------------------------------------------ for-loop [129] 4.5% ulp-difference [239] 11.0% ??? [219] 18.9% ??? [153] 30.8% ??? [225] 34.8% [248] 7938(1.6%) 2416(0.5%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [260] 55.1% ??? [258] 14.5% ------------------------------------------------------------------------------ list-member? [237] 100.0% [249] 4574(0.9%) 4574(0.9%) loop (unknown source) ------------------------------------------------------------------------------ ulp-difference [239] 7.6% flag-set? [146] 8.4% ??? [219] 19.5% ??? [153] 30.7% ??? [225] 33.9% [250] 3976(0.8%) 3118(0.6%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [262] 21.6% ------------------------------------------------------------------------------ argmins [243] 12.8% loop [241] 24.4% f6 [180] 62.8% [251] 3444(0.7%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 f6 [180] 62.8% eval-errors [159] 24.0% alt-errors [161] 13.2% ------------------------------------------------------------------------------ ??? [235] 100.0% [252] 3288(0.7%) 1694(0.3%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [152] 48.5% ------------------------------------------------------------------------------ mk-enode-rec! [253] 37.8% mk-egraph [238] 62.2% [253] 2898(0.6%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode! [93] 62.2% mk-enode-rec! [253] 37.8% ------------------------------------------------------------------------------ list-member? [237] 100.0% [254] 650(0.1%) 650(0.1%) member (unknown source) ------------------------------------------------------------------------------ loop [241] 100.0% [255] 336(0.1%) 0(0.0%) errors-score ...egime-testing/src/points.rkt:298:0 *bit-width* [264] 100.0% ------------------------------------------------------------------------------ debug-print [242] 100.0% [256] 314(0.1%) 314(0.1%) for-loop ...bie/regime-testing/src/debug.rkt:113:2 ------------------------------------------------------------------------------ loop [245] 100.0% [257] 52(0.0%) 52(0.0%) random-exp .../regime-testing/src/common.rkt:254:0 ------------------------------------------------------------------------------ ??? [132] 1.6% ??? [215] 5.0% ??? [248] 5.9% ??? [152] 14.3% ??? [247] 73.3% [258] 19534(3.9%) 15550(3.1%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [267] 9.5% dict? [268] 5.9% ??? [132] 5.0% ------------------------------------------------------------------------------ ??? [140] 0.4% ??? [234] 45.6% for-loop [246] 54.0% [259] 14420(2.9%) 8574(1.7%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [265] 40.5% ------------------------------------------------------------------------------ ??? [223] 9.6% ??? [248] 90.4% [260] 4834(1.0%) 4432(0.9%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [270] 8.3% ------------------------------------------------------------------------------ ??? [140] 28.0% ??? [152] 36.0% for-loop [246] 36.0% [261] 4598(0.9%) 2262(0.5%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [266] 50.8% ------------------------------------------------------------------------------ for-loop [82] 20.5% for-loop [50] 34.9% return/no-unsupplied [250] 44.6% [262] 1922(0.4%) 1922(0.4%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------ ??? [203] 16.6% for-loop [149] 22.2% ??? [247] 61.2% [263] 1542(0.3%) 698(0.1%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [269] 54.7% ------------------------------------------------------------------------------ eval-errors [159] 14.3% errors-score [255] 85.7% [264] 392(0.1%) 392(0.1%) *bit-width* ...e/regime-testing/src/float.rkt:43:0 ------------------------------------------------------------------------------ ??? [259] 100.0% [265] 5846(1.2%) 5846(1.2%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------ ??? [261] 100.0% [266] 2336(0.5%) 1442(0.3%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [271] 38.3% ------------------------------------------------------------------------------ ??? [258] 100.0% [267] 1856(0.4%) 1856(0.4%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------ ??? [225] 8.1% ??? [258] 91.9% [268] 1252(0.3%) 1252(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------ ??? [263] 100.0% [269] 844(0.2%) 252(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [272] 70.1% ------------------------------------------------------------------------------ ??? [260] 100.0% [270] 402(0.1%) 402(0.1%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------ check-hash/c [266] 100.0% [271] 894(0.2%) 894(0.2%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------ ??? [269] 100.0% [272] 592(0.1%) 592(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 ------------------------------------------------------------------------------