Profiling results ----------------- Total cpu time observed: 27924ms (out of 28448ms) Number of samples taken: 76 (once every 367ms) ======================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ======================================================================== ??? [28] 100.0% [1] 25620(91.7%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [7] 100.0% ------------------------------------------------------------------------ ??? [28] 100.0% [2] 9354(33.5%) 0(0.0%) run-improve50 ...me-testing/src/mainloop.rkt:235:0 for-loop [8] 96.6% prepare-points [34] 3.4% ------------------------------------------------------------------------ ->flonum [82] 100.0% [3] 7966(28.5%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [9] 100.0% ------------------------------------------------------------------------ ->flonum [82] 100.0% [4] 1666(6.0%) 0(0.0%) loop ...regime-testing/src/core/simplify.rkt:237:2 pass [10] 100.0% ------------------------------------------------------------------------ loop [53] 100.0% [5] 372(1.3%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 map [50] 100.0% ------------------------------------------------------------------------ match-e [18] 100.0% [6] 348(1.2%) 0(0.0%) variable? ...e-testing/src/syntax/syntax.rkt:665:0 ??? [48] 100.0% ------------------------------------------------------------------------ profile-thunk16 [1] 100.0% [7] 25620(91.7%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [28] 100.0% ------------------------------------------------------------------------ run-improve50 [2] 100.0% [8] 9038(32.4%) 0(0.0%) for-loop ...regime-testing/src/mainloop.rkt:251:10 run-iter! [11] 100.0% ------------------------------------------------------------------------ iterate-egraph!13 [3] 100.0% [9] 7966(28.5%) 0(0.0%) one-iter ...me-testing/src/core/simplify.rkt:116:0 for-loop [12] 53.2% for-loop [13] 46.8% ------------------------------------------------------------------------ loop [4] 100.0% [10] 1666(6.0%) 0(0.0%) pass ...regime-testing/src/core/simplify.rkt:227:2 for-loop [14] 100.0% ------------------------------------------------------------------------ for-loop [8] 100.0% [11] 9038(32.4%) 0(0.0%) run-iter! ...regime-testing/src/mainloop.rkt:215:0 simplify! [15] 81.1% finalize-iter! [19] 14.8% localize-error [20] 4.1% ------------------------------------------------------------------------ one-iter [9] 100.0% [12] 4240(15.2%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:166:2 for-loop [16] 91.8% match-e [18] 8.2% ------------------------------------------------------------------------ for-loop [13] 50.0% one-iter [9] 50.0% [13] 3726(13.3%) 2334(8.4%) for-loop ...e-testing/src/core/simplify.rkt:126:12 for-loop [13] 50.0% match-e [18] 18.7% ------------------------------------------------------------------------ pass [10] 100.0% [14] 1666(6.0%) 0(0.0%) for-loop ...e-testing/src/core/simplify.rkt:230:29 argmin [17] 100.0% ------------------------------------------------------------------------ run-iter! [11] 100.0% [15] 7328(26.2%) 0(0.0%) simplify! ...regime-testing/src/mainloop.rkt:155:0 for-loop [21] 100.0% ------------------------------------------------------------------------ for-loop [12] 100.0% [16] 3892(13.9%) 0(0.0%) for-loop ...e-testing/src/core/simplify.rkt:148:10 mk-enode! [29] 34.0% merge-egraph-nodes! [24] 25.1% substitute-e [25] 24.9% loop! [63] 15.9% ------------------------------------------------------------------------ baseline-error [37] 17.9% for-loop [14] 82.1% [17] 2028(7.3%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [22] 65.6% ??? [26] 17.9% expression-cost [27] 16.6% ------------------------------------------------------------------------ for-loop [12] 6.7% for-loop [30] 23.6% for-loop [13] 69.8% [18] 1740(6.2%) 704(2.5%) match-e ...regime-testing/src/core/ematch.rkt:46:0 for-loop [23] 52.9% variable? [6] 6.7% ------------------------------------------------------------------------ run-iter! [11] 100.0% [19] 1338(4.8%) 0(0.0%) finalize-iter! ...e-testing/src/mainloop.rkt:169:0 ??? [48] 100.0% ------------------------------------------------------------------------ run-iter! [11] 100.0% [20] 372(1.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [64] 100.0% ------------------------------------------------------------------------ simplify! [15] 100.0% [21] 7328(26.2%) 0(0.0%) for-loop .../regime-testing/src/mainloop.rkt:159:6 ??? [28] 100.0% ------------------------------------------------------------------------ argmin [17] 100.0% [22] 1330(4.8%) 0(0.0%) for-loop .../regime-testing/src/programs.rkt:210:2 ->flonum [82] 74.6% ...sting/src/common.rkt:48:2 [31] 25.4% ------------------------------------------------------------------------ match-e [18] 100.0% [23] 1036(3.7%) 356(1.3%) for-loop ...gime-testing/src/core/ematch.rkt:59:11 for-loop [30] 82.8% ------------------------------------------------------------------------ merge-egraph-nodes! [24] 15.8% for-loop [16] 84.2% [24] 978(3.5%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 loop! [63] 50.2% update-leader! [33] 33.9% merge-egraph-nodes! [24] 15.8% ------------------------------------------------------------------------ for-loop [16] 100.0% [25] 970(3.5%) 0(0.0%) substitute-e ...e-testing/src/core/ematch.rkt:71:0 mk-enode! [29] 100.0% ------------------------------------------------------------------------ argmin [17] 100.0% [26] 362(1.3%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:295:27 eval-errors [71] 100.0% ------------------------------------------------------------------------ argmin [17] 100.0% [27] 336(1.2%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [32] 100.0% ------------------------------------------------------------------------ for-loop [21] 8.7% run [7] 41.5% [28] 27924(100.0%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 41.5% prepare-points [34] 23.0% ->flonum [82] 17.0% run-improve50 [2] 12.4% eval-errors [71] 3.0% oracle-error [36] 2.5% baseline-error [37] 0.6% ------------------------------------------------------------------------ substitute-e [25] 42.3% for-loop [16] 57.7% [29] 2294(8.2%) 658(2.4%) mk-enode! ...ime-testing/src/core/egraph.rkt:102:0 new-enode [35] 71.3% ------------------------------------------------------------------------ for-loop [23] 100.0% [30] 1036(3.7%) 332(1.2%) for-loop ...gime-testing/src/core/ematch.rkt:65:37 match-e [18] 68.0% ------------------------------------------------------------------------ for-loop [22] 100.0% [31] 338(1.2%) 0(0.0%) ...sting/src/common.rkt:48:2 ...e/arr-i.rkt:906:19 ??? [38] 100.0% ------------------------------------------------------------------------ expression-cost [27] 100.0% [32] 336(1.2%) 0(0.0%) compile ...e/regime-testing/src/programs.rkt:186:0 hash-ref! [64] 100.0% ------------------------------------------------------------------------ merge-egraph-nodes! [24] 100.0% [33] 332(1.2%) 0(0.0%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [39] 100.0% ------------------------------------------------------------------------ run-improve50 [2] 2.4% ??? [28] 97.6% [34] 13154(47.1%) 0(0.0%) prepare-points ...ime-testing/src/points.rkt:214:0 loop [40] 41.6% loop [46] 26.6% make-exacts* [47] 24.2% for-loop [43] 5.2% debug7 [45] 2.4% ------------------------------------------------------------------------ mk-enode! [29] 100.0% [35] 1636(5.9%) 0(0.0%) new-enode ...egime-testing/src/core/enode.rkt:97:0 type-of-enode-expr [41] 100.0% ------------------------------------------------------------------------ ??? [28] 100.0% [36] 1394(5.0%) 0(0.0%) oracle-error ...egime-testing/src/points.rkt:290:0 for-loop [42] 100.0% ------------------------------------------------------------------------ ??? [28] 100.0% [37] 362(1.3%) 0(0.0%) baseline-error ...ime-testing/src/points.rkt:294:0 argmin [17] 100.0% ------------------------------------------------------------------------ ...sting/src/common.rkt:48:2 [31]100.0% [38] 338(1.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [96] 100.0% ------------------------------------------------------------------------ update-leader! [33] 100.0% [39] 332(1.2%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:223:6 for-loop [44] 100.0% ------------------------------------------------------------------------ prepare-points [34] 100.0% [40] 5468(19.6%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:158:2 loop [46] 67.2% make-exacts* [47] 32.8% ------------------------------------------------------------------------ new-enode [35] 100.0% [41] 1636(5.9%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [49] 100.0% ------------------------------------------------------------------------ oracle-error [36] 100.0% [42] 1394(5.0%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:291:2 map [50] 72.7% loop [53] 27.3% ------------------------------------------------------------------------ prepare-points [34] 100.0% [43] 686(2.5%) 0(0.0%) for-loop ...e/regime-testing/src/points.rkt:255:26 ??? [51] 100.0% ------------------------------------------------------------------------ for-loop [39] 100.0% [44] 332(1.2%) 0(0.0%) for-loop ...gime-testing/src/core/egraph.rkt:224:8 hash-update! [52] 100.0% ------------------------------------------------------------------------ prepare-points [34] 100.0% [45] 316(1.1%) 0(0.0%) debug7 ...erbie/regime-testing/src/debug.rkt:102:0 ??? [48] 100.0% ------------------------------------------------------------------------ prepare-points [34] 48.8% loop [40] 51.2% [46] 7178(25.7%) 0(0.0%) loop ...herbie/regime-testing/src/points.rkt:141:4 loop [53] 100.0% ------------------------------------------------------------------------ loop [40] 36.1% prepare-points [34] 63.9% [47] 4974(17.8%) 0(0.0%) make-exacts* ...egime-testing/src/points.rkt:138:0 loop [53] 85.3% eval-prog [55] 14.7% ------------------------------------------------------------------------ debug7 [45] 13.6% get-sigs [49] 13.9% variable? [6] 15.0% finalize-iter! [19] 57.5% [48] 2326(8.3%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [54] 43.0% hash-has-key? [57] 28.9% atab-add-altns [58] 14.5% ??? [60] 13.6% ------------------------------------------------------------------------ type-of-enode-expr [41] 100.0% [49] 1636(5.9%) 0(0.0%) get-sigs .../regime-testing/src/type-check.rkt:5:0 ->flonum [82] 80.2% ??? [48] 19.8% ------------------------------------------------------------------------ ??? [5] 26.8% for-loop [42] 73.2% [50] 1386(5.0%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 ??? [61] 73.2% ??? [80] 26.8% ------------------------------------------------------------------------ for-loop [43] 100.0% [51] 686(2.5%) 0(0.0%) ??? .../herbie/regime-testing/src/points.rkt:230:7 for-loop [56] 100.0% ------------------------------------------------------------------------ for-loop [44] 100.0% [52] 332(1.2%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [59] 100.0% ------------------------------------------------------------------------ parse-loop12 [85] 0.0% make-exacts* [47] 0.0% loop [46] 0.2% loop! [63] 1.4% for-loop [42] 2.8% loop [53] 95.5% [53] 13438(48.1%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [53] 95.5% ??? [61] 2.8% loop! [63] 1.4% ??? [76] 0.2% ??? [5] 0.0% ------------------------------------------------------------------------ ??? [48] 100.0% [54] 1000(3.6%) 0(0.0%) for-loop ...me-testing/src/core/alt-table.rkt:51:2 atab-add-altn [62] 100.0% ------------------------------------------------------------------------ make-exacts* [47] 100.0% [55] 732(2.6%) 406(1.5%) eval-prog ...regime-testing/src/programs.rkt:150:0 hash-ref! [64] 44.5% ------------------------------------------------------------------------ ??? [51] 100.0% [56] 686(2.5%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:231:9 ??? [80] 100.0% ------------------------------------------------------------------------ ??? [48] 100.0% [57] 672(2.4%) 348(1.2%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [90] 48.2% ------------------------------------------------------------------------ ??? [48] 100.0% [58] 338(1.2%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:50:0 atab-add-altn [62] 100.0% ------------------------------------------------------------------------ hash-update! [52] 100.0% [59] 332(1.2%) 0(0.0%) ??? ...e/regime-testing/src/core/egraph.rkt:226:24 for-loop [65] 100.0% ------------------------------------------------------------------------ ??? [48] 100.0% [60] 316(1.1%) 0(0.0%) ??? ...ects/racket/contract/private/guts.rkt:644:8 dict? [66] 100.0% ------------------------------------------------------------------------ loop [53] 27.3% map [50] 72.7% [61] 1394(5.0%) 0(0.0%) ??? ...herbie/regime-testing/src/points.rkt:292:26 ??? [76] 73.5% ??? [80] 26.5% ------------------------------------------------------------------------ atab-add-altns [58] 25.3% for-loop [54] 74.7% [62] 1338(4.8%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:208:0 best-and-tied-at-points [67] 100.0% ------------------------------------------------------------------------ for-loop [16] 24.5% merge-egraph-nodes! [24] 25.5% loop [53] 50.0% [63] 1266(4.5%) 0(0.0%) loop! ...e/regime-testing/src/core/enode.rkt:192:2 loop [53] 50.0% update-en-expr [68] 37.7% set [70] 12.3% ------------------------------------------------------------------------ eval-prog [55] 31.5% compile [32] 32.5% localize-error [20] 36.0% [64] 1034(3.7%) 336(1.2%) hash-ref! ...racket/private/more-scheme.rkt:373:13 parse-loop12 [85] 36.0% bigfloat-hash [69] 31.5% ------------------------------------------------------------------------ ??? [59] 100.0% [65] 332(1.2%) 332(1.2%) for-loop ...ime-testing/src/core/egraph.rkt:227:26 ------------------------------------------------------------------------ ??? [60] 100.0% [66] 316(1.1%) 316(1.1%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------ atab-add-altn [62] 100.0% [67] 1338(4.8%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [71] 75.2% for-loop [72] 24.8% ------------------------------------------------------------------------ loop! [63] 100.0% [68] 954(3.4%) 954(3.4%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------ hash-ref! [64] 100.0% [69] 326(1.2%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bigfloat->sig+exp [73] 100.0% ------------------------------------------------------------------------ loop! [63] 100.0% [70] 312(1.1%) 312(1.1%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------ ??? [26] 11.9% best-and-tied-at-points [67] 33.1% ??? [28] 55.0% [71] 3040(10.9%) 0(0.0%) eval-errors ...regime-testing/src/points.rkt:271:0 for-loop [74] 100.0% ------------------------------------------------------------------------ best-and-tied-at-points [67] 100.0% [72] 332(1.2%) 332(1.2%) for-loop ...-testing/src/core/alt-table.rkt:124:16 ------------------------------------------------------------------------ bigfloat-hash [69] 100.0% [73] 326(1.2%) 0(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:370:0 new-mpz [75] 100.0% ------------------------------------------------------------------------ eval-errors [71] 100.0% [74] 3040(10.9%) 0(0.0%) for-loop ...ie/regime-testing/src/points.rkt:273:2 ??? [76] 89.8% ulp-difference [77] 10.2% ------------------------------------------------------------------------ bigfloat->sig+exp [73] 100.0% [75] 326(1.2%) 326(1.2%) new-mpz ...-lib/math/private/bigfloat/gmp.rkt:73:0 ------------------------------------------------------------------------ ??? [61] 6.7% for-loop [74] 18.0% loop [53] 75.3% [76] 15174(54.3%) 1030(3.7%) ??? ...erbie/regime-testing/src/programs.rkt:156:4 ??? [78] 47.2% ??? [79] 36.5% ??? [80] 7.1% ??? [81] 2.4% ------------------------------------------------------------------------ for-loop [74] 100.0% [77] 310(1.1%) 310(1.1%) ulp-difference ...egime-testing/src/float.rkt:19:0 ------------------------------------------------------------------------ ??? [76] 100.0% [78] 7162(25.6%) 3096(11.1%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [84] 38.5% ??? [98] 4.8% parse-loop12 [85] 4.7% ??? [86] 4.5% for-loop [87] 4.3% ------------------------------------------------------------------------ ??? [76] 100.0% [79] 5534(19.8%) 724(2.6%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [83] 86.9% ------------------------------------------------------------------------ ??? [61] 14.8% map [50] 14.8% for-loop [56] 27.4% ??? [76] 43.0% [80] 2506(9.0%) 710(2.5%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ->flonum [82] 71.7% ------------------------------------------------------------------------ ??? [76] 100.0% [81] 370(1.3%) 370(1.3%) ??? ...tract/private/arrow-higher-order.rkt:145:21 ------------------------------------------------------------------------ for-loop [22] 2.9% get-sigs [49] 3.8% ??? [80] 15.7% for-loop [88] 38.8% ??? [28] 38.8% [82] 11428(40.9%) 1800(6.4%) ->flonum ...s/racket/private/norm-define.rkt:53:83 for-loop [88] 38.8% iterate-egraph!13 [3] 32.9% loop [4] 5.8% ??? [90] 5.8% loop [91] 2.9% ------------------------------------------------------------------------ ??? [79] 100.0% [83] 4810(17.2%) 2822(10.1%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [93] 41.3% ------------------------------------------------------------------------ ??? [78] 100.0% [84] 2758(9.9%) 340(1.2%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [89] 87.7% ------------------------------------------------------------------------ ??? [78] 47.3% hash-ref! [64] 52.7% [85] 706(2.5%) 334(1.2%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [53] 52.7% ------------------------------------------------------------------------ ??? [78] 100.0% [86] 320(1.1%) 320(1.1%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------ ??? [78] 100.0% [87] 308(1.1%) 0(0.0%) for-loop ...me-testing/src/syntax/syntax.rkt:531:2 ...higher-order.rkt:342:33 [92] 100.0% ------------------------------------------------------------------------ ->flonum [82] 100.0% [88] 9632(34.5%) 0(0.0%) for-loop ...me-testing/src/core/simplify.rkt:66:12 ->flonum [82] 100.0% ------------------------------------------------------------------------ ??? [84] 100.0% [89] 2418(8.7%) 1710(6.1%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [93] 29.3% ------------------------------------------------------------------------ hash-has-key? [57] 14.1% ->flonum [82] 85.9% [90] 2298(8.2%) 638(2.3%) ??? ...ects/racket/contract/private/list.rkt:737:4 ??? [95] 29.1% for-loop [94] 29.1% ??? [96] 14.1% ------------------------------------------------------------------------ ->flonum [82] 100.0% [91] 326(1.2%) 0(0.0%) loop .../herbie/regime-testing/src/points.rkt:66:6 random-exp [97] 100.0% ------------------------------------------------------------------------ for-loop [87] 100.0% [92] 308(1.1%) 308(1.1%) ...higher-order.rkt:342:33 (unknown source) ------------------------------------------------------------------------ bfdiv [89] 26.3% real->bigfloat [83] 73.7% [93] 2696(9.7%) 2696(9.7%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------ ??? [90] 100.0% [94] 668(2.4%) 668(2.4%) for-loop ...acket/contract/private/list.rkt:743:12 ------------------------------------------------------------------------ ??? [90] 100.0% [95] 668(2.4%) 334(1.2%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [99] 50.0% ------------------------------------------------------------------------ ??? [90] 48.9% ??? [38] 51.1% [96] 662(2.4%) 338(1.2%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [98] 48.9% ------------------------------------------------------------------------ loop [91] 100.0% [97] 326(1.2%) 326(1.2%) random-exp .../regime-testing/src/common.rkt:254:0 ------------------------------------------------------------------------ ??? [96] 48.4% ??? [78] 51.6% [98] 670(2.4%) 670(2.4%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ------------------------------------------------------------------------ ??? [95] 100.0% [99] 334(1.2%) 334(1.2%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------