Profiling results ----------------- Total cpu time observed: 425524ms (out of 427312ms) Number of samples taken: 1271 (once every 335ms) (Hiding functions with self<1.0% and local<2.0%: 11 of 202 hidden) =========================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================== ??? [160] 100.0% [1] 374510(88.0%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [14] 98.7% --------------------------------------------------------------------------- ??? [56] 100.0% [2] 358692(84.3%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [15] 100.0% --------------------------------------------------------------------------- ??? [56] 100.0% [3] 349028(82.0%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [16] 99.1% get-final-combination [18] 0.9% --------------------------------------------------------------------------- ??? [160] 100.0% [4] 24860(5.8%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [17] 100.0% --------------------------------------------------------------------------- substitute-e [47] 25.6% match-e [35] 74.4% [5] 10378(2.4%) 634(0.1%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [110] 93.9% --------------------------------------------------------------------------- ??? [158] 100.0% [6] 2602(0.6%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [19] 87.1% f6 [38] 12.9% --------------------------------------------------------------------------- hash-ref! [77] 100.0% [7] 1270(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [20] 100.0% --------------------------------------------------------------------------- hash-ref! [77] 100.0% [8] 970(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [21] 100.0% --------------------------------------------------------------------------- copying-mergesort [149] 100.0% [9] 648(0.2%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [151] 100.0% --------------------------------------------------------------------------- hash-ref! [77] 100.0% [10] 646(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [22] 100.0% --------------------------------------------------------------------------- hash-ref! [77] 100.0% [11] 334(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 for-loop [23] 100.0% --------------------------------------------------------------------------- f6 [38] 100.0% [12] 326(0.1%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 expression->type [24] 100.0% --------------------------------------------------------------------------- hash-ref! [77] 100.0% [13] 300(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:483:23 for-loop [25] 100.0% --------------------------------------------------------------------------- iterate-egraph!13 [1] 100.0% [14] 369592(86.9%) 1378(0.3%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [27] 85.8% for-loop [28] 13.7% --------------------------------------------------------------------------- profile-thunk16 [2] 100.0% [15] 358692(84.3%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [56] 100.0% --------------------------------------------------------------------------- run-improve50 [3] 100.0% [16] 345728(81.2%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [26] 100.0% --------------------------------------------------------------------------- loop [4] 100.0% [17] 24860(5.8%) 336(0.1%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [29] 98.6% --------------------------------------------------------------------------- run-improve50 [3] 100.0% [18] 3300(0.8%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [30] 100.0% --------------------------------------------------------------------------- approximate9 [6] 100.0% [19] 2266(0.5%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 ??? [158] 57.5% hash-ref! [77] 42.5% --------------------------------------------------------------------------- ??? [7] 100.0% [20] 1270(0.3%) 300(0.1%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [77] 76.4% --------------------------------------------------------------------------- ??? [8] 100.0% [21] 970(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [31] 100.0% --------------------------------------------------------------------------- ??? [10] 100.0% [22] 646(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 hash-ref! [77] 100.0% --------------------------------------------------------------------------- ??? [11] 100.0% [23] 334(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [77] 100.0% --------------------------------------------------------------------------- loop [12] 100.0% [24] 326(0.1%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [32] 100.0% --------------------------------------------------------------------------- ??? [13] 100.0% [25] 300(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:487:35 parse-loop79 [126] 100.0% --------------------------------------------------------------------------- for-loop [16] 100.0% [26] 345728(81.2%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [33] 96.9% finalize-iter! [37] 2.2% gen-series! [40] 0.8% localize-error [43] 0.1% --------------------------------------------------------------------------- one-iter [14] 100.0% [27] 317202(74.5%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [34] 92.4% match-e [35] 6.7% reduce-to-single! [41] 0.8% update-leader! [58] 0.1% --------------------------------------------------------------------------- for-loop [28] 48.3% one-iter [14] 51.7% [28] 50700(11.9%) 11018(2.6%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [28] 48.3% match-e [35] 38.8% ??? [81] 0.3% --------------------------------------------------------------------------- pass [17] 100.0% [29] 24524(5.8%) 0(0.0%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [36] 69.4% loop [39] 18.5% for-loop [42] 9.5% make-sequence [79] 2.6% --------------------------------------------------------------------------- get-final-combination [18] 100.0% [30] 3300(0.8%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f6 [38] 100.0% --------------------------------------------------------------------------- for-loop [21] 100.0% [31] 970(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [77] 68.0% ??? [44] 32.0% --------------------------------------------------------------------------- expression->type [24] 100.0% [32] 326(0.1%) 0(0.0%) for-loop ...ie/alt-testing/src/type-check.rkt:52:5 f6 [38] 100.0% --------------------------------------------------------------------------- run-iter! [26] 100.0% [33] 334858(78.7%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [45] 100.0% --------------------------------------------------------------------------- for-loop [27] 100.0% [34] 293250(68.9%) 1338(0.3%) for-loop ...t-testing/src/core/simplify.rkt:148:10 merge-egraph-nodes! [46] 39.1% mk-enode! [57] 24.0% loop! [74] 17.7% substitute-e [47] 16.7% list-member? [50] 1.9% --------------------------------------------------------------------------- for-loop [27] 19.1% for-loop [59] 32.2% for-loop [28] 48.7% [35] 60518(14.2%) 17864(4.2%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [48] 47.9% for-loop [59] 10.9% ??? [110] 8.4% variable? [5] 5.2% list-cartesian-product [63] 1.7% custom-in-set [105] 0.9% loop [108] 0.3% curry* [67] 0.3% filter [176] 0.3% --------------------------------------------------------------------------- for-loop [29] 100.0% [36] 17022(4.0%) 316(0.1%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [49] 94.1% expression-cost [54] 4.0% --------------------------------------------------------------------------- run-iter! [26] 100.0% [37] 7594(1.8%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [110] 100.0% --------------------------------------------------------------------------- for-loop [32] 1.2% approximate9 [6] 1.2% map [53] 4.4% parse-loop79 [126] 5.7% hash-ref! [77] 6.4% f6 [38] 8.3% simplify [91] 13.9% split-table [30] 58.9% [38] 5602(1.3%) 310(0.1%) f6 ...et/collects/racket/match/compiler.rkt:507:40 loop [108] 47.7% map [53] 26.4% option-on-expr [125] 11.2% f6 [38] 8.3% combine-mterms [55] 3.0% loop [12] 1.2% ??? [160] 1.2% --------------------------------------------------------------------------- for-loop [29] 100.0% [39] 4528(1.1%) 306(0.1%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [49] 64.9% expression-cost [54] 28.3% --------------------------------------------------------------------------- run-iter! [26] 100.0% [40] 2602(0.6%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [51] 100.0% --------------------------------------------------------------------------- for-loop [27] 100.0% [41] 2486(0.6%) 0(0.0%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [52] 87.0% make-sequence [79] 13.0% --------------------------------------------------------------------------- for-loop [29] 100.0% [42] 2328(0.5%) 2328(0.5%) for-loop ...t-testing/src/core/simplify.rkt:217:13 --------------------------------------------------------------------------- run-iter! [26] 100.0% [43] 360(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [77] 100.0% --------------------------------------------------------------------------- for-loop [31] 100.0% [44] 310(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [77] 100.0% --------------------------------------------------------------------------- simplify! [33] 100.0% [45] 334858(78.7%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [56] 99.9% debug-print [72] 0.1% --------------------------------------------------------------------------- merge-egraph-nodes! [46] 4.0% for-loop [60] 10.6% for-loop [34] 85.4% [46] 114608(26.9%) 1006(0.2%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [58] 48.7% for-loop [60] 15.9% loop! [74] 15.8% for-loop [61] 9.8% merge-egraph-nodes! [46] 4.0% enode-merge! [62] 3.8% make-sequence [79] 0.6% --------------------------------------------------------------------------- substitute-e [47] 6.5% for-loop [34] 93.5% [47] 49106(11.5%) 2258(0.5%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [57] 87.3% substitute-e [47] 6.5% variable? [5] 1.9% ??? [110] 0.9% --------------------------------------------------------------------------- match-e [35] 100.0% [48] 38950(9.2%) 12578(3.0%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [59] 60.0% list-cartesian-product [63] 6.8% loop [108] 2.4% curry* [67] 2.1% foldl [68] 1.3% filter [176] 0.9% --------------------------------------------------------------------------- loop [39] 15.5% argmin [36] 84.5% [49] 18966(4.5%) 1024(0.2%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [160] 63.0% ...sting/src/common.rkt:47:2 [112] 26.2% ??? [111] 5.5% --------------------------------------------------------------------------- for-loop [34] 100.0% [50] 5672(1.3%) 1044(0.2%) list-member? ...llects/racket/private/set.rkt:24:0 loop [64] 75.5% member [69] 6.1% --------------------------------------------------------------------------- gen-series! [40] 100.0% [51] 2602(0.6%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [65] 100.0% --------------------------------------------------------------------------- reduce-to-single! [41] 100.0% [52] 2162(0.5%) 2162(0.5%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 --------------------------------------------------------------------------- f6 [38] 100.0% [53] 1976(0.5%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 parse-loop79 [126] 32.1% loop [108] 18.2% simplify-node [106] 17.0% taylor-invert [71] 17.0% f6 [38] 15.7% --------------------------------------------------------------------------- argmin [36] 34.7% loop [39] 65.3% [54] 1962(0.5%) 310(0.1%) expression-cost ...-testing/src/programs.rkt:209:0 compile [66] 84.2% --------------------------------------------------------------------------- f6 [38] 100.0% [55] 336(0.1%) 0(0.0%) combine-mterms ...esting/src/core/reduce.rkt:191:0 for-loop [70] 100.0% --------------------------------------------------------------------------- for-loop [45] 26.3% run [15] 29.2% [56] 423212(99.5%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [160] 41.5% profile-thunk16 [2] 29.2% run-improve50 [3] 28.1% prepare-points [76] 1.2% --------------------------------------------------------------------------- mk-egraph [170] 0.3% mk-enode-rec! [177] 1.2% substitute-e [47] 37.3% for-loop [34] 61.3% [57] 115020(27.0%) 7052(1.7%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [73] 91.8% hash-has-key? [118] 1.8% --------------------------------------------------------------------------- for-loop [27] 0.5% merge-egraph-nodes! [46] 99.5% [58] 62454(14.7%) 4012(0.9%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [75] 86.6% update-en-expr [129] 2.6% make-sequence [79] 1.6% hash-ref! [77] 1.1% --------------------------------------------------------------------------- match-e [35] 31.2% for-loop [48] 68.8% [59] 37546(8.8%) 1054(0.2%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [35] 95.0% ??? [81] 2.6% --------------------------------------------------------------------------- merge-egraph-nodes! [46] 100.0% [60] 30194(7.1%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [46] 79.8% loop! [74] 20.2% --------------------------------------------------------------------------- merge-egraph-nodes! [46] 100.0% [61] 11568(2.7%) 8294(1.9%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [129] 28.3% --------------------------------------------------------------------------- merge-egraph-nodes! [46] 100.0% [62] 4654(1.1%) 1022(0.2%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [78] 56.5% custom-set-intersect! [82] 21.5% --------------------------------------------------------------------------- list-cartesian-product [63] 25.3% match-e [35] 25.3% for-loop [48] 49.4% [63] 4632(1.1%) 4632(1.1%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [63] 25.3% --------------------------------------------------------------------------- list-member? [50] 100.0% [64] 4282(1.0%) 4282(1.0%) loop (unknown source) --------------------------------------------------------------------------- for-loop [51] 100.0% [65] 2602(0.6%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [80] 100.0% --------------------------------------------------------------------------- expression-cost [54] 100.0% [66] 1652(0.4%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [77] 100.0% --------------------------------------------------------------------------- match-e [35] 19.7% for-loop [48] 80.3% [67] 1616(0.4%) 926(0.2%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [83] 42.7% --------------------------------------------------------------------------- for-loop [48] 100.0% [68] 678(0.2%) 322(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [84] 52.5% --------------------------------------------------------------------------- list-member? [50] 100.0% [69] 346(0.1%) 346(0.1%) member (unknown source) --------------------------------------------------------------------------- combine-mterms [55] 100.0% [70] 336(0.1%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:195:5 hash-ref! [77] 100.0% --------------------------------------------------------------------------- map [53] 100.0% [71] 336(0.1%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [91] 100.0% --------------------------------------------------------------------------- for-loop [45] 100.0% [72] 310(0.1%) 0(0.0%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 for-loop [85] 100.0% --------------------------------------------------------------------------- mk-enode! [57] 100.0% [73] 105604(24.8%) 1032(0.2%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [86] 98.1% set [89] 1.0% --------------------------------------------------------------------------- for-loop [60] 5.5% merge-egraph-nodes! [46] 21.7% loop [108] 30.4% for-loop [34] 42.4% [74] 85648(20.1%) 17094(4.0%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [88] 38.4% loop [108] 33.2% set [89] 10.7% update-en-expr [129] 6.2% --------------------------------------------------------------------------- update-leader! [58] 100.0% [75] 54110(12.7%) 3324(0.8%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [87] 92.6% update-en-expr [129] 1.2% --------------------------------------------------------------------------- ??? [56] 100.0% [76] 9988(2.3%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [90] 48.8% make-exacts* [103] 27.5% loop [102] 20.3% for-loop [96] 3.4% --------------------------------------------------------------------------- for-loop [137] 1.2% ??? [44] 1.2% for-loop [70] 1.4% for-loop [23] 2.2% for-loop [22] 2.6% for-loop [31] 3.0% for-loop [20] 4.3% loop [19] 5.6% localize-error [43] 7.3% ??? [93] 11.3% ??? [92] 12.1% ??? [158] 12.1% update-leader! [58] 13.8% compile [66] 22.0% [77] 4962(1.2%) 2352(0.6%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [93] 17.8% ??? [92] 12.1% simplify [91] 10.1% f6 [38] 7.3% ??? [7] 6.3% ??? [94] 5.6% ??? [8] 4.3% ??? [10] 2.6% ??? [11] 2.2% ??? [13] 1.2% --------------------------------------------------------------------------- enode-merge! [62] 100.0% [78] 2630(0.6%) 990(0.2%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [88] 62.4% --------------------------------------------------------------------------- reduce-to-single! [41] 12.4% merge-egraph-nodes! [46] 24.5% for-loop [29] 24.7% update-leader! [58] 38.4% [79] 2614(0.6%) 2288(0.5%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [97] 12.5% --------------------------------------------------------------------------- taylor-alt [65] 100.0% [80] 2602(0.6%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [158] 100.0% --------------------------------------------------------------------------- for-loop [28] 24.4% for-loop [59] 75.6% [81] 1302(0.3%) 676(0.2%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [95] 48.1% --------------------------------------------------------------------------- enode-merge! [62] 100.0% [82] 1002(0.2%) 1002(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 --------------------------------------------------------------------------- curry* [67] 100.0% [83] 690(0.2%) 690(0.2%) procedure-arity ...ket/private/norm-arity.rkt:7:27 --------------------------------------------------------------------------- foldl [68] 100.0% [84] 356(0.1%) 356(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 --------------------------------------------------------------------------- debug-print [72] 100.0% [85] 310(0.1%) 0(0.0%) for-loop ...herbie/alt-testing/src/debug.rkt:113:2 write-proc [98] 100.0% --------------------------------------------------------------------------- new-enode [73] 100.0% [86] 103562(24.3%) 2004(0.5%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [99] 98.1% --------------------------------------------------------------------------- for-loop [75] 100.0% [87] 50114(11.8%) 670(0.2%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [100] 98.7% --------------------------------------------------------------------------- adopt-enode! [78] 4.2% loop! [74] 95.8% [88] 38876(9.1%) 10426(2.5%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [101] 63.9% for-loop [104] 9.3% --------------------------------------------------------------------------- new-enode [73] 5.2% loop! [74] 94.8% [89] 19590(4.6%) 19590(4.6%) set ...collects/racket/private/set-types.rkt:981:0 --------------------------------------------------------------------------- prepare-points [76] 100.0% [90] 4878(1.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 loop [102] 79.5% make-exacts* [103] 20.5% --------------------------------------------------------------------------- taylor-invert [71] 14.6% hash-ref! [77] 85.4% [91] 2302(0.5%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f6 [38] 69.8% parse-loop79 [126] 15.6% simplify-node [106] 14.6% --------------------------------------------------------------------------- hash-ref! [77] 100.0% [92] 2266(0.5%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [77] 100.0% --------------------------------------------------------------------------- hash-ref! [77] 100.0% [93] 1322(0.3%) 320(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 hash-ref! [77] 75.8% --------------------------------------------------------------------------- hash-ref! [77] 100.0% [94] 962(0.2%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [158] 100.0% --------------------------------------------------------------------------- ??? [81] 100.0% [95] 626(0.1%) 322(0.1%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ??? [110] 48.6% --------------------------------------------------------------------------- prepare-points [76] 100.0% [96] 336(0.1%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [107] 100.0% --------------------------------------------------------------------------- make-sequence [79] 100.0% [97] 326(0.1%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [105] 100.0% --------------------------------------------------------------------------- for-loop [85] 100.0% [98] 310(0.1%) 310(0.1%) write-proc ...alt-testing/src/alternative.rkt:22:9 --------------------------------------------------------------------------- type-of-enode-expr [86] 100.0% [99] 101558(23.9%) 2292(0.5%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [111] 39.6% ??? [160] 29.4% ??? [110] 15.1% ...sting/src/common.rkt:47:2 [112] 13.7% --------------------------------------------------------------------------- for-loop [87] 100.0% [100] 49444(11.6%) 1364(0.3%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [109] 97.2% --------------------------------------------------------------------------- custom-set-union [88] 100.0% [101] 24840(5.8%) 7840(1.8%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [113] 68.4% --------------------------------------------------------------------------- prepare-points [76] 34.4% loop [90] 65.6% [102] 5912(1.4%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [108] 100.0% --------------------------------------------------------------------------- loop [90] 26.7% prepare-points [76] 73.3% [103] 3740(0.9%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [108] 100.0% --------------------------------------------------------------------------- custom-set-union [88] 100.0% [104] 3610(0.8%) 3610(0.8%) for-loop ...cts/racket/private/set-types.rkt:152:2 --------------------------------------------------------------------------- ??? [97] 31.9% match-e [35] 68.1% [105] 1022(0.2%) 1022(0.2%) custom-in-set ...acket/private/set-types.rkt:577:0 --------------------------------------------------------------------------- simplify [91] 50.0% map [53] 50.0% [106] 672(0.2%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 append-map [116] 50.0% combine-aterms [114] 50.0% --------------------------------------------------------------------------- for-loop [96] 100.0% [107] 336(0.1%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [115] 100.0% --------------------------------------------------------------------------- make-exacts* [103] 0.0% option-on-expr [125] 0.0% map [53] 0.0% loop [102] 0.1% match-e [35] 0.5% for-loop [48] 1.8% f6 [38] 3.3% loop! [74] 13.4% loop [108] 79.3% [108] 71146(16.7%) 4586(1.1%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [108] 79.3% loop! [74] 12.8% option-on-expr [125] 3.3% for-loop [123] 1.0% ??? [151] 0.1% --------------------------------------------------------------------------- hash-update! [100] 100.0% [109] 48080(11.3%) 368(0.1%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [117] 99.2% --------------------------------------------------------------------------- for-loop [95] 0.7% substitute-e [47] 3.0% finalize-iter! [37] 17.1% match-e [35] 21.9% variable? [5] 22.0% get-sigs [99] 34.6% [110] 44380(10.4%) 16096(3.8%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [118] 45.9% for-loop [121] 15.7% atab-add-altns [127] 1.5% atab-pick-alt8 [128] 0.7% --------------------------------------------------------------------------- for-loop [49] 2.5% get-sigs [99] 97.5% [111] 41248(9.7%) 2396(0.6%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [120] 47.9% for-loop [119] 41.5% get/build-late-neg-projection [148] 4.0% ??? [183] 0.8% --------------------------------------------------------------------------- for-loop [49] 26.4% get-sigs [99] 73.6% [112] 18828(4.4%) 7392(1.7%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [122] 36.6% ??? [124] 24.1% --------------------------------------------------------------------------- for-loop [101] 100.0% [113] 17000(4.0%) 17000(4.0%) for-loop ...cts/racket/private/set-types.rkt:178:5 --------------------------------------------------------------------------- simplify-node [106] 100.0% [114] 336(0.1%) 336(0.1%) combine-aterms ...esting/src/core/reduce.rkt:183:0 --------------------------------------------------------------------------- ??? [107] 100.0% [115] 336(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:346:33 ??? [186] 100.0% --------------------------------------------------------------------------- simplify-node [106] 100.0% [116] 336(0.1%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 parse-loop79 [126] 100.0% --------------------------------------------------------------------------- ??? [109] 100.0% [117] 47712(11.2%) 41462(9.7%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [129] 13.1% --------------------------------------------------------------------------- mk-enode! [57] 9.1% ??? [110] 90.9% [118] 22406(5.3%) 6350(1.5%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [167] 67.2% ??? [171] 4.5% --------------------------------------------------------------------------- for-loop [174] 17.1% ??? [111] 82.9% [119] 20668(4.9%) 1648(0.4%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [173] 90.5% ??? [186] 1.6% --------------------------------------------------------------------------- ??? [111] 100.0% [120] 19756(4.6%) 1924(0.5%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [130] 90.3% --------------------------------------------------------------------------- ??? [110] 100.0% [121] 6948(1.6%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:52:2 atab-add-altn [131] 100.0% --------------------------------------------------------------------------- for-loop [182] 6.8% ??? [173] 14.4% ...sting/src/common.rkt:47:2 [112] 78.8% [122] 6896(1.6%) 2254(0.5%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [173] 59.3% ??? [183] 9.8% ??? [184] 9.7% --------------------------------------------------------------------------- loop [108] 100.0% [123] 4574(1.1%) 1296(0.3%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [132] 57.9% compose [135] 13.8% --------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [112] 100.0% [124] 4540(1.1%) 1998(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [168] 35.4% assoc-ref [134] 14.1% return/no-unsupplied [169] 6.5% --------------------------------------------------------------------------- f6 [38] 19.0% loop [108] 81.0% [125] 3300(0.8%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [133] 70.8% errors [143] 19.8% loop [108] 9.4% --------------------------------------------------------------------------- parse-loop79 [126] 5.6% for-loop [25] 5.6% append-map [116] 25.3% simplify [91] 27.1% map [53] 36.4% [126] 1330(0.3%) 994(0.2%) parse-loop79 ...s/racket/match/compiler.rkt:418:15 f6 [38] 30.9% for-loop [137] 5.6% parse-loop79 [126] 5.6% --------------------------------------------------------------------------- ??? [110] 100.0% [127] 646(0.2%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:51:0 atab-add-altn [131] 100.0% --------------------------------------------------------------------------- ??? [110] 100.0% [128] 314(0.1%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:61:0 debug7 [136] 100.0% --------------------------------------------------------------------------- for-loop [75] 3.0% update-leader! [58] 7.3% for-loop [61] 14.7% for-loop [117] 28.0% loop! [74] 45.5% [129] 22320(5.2%) 21984(5.2%) update-en-expr ...esting/src/core/egraph.rkt:212:0 --------------------------------------------------------------------------- ??? [120] 100.0% [130] 17832(4.2%) 1292(0.3%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [138] 92.8% --------------------------------------------------------------------------- atab-add-altns [127] 8.5% for-loop [121] 91.5% [131] 7594(1.8%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:243:0 best-and-tied-at-points [139] 100.0% --------------------------------------------------------------------------- for-loop [123] 100.0% [132] 2648(0.6%) 1932(0.5%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 for-loop [141] 27.0% --------------------------------------------------------------------------- option-on-expr [125] 100.0% [133] 2336(0.5%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [140] 100.0% --------------------------------------------------------------------------- ??? [124] 100.0% [134] 638(0.1%) 638(0.1%) assoc-ref ...collects/racket/private/dict.rkt:56:0 --------------------------------------------------------------------------- for-loop [123] 100.0% [135] 630(0.1%) 630(0.1%) compose ...collects/racket/private/list.rkt:385:12 --------------------------------------------------------------------------- atab-pick-alt8 [128] 100.0% [136] 314(0.1%) 314(0.1%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 --------------------------------------------------------------------------- parse-loop79 [126] 100.0% [137] 300(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:490:59 hash-ref! [77] 100.0% --------------------------------------------------------------------------- ??? [130] 100.0% [138] 16540(3.9%) 674(0.2%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [142] 95.9% --------------------------------------------------------------------------- atab-add-altn [131] 100.0% [139] 7594(1.8%) 302(0.1%) best-and-tied-at-points ...ore/alt-table.rkt:157:0 errors [143] 78.6% for-loop [145] 17.4% --------------------------------------------------------------------------- sort-context-on-expr [133] 100.0% [140] 2336(0.5%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [144] 57.1% loop [153] 42.9% --------------------------------------------------------------------------- setfindf [132] 100.0% [141] 716(0.2%) 716(0.2%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 --------------------------------------------------------------------------- ??? [138] 100.0% [142] 15866(3.7%) 3652(0.9%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [146] 51.7% get/build-late-neg-projection [148] 25.2% --------------------------------------------------------------------------- option-on-expr [125] 9.9% best-and-tied-at-points [139] 90.1% [143] 6626(1.6%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [147] 89.6% eval-prog [150] 10.4% --------------------------------------------------------------------------- ??? [140] 100.0% [144] 1334(0.3%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [149] 100.0% --------------------------------------------------------------------------- best-and-tied-at-points [139] 100.0% [145] 1320(0.3%) 1320(0.3%) for-loop ...-testing/src/core/alt-table.rkt:159:16 --------------------------------------------------------------------------- for-loop [142] 100.0% [146] 8210(1.9%) 8210(1.9%) add-list-context ...ontract/private/list.rkt:752:0 --------------------------------------------------------------------------- errors [143] 100.0% [147] 5936(1.4%) 598(0.1%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [151] 72.9% ulp-difference [155] 11.7% ??? [158] 5.3% --------------------------------------------------------------------------- ??? [154] 14.6% ??? [111] 14.6% for-loop [142] 70.7% [148] 5660(1.3%) 1722(0.4%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [152] 61.1% ??? [154] 14.6% --------------------------------------------------------------------------- copying-mergesort [149] 48.8% generic-sort/key [144] 51.2% [149] 1334(0.3%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [149] 48.8% loop [153] 39.1% jloop [9] 12.1% --------------------------------------------------------------------------- errors [143] 100.0% [150] 690(0.2%) 690(0.2%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 --------------------------------------------------------------------------- jloop [9] 3.9% loop [153] 10.2% for-loop [147] 26.0% loop [108] 59.9% [151] 16628(3.9%) 1340(0.3%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [156] 49.2% ??? [157] 33.3% ??? [158] 9.4% --------------------------------------------------------------------------- get/build-late-neg-projection [148]100.0% [152] 3938(0.9%) 988(0.2%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [159] 74.9% --------------------------------------------------------------------------- copying-mergesort [149] 40.6% ??? [140] 59.4% [153] 1688(0.4%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [151] 100.0% --------------------------------------------------------------------------- get/build-late-neg-projection [148]100.0% [154] 1656(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [148]100.0% --------------------------------------------------------------------------- for-loop [147] 100.0% [155] 696(0.2%) 336(0.1%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 ??? [168] 51.7% --------------------------------------------------------------------------- ??? [151] 100.0% [156] 8186(1.9%) 5442(1.3%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [163] 21.4% ...higher-order.rkt:346:33 [164] 4.5% ??? [172] 4.0% bf* [165] 3.6% --------------------------------------------------------------------------- ??? [151] 100.0% [157] 5534(1.3%) 370(0.1%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [161] 93.3% --------------------------------------------------------------------------- for-loop [147] 7.0% ??? [94] 7.2% loop [19] 9.7% ??? [160] 20.6% for-loop [80] 20.6% ??? [151] 35.0% [158] 4482(1.1%) 948(0.2%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [160] 41.4% approximate9 [6] 20.6% hash-ref! [77] 16.9% --------------------------------------------------------------------------- contract-struct-name [162] 28.0% ??? [152] 72.0% [159] 2950(0.7%) 1976(0.5%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [162] 50.1% --------------------------------------------------------------------------- f6 [38] 0.0% ??? [158] 0.7% for-loop [49] 1.0% get-sigs [99] 2.5% ??? [160] 4.0% for-loop [166] 44.0% ??? [56] 47.6% [160] 404590(95.1%) 9214(2.2%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [1] 45.1% for-loop [166] 44.0% ??? [160] 4.0% loop [4] 2.6% ??? [167] 2.2% ??? [158] 0.5% mk-egraph [170] 0.2% ??? [168] 0.2% return/no-unsupplied [169] 0.2% ??? [173] 0.1% ??? [171] 0.0% --------------------------------------------------------------------------- ??? [157] 100.0% [161] 5164(1.2%) 2962(0.7%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [181] 42.6% --------------------------------------------------------------------------- build-compound-type-name [159] 100.0% [162] 1980(0.5%) 974(0.2%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [159] 67.1% --------------------------------------------------------------------------- ??? [156] 100.0% [163] 1748(0.4%) 334(0.1%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [168] 41.4% return/no-unsupplied [169] 39.5% --------------------------------------------------------------------------- ??? [156] 100.0% [164] 370(0.1%) 0(0.0%) ...higher-order.rkt:346:33 (unknown source) ??? [173] 100.0% --------------------------------------------------------------------------- ??? [156] 100.0% [165] 298(0.1%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [172] 100.0% --------------------------------------------------------------------------- ??? [160] 100.0% [166] 369326(86.8%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [160] 100.0% --------------------------------------------------------------------------- hash-has-key? [118] 35.8% ??? [160] 64.2% [167] 42108(9.9%) 17344(4.1%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [174] 41.5% ??? [180] 14.9% ??? [173] 1.6% --------------------------------------------------------------------------- ulp-difference [155] 8.4% ??? [163] 16.9% ??? [160] 37.0% ??? [124] 37.6% [168] 4272(1.0%) 1280(0.3%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [175] 62.5% ??? [184] 7.5% --------------------------------------------------------------------------- ??? [124] 10.4% ??? [163] 24.2% ??? [160] 65.5% [169] 2856(0.7%) 1940(0.5%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [176] 32.1% --------------------------------------------------------------------------- ??? [160] 100.0% [170] 1686(0.4%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [177] 79.1% mk-enode! [57] 20.9% --------------------------------------------------------------------------- ??? [160] 22.8% hash-has-key? [118] 77.2% [171] 1298(0.3%) 1298(0.3%) ??? ...ects/racket/contract/private/hash.rkt:245:7 --------------------------------------------------------------------------- bf* [165] 47.6% ??? [156] 52.4% [172] 626(0.1%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [178] 100.0% --------------------------------------------------------------------------- ...higher-order.rkt:346:33 [164] 1.4% ??? [167] 2.5% ??? [160] 2.5% ??? [122] 21.4% for-loop [119] 72.1% [173] 25932(6.1%) 2980(0.7%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [179] 70.9% ??? [122] 7.7% for-loop [182] 7.4% ??? [186] 2.5% --------------------------------------------------------------------------- ??? [167] 100.0% [174] 17490(4.1%) 9442(2.2%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [180] 21.8% for-loop [119] 20.3% ??? [183] 3.9% --------------------------------------------------------------------------- ??? [168] 100.0% [175] 2672(0.6%) 2672(0.6%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 --------------------------------------------------------------------------- match-e [35] 19.6% for-loop [48] 22.5% return/no-unsupplied [169] 57.9% [176] 1582(0.4%) 1582(0.4%) filter ...t/collects/racket/private/list.rkt:256:2 --------------------------------------------------------------------------- mk-enode-rec! [177] 45.1% mk-egraph [170] 54.9% [177] 1334(0.3%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode! [57] 54.9% mk-enode-rec! [177] 45.1% --------------------------------------------------------------------------- ??? [172] 100.0% [178] 626(0.1%) 298(0.1%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [181] 52.4% --------------------------------------------------------------------------- ??? [173] 100.0% [179] 18386(4.3%) 1676(0.4%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [184] 87.5% ??? [186] 3.4% --------------------------------------------------------------------------- for-loop [174] 37.9% ??? [167] 62.1% [180] 10084(2.4%) 5884(1.4%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [185] 41.7% --------------------------------------------------------------------------- bfmul [178] 13.0% real->bigfloat [161] 87.0% [181] 2530(0.6%) 2530(0.6%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 --------------------------------------------------------------------------- ??? [173] 100.0% [182] 1922(0.5%) 986(0.2%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [122] 48.7% --------------------------------------------------------------------------- ??? [111] 18.7% ??? [122] 40.3% for-loop [174] 41.0% [183] 1678(0.4%) 676(0.2%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [187] 59.7% --------------------------------------------------------------------------- ??? [168] 1.8% ??? [122] 7.6% ??? [179] 90.6% [184] 17744(4.2%) 16774(3.9%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [190] 3.7% --------------------------------------------------------------------------- ??? [180] 100.0% [185] 4200(1.0%) 4200(1.0%) make-keyword-procedure ...ket/private/kw.rkt:260:4 --------------------------------------------------------------------------- for-loop [119] 16.6% ??? [115] 17.3% ??? [179] 32.2% ??? [173] 33.9% [186] 1946(0.5%) 324(0.1%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [188] 83.4% --------------------------------------------------------------------------- ??? [183] 100.0% [187] 1002(0.2%) 332(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [189] 66.9% --------------------------------------------------------------------------- ??? [186] 100.0% [188] 1622(0.4%) 660(0.2%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [191] 59.3% --------------------------------------------------------------------------- check-hash/c [187] 100.0% [189] 670(0.2%) 670(0.2%) flat-contract? .../contract/private/guts.rkt:111:0 --------------------------------------------------------------------------- ??? [184] 100.0% [190] 650(0.2%) 650(0.2%) contract? ...acket/contract/private/guts.rkt:109:0 --------------------------------------------------------------------------- ??? [188] 100.0% [191] 962(0.2%) 962(0.2%) ??? ...ects/racket/contract/private/list.rkt:141:5 ---------------------------------------------------------------------------