Profiling results ----------------- Total cpu time observed: 671140ms (out of 674104ms) Number of samples taken: 1991 (once every 337ms) (Hiding functions with self<1.0% and local<2.0%: 22 of 285 hidden) =============================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =============================================================================== ??? [75] 100.0% [1] 585704(87.3%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [19] 100.0% ------------------------------------------------------------------------------- ??? [75] 100.0% [2] 542200(80.8%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [20] 94.2% get-final-combination [28] 5.4% loop [94] 0.2% setup-alt-simplified [33] 0.1% prepare-points [95] 0.1% ------------------------------------------------------------------------------- ??? [220] 100.0% [3] 402824(60.0%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [21] 98.1% map-enodes [29] 1.7% debug7 [56] 0.1% ------------------------------------------------------------------------------- ??? [217] 100.0% [4] 118110(17.6%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [22] 98.4% f101 [156] 1.6% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [5] 109672(16.3%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 ??? [39] 96.7% hash-ref! [221] 2.7% simplify [37] 0.6% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [6] 104804(15.6%) 312(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [23] 99.9% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [7] 95078(14.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [24] 100.0% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [8] 84762(12.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 for-loop [25] 100.0% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [9] 52520(7.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [26] 100.0% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [10] 44120(6.6%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [217] 94.4% hash-ref! [221] 5.6% ------------------------------------------------------------------------------- ??? [220] 100.0% [11] 38802(5.8%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [27] 100.0% ------------------------------------------------------------------------------- copying-mergesort [208] 100.0% [12] 4652(0.7%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [215] 100.0% ------------------------------------------------------------------------------- f101 [156] 100.0% [13] 3282(0.5%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 first-nonzero-exp [32] 59.4% simplify [37] 40.6% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [14] 3276(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:483:23 for-loop [30] 100.0% ------------------------------------------------------------------------------- f101 [156] 100.0% [15] 2660(0.4%) 690(0.1%) combine-mterms ...esting/src/core/reduce.rkt:191:0 for-loop [31] 74.1% ------------------------------------------------------------------------------- for-loop [201] 40.9% loop [168] 59.1% [16] 1640(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [215] 100.0% ------------------------------------------------------------------------------- f101 [156] 100.0% [17] 1582(0.2%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 loop [168] 58.5% debug-print [55] 21.1% debug7 [56] 20.4% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [18] 980(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [221] 66.1% for-loop [34] 33.9% ------------------------------------------------------------------------------- profile-thunk16 [1] 99.9% [19] 586020(87.3%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [75] 100.0% ------------------------------------------------------------------------------- run-improve50 [2] 100.0% [20] 510808(76.1%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [35] 100.0% ------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [21] 395370(58.9%) 4424(0.7%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [36] 71.3% for-loop [38] 27.6% ------------------------------------------------------------------------------- approximate9 [4] 100.0% [22] 116172(17.3%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 ??? [217] 62.0% hash-ref! [221] 38.0% ------------------------------------------------------------------------------- ??? [6] 100.0% [23] 104804(15.6%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 ??? [39] 64.8% hash-ref! [221] 34.0% simplify [37] 1.2% ------------------------------------------------------------------------------- ??? [7] 100.0% [24] 95078(14.2%) 300(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [221] 99.4% simplify [37] 0.5% ------------------------------------------------------------------------------- ??? [8] 100.0% [25] 84762(12.6%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:324:46 hash-ref! [221] 100.0% ------------------------------------------------------------------------------- ??? [9] 100.0% [26] 52520(7.8%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [40] 100.0% ------------------------------------------------------------------------------- loop [11] 100.0% [27] 38802(5.8%) 324(0.0%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [41] 99.2% ------------------------------------------------------------------------------- run-improve50 [2] 100.0% [28] 29036(4.3%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [42] 97.7% extract-alt [43] 2.3% ------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [29] 6852(1.0%) 0(0.0%) map-enodes ...lt-testing/src/core/egraph.rkt:140:0 loop [168] 86.4% for-loop [176] 13.6% ------------------------------------------------------------------------------- ??? [14] 100.0% [30] 3276(0.5%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:487:35 parse-loop79 [164] 100.0% ------------------------------------------------------------------------------- combine-mterms [15] 100.0% [31] 1970(0.3%) 978(0.1%) for-loop .../alt-testing/src/core/reduce.rkt:195:5 hash-ref! [221] 50.4% ------------------------------------------------------------------------------- taylor-invert [13] 100.0% [32] 1948(0.3%) 320(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [221] 83.6% ------------------------------------------------------------------------------- run-improve50 [2] 100.0% [33] 624(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [44] 100.0% ------------------------------------------------------------------------------- ??? [18] 100.0% [34] 332(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [221] 100.0% ------------------------------------------------------------------------------- for-loop [20] 100.0% [35] 510808(76.1%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [45] 71.2% gen-series! [47] 23.1% finalize-iter! [50] 4.2% choose-best-alt! [52] 0.9% gen-rewrites! [58] 0.4% ------------------------------------------------------------------------------- one-iter [21] 100.0% [36] 281794(42.0%) 636(0.1%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [46] 89.2% match-e [48] 8.2% update-leader! [79] 2.1% reduce-to-single! [60] 0.3% ------------------------------------------------------------------------------- loop [168] 0.5% for-loop [24] 0.5% ??? [5] 0.6% for-loop [170] 0.6% parse-loop79 [164] 0.9% taylor-invert [13] 1.2% for-loop [23] 3.4% hash-ref! [221] 90.1% [37] 115846(17.3%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f101 [156] 58.8% parse-loop79 [164] 35.9% debug-print [55] 2.0% simplify* [175] 1.4% debug7 [56] 1.1% simplify-node [51] 0.6% ??? [57] 0.3% ------------------------------------------------------------------------------- for-loop [38] 49.2% one-iter [21] 50.8% [38] 109152(16.3%) 24986(3.7%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [38] 49.2% match-e [48] 38.6% ------------------------------------------------------------------------------- ??? [5] 38.3% for-loop [23] 61.7% [39] 106338(15.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [221] 100.0% ------------------------------------------------------------------------------- for-loop [26] 100.0% [40] 52520(7.8%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [221] 100.0% ------------------------------------------------------------------------------- pass [27] 100.0% [41] 38478(5.7%) 360(0.1%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [49] 78.5% loop [53] 12.0% for-loop [54] 7.7% make-sequence [133] 0.8% ------------------------------------------------------------------------------- get-final-combination [28] 100.0% [42] 28376(4.2%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f101 [156] 100.0% ------------------------------------------------------------------------------- get-final-combination [28] 100.0% [43] 660(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 loop [59] 100.0% ------------------------------------------------------------------------------- setup-alt-simplified [33] 100.0% [44] 624(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [220] 100.0% ------------------------------------------------------------------------------- run-iter! [35] 100.0% [45] 363796(54.2%) 310(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [61] 99.9% ------------------------------------------------------------------------------- for-loop [36] 100.0% [46] 251302(37.4%) 1008(0.2%) for-loop ...t-testing/src/core/simplify.rkt:148:10 mk-enode! [77] 29.8% merge-egraph-nodes! [63] 26.1% loop! [173] 23.5% substitute-e [65] 17.1% list-member? [67] 3.0% ------------------------------------------------------------------------------- run-iter! [35] 100.0% [47] 118110(17.6%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [62] 100.0% ------------------------------------------------------------------------------- for-loop [36] 13.7% for-loop [78] 24.3% for-loop [38] 62.0% [48] 107156(16.0%) 39984(6.0%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [64] 46.1% ??? [119] 8.1% for-loop [78] 7.7% variable? [80] 3.4% list-cartesian-product [82] 1.2% filter [250] 0.5% loop [168] 0.5% custom-in-set [148] 0.2% ------------------------------------------------------------------------------- for-loop [41] 100.0% [49] 30210(4.5%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [66] 90.0% expression-cost [68] 10.0% ------------------------------------------------------------------------------- run-iter! [35] 100.0% [50] 21202(3.2%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [119] 100.0% ------------------------------------------------------------------------------- parse-loop79 [164] 3.1% simplify [37] 6.4% map [159] 90.5% [51] 10054(1.5%) 980(0.1%) simplify-node ...-testing/src/core/reduce.rkt:50:0 append-map [160] 32.6% f101 [156] 29.2% combine-aterms [69] 28.5% ------------------------------------------------------------------------------- run-iter! [35] 100.0% [52] 4768(0.7%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [119] 100.0% ------------------------------------------------------------------------------- for-loop [41] 100.0% [53] 4626(0.7%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [66] 78.3% expression-cost [68] 21.7% ------------------------------------------------------------------------------- for-loop [41] 100.0% [54] 2970(0.4%) 2970(0.4%) for-loop ...t-testing/src/core/simplify.rkt:217:13 ------------------------------------------------------------------------------- taylor [17] 12.9% simplify [37] 87.1% [55] 2598(0.4%) 334(0.0%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 for-loop [70] 87.1% ------------------------------------------------------------------------------- taylor [17] 12.6% for-loop [142] 12.7% iterate-egraph!13 [3] 23.5% simplify [37] 51.2% [56] 2558(0.4%) 962(0.1%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 ??? [233] 25.7% ??? [119] 24.6% return/no-unsupplied [234] 12.0% ------------------------------------------------------------------------------- simplify [37] 13.7% map [159] 41.3% parse-loop79 [164] 45.0% [57] 2290(0.3%) 636(0.1%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 for-loop [72] 57.0% pattern-match [90] 15.2% ------------------------------------------------------------------------------- run-iter! [35] 100.0% [58] 2244(0.3%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 for-loop [71] 100.0% ------------------------------------------------------------------------------- extract-alt [43] 39.8% best-alt [228] 60.2% [59] 1660(0.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [246] 81.1% errors-score [74] 18.9% ------------------------------------------------------------------------------- for-loop [36] 100.0% [60] 984(0.1%) 304(0.0%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 make-sequence [133] 36.4% for-loop [73] 32.7% ------------------------------------------------------------------------------- simplify! [45] 97.9% [61] 371126(55.3%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [75] 100.0% ------------------------------------------------------------------------------- gen-series! [47] 100.0% [62] 118110(17.6%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [76] 100.0% ------------------------------------------------------------------------------- for-loop [84] 3.5% merge-egraph-nodes! [63] 4.6% for-loop [46] 91.9% [63] 65650(9.8%) 2408(0.4%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [79] 48.3% loop! [173] 17.5% for-loop [81] 14.9% for-loop [84] 4.9% enode-merge! [86] 4.7% merge-egraph-nodes! [63] 4.6% for-loop [117] 1.0% make-sequence [133] 0.5% ------------------------------------------------------------------------------- match-e [48] 100.0% [64] 62968(9.4%) 20562(3.1%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [78] 55.4% list-cartesian-product [82] 9.9% loop [168] 5.4% filter [250] 1.0% foldl [179] 0.5% ------------------------------------------------------------------------------- substitute-e [65] 7.5% for-loop [46] 92.5% [65] 43054(6.4%) 1384(0.2%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [77] 85.6% substitute-e [65] 7.5% ??? [119] 3.6% variable? [80] 1.1% ------------------------------------------------------------------------------- loop [53] 11.8% argmin [49] 88.2% [66] 30822(4.6%) 1362(0.2%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [220] 67.9% ...sting/src/common.rkt:47:2 [122] 27.6% ------------------------------------------------------------------------------- for-loop [46] 100.0% [67] 7572(1.1%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [83] 86.8% member [89] 13.2% ------------------------------------------------------------------------------- loop [53] 25.0% argmin [49] 75.0% [68] 4014(0.6%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [85] 100.0% ------------------------------------------------------------------------------- simplify-node [51] 100.0% [69] 2862(0.4%) 904(0.1%) combine-aterms ...esting/src/core/reduce.rkt:183:0 for-loop [88] 68.4% ------------------------------------------------------------------------------- debug-print [55] 100.0% [70] 2264(0.3%) 2264(0.3%) for-loop ...herbie/alt-testing/src/debug.rkt:113:2 ------------------------------------------------------------------------------- gen-rewrites! [58] 100.0% [71] 2244(0.3%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:138:11 ??? [87] 100.0% ------------------------------------------------------------------------------- ??? [57] 100.0% [72] 1306(0.2%) 996(0.1%) for-loop ...e/alt-testing/src/core/reduce.rkt:62:7 pattern-match [90] 23.7% ------------------------------------------------------------------------------- reduce-to-single! [60] 100.0% [73] 322(0.0%) 322(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 ------------------------------------------------------------------------------- loop [59] 100.0% [74] 314(0.0%) 0(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 loop [168] 100.0% ------------------------------------------------------------------------------- for-loop [61] 19.4% run [19] 35.0% [75] 665240(99.1%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 34.9% run-improve50 [2] 31.8% ??? [220] 29.7% loop [94] 2.0% prepare-points [95] 1.5% ------------------------------------------------------------------------------- for-loop [62] 100.0% [76] 118110(17.6%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [91] 100.0% ------------------------------------------------------------------------------- mk-egraph [237] 0.3% mk-enode-rec! [253] 1.5% substitute-e [65] 32.4% for-loop [46] 65.8% [77] 113728(16.9%) 11482(1.7%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [92] 86.4% hash-has-key? [127] 2.6% ------------------------------------------------------------------------------- match-e [48] 26.1% for-loop [64] 73.9% [78] 50808(7.6%) 3024(0.5%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [48] 92.5% ??? [99] 2.6% ------------------------------------------------------------------------------- for-loop [36] 15.0% merge-egraph-nodes! [63] 85.0% [79] 39178(5.8%) 3346(0.5%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [93] 85.5% custom-set-union! [100] 2.5% make-sequence [133] 0.9% update-en-expr [184] 0.8% hash-ref! [221] 0.8% ------------------------------------------------------------------------------- expression->type [213] 2.7% substitute-e [65] 9.2% free-variables [212] 11.4% match-e [48] 76.6% [80] 11184(1.7%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [119] 100.0% ------------------------------------------------------------------------------- merge-egraph-nodes! [63] 100.0% [81] 10142(1.5%) 8156(1.2%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [184] 19.6% ------------------------------------------------------------------------------- match-e [48] 10.3% list-cartesian-product [82] 19.3% for-loop [64] 70.4% [82] 9224(1.4%) 7236(1.1%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [82] 19.3% for-loop [98] 16.3% ------------------------------------------------------------------------------- list-member? [67] 100.0% [83] 6576(1.0%) 6576(1.0%) loop (unknown source) ------------------------------------------------------------------------------- merge-egraph-nodes! [63] 100.0% [84] 5626(0.8%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [63] 83.0% loop! [173] 17.0% ------------------------------------------------------------------------------- expression-cost [68] 100.0% [85] 4014(0.6%) 360(0.1%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [221] 91.0% ------------------------------------------------------------------------------- merge-egraph-nodes! [63] 100.0% [86] 3306(0.5%) 344(0.1%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [96] 69.0% custom-set-intersect! [101] 20.6% ------------------------------------------------------------------------------- for-loop [71] 100.0% [87] 2244(0.3%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [97] 100.0% ------------------------------------------------------------------------------- combine-aterms [69] 100.0% [88] 1958(0.3%) 640(0.1%) for-loop .../alt-testing/src/core/reduce.rkt:185:4 hash-ref! [221] 67.3% ------------------------------------------------------------------------------- list-member? [67] 100.0% [89] 996(0.1%) 996(0.1%) member (unknown source) ------------------------------------------------------------------------------- for-loop [102] 23.6% for-loop [72] 23.6% ??? [57] 52.9% [90] 658(0.1%) 658(0.1%) pattern-match ...testing/src/core/matcher.rkt:48:0 for-loop [102] 23.6% ------------------------------------------------------------------------------- taylor-alt [76] 100.0% [91] 118110(17.6%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [217] 100.0% ------------------------------------------------------------------------------- mk-enode! [77] 100.0% [92] 98284(14.6%) 694(0.1%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [103] 98.3% set [183] 0.3% ------------------------------------------------------------------------------- update-leader! [79] 100.0% [93] 33506(5.0%) 312(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [104] 99.1% ------------------------------------------------------------------------------- run-improve50 [2] 4.9% ??? [75] 95.1% [94] 27692(4.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 loop [105] 43.2% make-exacts* [114] 32.1% loop [115] 22.3% for-loop [108] 2.4% ------------------------------------------------------------------------------- run-improve50 [2] 1.9% ??? [75] 98.1% [95] 20406(3.0%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [105] 43.4% make-exacts* [114] 29.2% loop [115] 25.6% for-loop [108] 1.8% ------------------------------------------------------------------------------- enode-merge! [86] 100.0% [96] 2282(0.3%) 996(0.1%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [182] 56.4% ------------------------------------------------------------------------------- ??? [87] 46.8% matcher [116] 53.2% [97] 2244(0.3%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [106] 69.3% *rules* [107] 16.0% expression->type [213] 7.4% f101 [156] 7.3% ------------------------------------------------------------------------------- list-cartesian-product [82] 100.0% [98] 1988(0.3%) 1988(0.3%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------- for-loop [78] 100.0% [99] 1338(0.2%) 680(0.1%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [109] 49.2% ------------------------------------------------------------------------------- update-leader! [79] 100.0% [100] 986(0.1%) 336(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [110] 65.9% ------------------------------------------------------------------------------- enode-merge! [86] 100.0% [101] 680(0.1%) 322(0.0%) custom-set-intersect! ...ivate/set-types.rkt:269:0 for-loop [111] 52.6% ------------------------------------------------------------------------------- pattern-match [90] 100.0% [102] 310(0.0%) 0(0.0%) for-loop .../alt-testing/src/core/matcher.rkt:66:9 pattern-match [90] 100.0% ------------------------------------------------------------------------------- new-enode [92] 100.0% [103] 96624(14.4%) 1006(0.1%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [112] 99.0% ------------------------------------------------------------------------------- for-loop [93] 100.0% [104] 33194(4.9%) 0(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [113] 100.0% ------------------------------------------------------------------------------- prepare-points [95] 42.6% loop [94] 57.4% [105] 20810(3.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [114] 62.5% loop [115] 37.5% ------------------------------------------------------------------------------- rewriter [97] 100.0% [106] 2244(0.3%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [116] 100.0% ------------------------------------------------------------------------------- rewriter [97] 100.0% [107] 1224(0.2%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [117] 100.0% ------------------------------------------------------------------------------- prepare-points [95] 35.3% loop [94] 64.7% [108] 1014(0.2%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [118] 100.0% ------------------------------------------------------------------------------- ??? [99] 100.0% [109] 658(0.1%) 324(0.0%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ??? [119] 50.8% ------------------------------------------------------------------------------- custom-set-union! [100] 100.0% [110] 650(0.1%) 650(0.1%) for-loop ...cts/racket/private/set-types.rkt:253:4 ------------------------------------------------------------------------------- custom-set-intersect! [101] 100.0% [111] 358(0.1%) 358(0.1%) for-loop ...cts/racket/private/set-types.rkt:282:4 ------------------------------------------------------------------------------- type-of-enode-expr [103] 100.0% [112] 95618(14.2%) 1994(0.3%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [220] 36.3% ??? [120] 35.2% ??? [119] 14.2% ...sting/src/common.rkt:47:2 [122] 12.2% ------------------------------------------------------------------------------- for-loop [104] 100.0% [113] 33194(4.9%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [121] 100.0% ------------------------------------------------------------------------------- prepare-points [95] 21.4% loop [94] 31.9% loop [105] 46.7% [114] 27868(4.2%) 316(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [168] 77.2% eval-prog [153] 21.7% ------------------------------------------------------------------------------- prepare-points [95] 27.2% loop [94] 32.2% loop [105] 40.6% [115] 19216(2.9%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [168] 98.4% ??? [215] 1.6% ------------------------------------------------------------------------------- for-loop [124] 9.6% matcher [116] 32.4% for-loop [106] 58.0% [116] 2244(0.3%) 360(0.1%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [97] 42.0% matcher [116] 32.4% for-loop [124] 9.6% ------------------------------------------------------------------------------- merge-egraph-nodes! [63] 35.5% *rules* [107] 64.5% [117] 1898(0.3%) 1580(0.2%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 loop [125] 16.8% ------------------------------------------------------------------------------- for-loop [108] 100.0% [118] 1014(0.2%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 for-loop [123] 100.0% ------------------------------------------------------------------------------- simplify* [175] 0.4% f101 [156] 0.4% for-loop [109] 0.4% debug7 [56] 0.8% expression->type [213] 0.8% ??? [245] 2.5% free-variables [212] 2.5% substitute-e [65] 4.9% choose-best-alt! [52] 6.1% variable? [80] 14.3% get-sigs [112] 17.4% match-e [48] 22.2% finalize-iter! [50] 27.2% [119] 78026(11.6%) 28554(4.3%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [127] 29.3% for-loop [128] 26.8% atab-pick-alt8 [132] 6.1% ??? [245] 0.4% ------------------------------------------------------------------------------- ??? [217] 1.1% f101 [156] 1.8% get-sigs [112] 97.1% [120] 34694(5.2%) 0(0.0%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [129] 53.4% for-loop [130] 36.8% get/build-late-neg-projection [155] 8.6% ------------------------------------------------------------------------------- hash-update! [113] 100.0% [121] 33194(4.9%) 1352(0.2%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [126] 93.9% make-sequence [133] 2.0% ------------------------------------------------------------------------------- f101 [156] 1.4% ??? [217] 3.0% for-loop [66] 40.4% get-sigs [112] 55.2% [122] 21100(3.1%) 6304(0.9%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [131] 35.6% ??? [151] 34.6% ------------------------------------------------------------------------------- ??? [118] 100.0% [123] 1014(0.2%) 358(0.1%) for-loop ...erbie/alt-testing/src/points.rkt:231:9 ??? [217] 64.7% ------------------------------------------------------------------------------- matcher [116] 100.0% [124] 624(0.1%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [116] 100.0% ------------------------------------------------------------------------------- for-loop [117] 100.0% [125] 318(0.0%) 0(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [134] 100.0% ------------------------------------------------------------------------------- ??? [121] 100.0% [126] 31178(4.6%) 26474(3.9%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [184] 15.1% ------------------------------------------------------------------------------- mk-enode! [77] 11.5% ??? [119] 88.5% [127] 25856(3.9%) 9920(1.5%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [231] 56.3% ??? [238] 5.3% ------------------------------------------------------------------------------- ??? [119] 100.0% [128] 20900(3.1%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:52:2 atab-add-altn [136] 100.0% ------------------------------------------------------------------------------- ??? [120] 100.0% [129] 18542(2.8%) 2316(0.3%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [137] 87.5% ------------------------------------------------------------------------------- for-loop [244] 23.4% ??? [120] 76.6% [130] 16680(2.5%) 2282(0.3%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [135] 84.5% ??? [227] 1.9% ------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [122] 100.0% [131] 7504(1.1%) 3354(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [233] 34.4% assoc-ref [139] 16.9% return/no-unsupplied [234] 4.0% ------------------------------------------------------------------------------- ??? [119] 100.0% [132] 4768(0.7%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:61:0 point-best-alt [138] 58.5% ??? [217] 27.2% for-loop [140] 7.5% for-loop [142] 6.8% ------------------------------------------------------------------------------- for-loop [41] 15.5% merge-egraph-nodes! [63] 16.8% update-leader! [79] 17.1% reduce-to-single! [60] 17.8% ??? [121] 32.9% [133] 2016(0.3%) 1658(0.2%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [141] 17.8% ------------------------------------------------------------------------------- loop [125] 100.0% [134] 318(0.0%) 318(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ------------------------------------------------------------------------------- ...higher-order.rkt:342:33 [240] 1.3% ??? [231] 2.7% ??? [220] 3.9% ...higher-order.rkt:346:33 [229] 4.2% ??? [151] 29.1% for-loop [130] 58.9% [135] 23928(3.6%) 4174(0.6%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [145] 56.3% ??? [151] 16.8% for-loop [147] 5.3% ??? [245] 2.8% ??? [227] 1.3% ------------------------------------------------------------------------------- for-loop [128] 98.6% [136] 21202(3.2%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:243:0 best-and-tied-at-points [143] 91.1% override-at-pnts [146] 7.4% loop [168] 1.5% ------------------------------------------------------------------------------- ??? [129] 100.0% [137] 16226(2.4%) 1360(0.2%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [144] 91.6% ------------------------------------------------------------------------------- atab-pick-alt8 [132] 100.0% [138] 2790(0.4%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:55:0 loop [168] 100.0% ------------------------------------------------------------------------------- ??? [131] 100.0% [139] 1266(0.2%) 1266(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------- atab-pick-alt8 [132] 100.0% [140] 358(0.1%) 358(0.1%) for-loop ...lt-testing/src/core/alt-table.rkt:81:2 ------------------------------------------------------------------------------- make-sequence [133] 100.0% [141] 358(0.1%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [148] 100.0% ------------------------------------------------------------------------------- atab-pick-alt8 [132] 100.0% [142] 324(0.0%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:88:2 debug7 [56] 100.0% ------------------------------------------------------------------------------- atab-add-altn [136] 100.0% [143] 19312(2.9%) 914(0.1%) best-and-tied-at-points ...ore/alt-table.rkt:157:0 errors [149] 93.7% ------------------------------------------------------------------------------- ??? [137] 100.0% [144] 14866(2.2%) 656(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [150] 95.6% ------------------------------------------------------------------------------- ??? [135] 100.0% [145] 13466(2.0%) 1690(0.3%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [245] 82.7% ??? [227] 4.8% ------------------------------------------------------------------------------- atab-add-altn [136] 100.0% [146] 1566(0.2%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:180:0 errors [149] 100.0% ------------------------------------------------------------------------------- ??? [135] 100.0% [147] 1278(0.2%) 978(0.1%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [151] 23.5% ------------------------------------------------------------------------------- ??? [141] 49.9% match-e [48] 50.1% [148] 718(0.1%) 718(0.1%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------- override-at-pnts [146] 4.3% composed [246] 4.5% option-on-expr [174] 10.9% loop [168] 30.1% best-and-tied-at-points [143] 50.1% [149] 36134(5.4%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [152] 87.2% eval-prog [153] 12.8% ------------------------------------------------------------------------------- ??? [144] 100.0% [150] 14210(2.1%) 4120(0.6%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [154] 56.6% get/build-late-neg-projection [155] 14.4% ------------------------------------------------------------------------------- for-loop [147] 2.1% ??? [135] 27.5% ...sting/src/common.rkt:47:2 [122] 70.4% [151] 7292(1.1%) 2630(0.4%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [135] 65.7% ??? [245] 13.9% ------------------------------------------------------------------------------- errors [149] 100.0% [152] 31526(4.7%) 1940(0.3%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [215] 82.0% ulp-difference [178] 6.6% ??? [217] 5.2% ------------------------------------------------------------------------------- sort-context-on-expr [185] 2.6% point->alt [200] 5.8% errors [149] 39.6% make-exacts* [114] 51.9% [153] 11628(1.7%) 2396(0.4%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 hash-ref! [221] 45.4% f101 [156] 34.0% ------------------------------------------------------------------------------- for-loop [150] 100.0% [154] 8040(1.2%) 8040(1.2%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------------- ??? [158] 19.9% ??? [120] 39.5% for-loop [150] 40.6% [155] 5050(0.8%) 2316(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [157] 43.8% ??? [158] 27.0% ------------------------------------------------------------------------------- for-loop [171] 0.0% mterm->expr [209] 0.1% rewriter [97] 0.3% for-loop [216] 0.3% simplify-node [51] 0.4% approximate9 [4] 0.4% hash-ref! [221] 0.6% composed [246] 0.9% eval-prog [153] 1.1% eval-const-expr [189] 1.4% loop [168] 2.9% append-map [160] 3.4% f101 [156] 6.5% parse-loop79 [164] 9.6% simplify [37] 19.5% split-table [42] 23.4% map [159] 28.9% [156] 115870(17.3%) 17394(2.6%) f101 .../collects/racket/match/compiler.rkt:507:40 map [159] 52.9% loop [168] 21.3% f101 [156] 6.5% append-map [160] 4.5% option-on-expr [174] 2.1% composed [246] 0.9% ??? [217] 0.9% ??? [162] 0.9% ??? [220] 0.7% parse-app [169] 0.6% compose [190] 0.6% gather-multiplicative-terms [165] 0.5% taylor-invert [13] 0.4% combine-mterms [15] 0.4% taylor [17] 0.3% ...sting/src/common.rkt:47:2 [122] 0.3% ??? [120] 0.2% loop [163] 0.2% parse-loop79 [164] 0.2% ??? [119] 0.1% ------------------------------------------------------------------------------- get/build-late-neg-projection [155] 100.0% [157] 2376(0.4%) 326(0.0%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [161] 86.3% ------------------------------------------------------------------------------- get/build-late-neg-projection [155] 100.0% [158] 2370(0.4%) 358(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [155] 84.9% ------------------------------------------------------------------------------- option-on-expr [174] 0.4% gather-multiplicative-terms [165] 0.8% parse-loop79 [164] 5.6% f101 [156] 93.2% [159] 79160(11.8%) 1268(0.2%) map ...acket/collects/racket/private/map.rkt:20:13 f101 [156] 56.0% parse-loop79 [164] 32.2% simplify-node [51] 4.1% simplify* [175] 3.5% loop [168] 1.6% gather-multiplicative-terms [165] 0.6% make-multiplication-node [177] 0.6% ??? [57] 0.5% ------------------------------------------------------------------------------- parse-loop79 [164] 0.2% append-map [160] 3.7% simplify-node [51] 14.5% f101 [156] 81.5% [160] 14744(2.2%) 4238(0.6%) append-map ...acket/collects/racket/list.rkt:565:2 f101 [156] 56.5% parse-loop79 [164] 16.0% free-variables [212] 9.6% append-map [160] 3.7% loop [167] 2.3% loop [168] 0.2% ------------------------------------------------------------------------------- ??? [157] 100.0% [161] 2050(0.3%) 972(0.1%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [166] 52.6% ------------------------------------------------------------------------------- f101 [156] 100.0% [162] 998(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:336:46 ??? [245] 100.0% ------------------------------------------------------------------------------- f101 [156] 100.0% [163] 978(0.1%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 expression->type [213] 100.0% ------------------------------------------------------------------------------- composed [246] 0.4% hash-ref! [221] 0.9% f101 [156] 1.5% loop [168] 3.9% for-loop [30] 4.1% append-map [160] 4.1% simplify [37] 21.2% parse-loop79 [164] 30.2% map [159] 33.9% [164] 80434(12.0%) 50432(7.5%) parse-loop79 ...s/racket/match/compiler.rkt:418:15 parse-loop79 [164] 30.2% f101 [156] 11.7% loop [168] 10.8% map [159] 5.9% for-loop [170] 2.8% parse-app [169] 1.9% make-multiplication-node [177] 1.8% for-loop [171] 1.4% simplify [37] 1.2% simplify* [175] 0.8% ??? [57] 0.4% append-map [160] 0.4% loop [172] 0.4% make-keyword-procedure [262] 0.2% simplify-node [51] 0.1% ------------------------------------------------------------------------------- map [159] 18.1% f101 [156] 81.9% [165] 2932(0.4%) 1976(0.3%) gather-multiplicative-terms ...re/reduce.rkt:116:0 map [159] 39.8% compose [190] 10.9% ------------------------------------------------------------------------------- build-compound-type-name [161] 100.0% [166] 1078(0.2%) 1078(0.2%) contract-struct-name ...ract/private/prop.rkt:89:0 ------------------------------------------------------------------------------- append-map [160] 100.0% [167] 682(0.1%) 682(0.1%) loop ...are/racket/collects/racket/list.rkt:414:34 ------------------------------------------------------------------------------- errors-score [74] 0.0% atab-add-altn [136] 0.1% append-map [160] 0.2% loop [115] 0.4% match-e [48] 0.4% make-exacts* [114] 0.4% taylor [17] 0.6% ??? [215] 0.8% map-enodes [29] 0.8% point-best-alt [138] 1.2% map [159] 1.2% ??? [235] 1.7% for-loop [64] 1.8% option-on-expr [174] 2.0% loop! [173] 5.5% f101 [156] 9.2% parse-loop79 [164] 11.5% loop [168] 62.1% [168] 150048(22.4%) 6298(0.9%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [168] 62.1% option-on-expr [174] 9.2% parse-loop79 [164] 6.8% f101 [156] 5.1% loop! [173] 4.8% errors [149] 3.2% hash-ref! [221] 1.6% for-loop [176] 0.8% ??? [215] 0.8% ??? [217] 0.7% foldl [179] 0.6% curried [214] 0.5% simplify [37] 0.4% simplify* [175] 0.3% make-multiplication-node [177] 0.2% loop [181] 0.1% ??? [219] 0.0% ??? [16] 0.0% ------------------------------------------------------------------------------- f101 [156] 25.8% parse-loop79 [164] 67.7% [169] 4964(0.7%) 4640(0.7%) parse-app .../collects/racket/private/kw.rkt:951:2 loop [180] 6.5% ------------------------------------------------------------------------------- parse-loop79 [164] 100.0% [170] 2284(0.3%) 360(0.1%) for-loop ...alt-testing/src/core/taylor.rkt:490:59 hash-ref! [221] 53.9% simplify [37] 30.3% ------------------------------------------------------------------------------- parse-loop79 [164] 100.0% [171] 1964(0.3%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:99:13 make-multiplication-node [177] 68.2% f101 [156] 31.8% ------------------------------------------------------------------------------- parse-loop79 [164] 3.4% loop [172] 96.6% [172] 688(0.1%) 368(0.1%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [172] 96.6% ulp-difference [178] 2.6% ------------------------------------------------------------------------------- for-loop [84] 0.9% merge-egraph-nodes! [63] 13.1% loop [168] 27.2% for-loop [46] 58.9% [173] 74616(11.1%) 13732(2.0%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [182] 39.0% loop [168] 31.7% set [183] 13.9% update-en-expr [184] 4.5% ------------------------------------------------------------------------------- f101 [156] 10.5% loop [168] 89.5% [174] 28376(4.2%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [185] 39.8% loop [168] 35.4% errors [149] 13.9% err-lsts->split-indices [191] 4.9% pick-errors [192] 4.8% map [159] 1.2% ------------------------------------------------------------------------------- loop [168] 5.7% parse-loop79 [164] 10.8% simplify [37] 13.6% map [159] 69.9% [175] 12002(1.8%) 6884(1.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 ??? [187] 24.4% return/no-unsupplied [234] 10.7% hash-ref! [221] 5.2% ??? [119] 2.3% ------------------------------------------------------------------------------- map-enodes [29] 13.6% loop [168] 86.4% [176] 6852(1.0%) 2576(0.4%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [188] 29.6% eval-const-expr [189] 23.2% curried [214] 4.9% compose [190] 4.7% ------------------------------------------------------------------------------- loop [168] 6.7% for-loop [171] 27.0% map [159] 32.7% parse-loop79 [164] 33.5% [177] 4958(0.7%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [186] 100.0% ------------------------------------------------------------------------------- loop [172] 13.2% for-loop [152] 86.8% [178] 2416(0.4%) 1054(0.2%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [234] 42.5% ??? [233] 13.9% ------------------------------------------------------------------------------- for-loop [64] 20.0% loop [168] 80.0% [179] 1718(0.3%) 1060(0.2%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [193] 38.3% ------------------------------------------------------------------------------- loop [180] 50.0% parse-app [169] 50.0% [180] 324(0.0%) 324(0.0%) loop .../collects/racket/private/stxcase.rkt:112:7 loop [180] 50.0% ------------------------------------------------------------------------------- loop [168] 0.7% loop [181] 99.3% [181] 324(0.0%) 324(0.0%) loop ...ket/collects/racket/private/list.rkt:82:16 loop [181] 99.3% ------------------------------------------------------------------------------- adopt-enode! [96] 4.1% loop! [173] 95.9% [182] 31734(4.7%) 8940(1.3%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [194] 62.5% for-loop [197] 9.4% ------------------------------------------------------------------------------- new-enode [92] 1.5% loop! [173] 98.5% [183] 20422(3.0%) 20422(3.0%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------- update-leader! [79] 2.4% for-loop [81] 14.5% for-loop [126] 34.4% loop! [173] 48.7% [184] 13674(2.0%) 13674(2.0%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------------- option-on-expr [174] 100.0% [185] 11306(1.7%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [195] 97.3% eval-prog [153] 2.7% ------------------------------------------------------------------------------- make-multiplication-node [177] 100.0% [186] 4958(0.7%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [196] 78.8% group-by68 [198] 21.2% ------------------------------------------------------------------------------- simplify* [175] 100.0% [187] 2932(0.4%) 694(0.1%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [248] 65.3% ??? [245] 11.1% ------------------------------------------------------------------------------- for-loop [176] 100.0% [188] 2028(0.3%) 1704(0.3%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 for-loop [202] 16.0% ------------------------------------------------------------------------------- for-loop [176] 100.0% [189] 1590(0.2%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f101 [156] 100.0% ------------------------------------------------------------------------------- gather-multiplicative-terms [165] 20.4% for-loop [176] 20.7% f101 [156] 58.9% [190] 1568(0.2%) 1568(0.2%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------------- option-on-expr [174] 100.0% [191] 1390(0.2%) 352(0.1%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [199] 74.7% ------------------------------------------------------------------------------- option-on-expr [174] 100.0% [192] 1348(0.2%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 point->alt [200] 50.3% for-loop [201] 49.7% ------------------------------------------------------------------------------- foldl [179] 100.0% [193] 658(0.1%) 658(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------- custom-set-union [182] 100.0% [194] 19826(3.0%) 5424(0.8%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [203] 72.6% ------------------------------------------------------------------------------- sort-context-on-expr [185] 100.0% [195] 11004(1.6%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [204] 84.9% loop [211] 15.1% ------------------------------------------------------------------------------- make-multiplication-subnode [186] 100.0% [196] 3906(0.6%) 618(0.1%) for-loop .../alt-testing/src/core/reduce.rkt:242:3 make-multiplication-subsubsubnode [205] 59.0% mterm->expr [209] 25.1% ------------------------------------------------------------------------------- custom-set-union [182] 100.0% [197] 2968(0.4%) 2968(0.4%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------- make-multiplication-subnode [186] 100.0% [198] 1052(0.2%) 692(0.1%) group-by68 ...acket/collects/racket/list.rkt:749:0 hash-update [207] 34.2% ------------------------------------------------------------------------------- err-lsts->split-indices [191] 100.0% [199] 1038(0.2%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [206] 100.0% ------------------------------------------------------------------------------- pick-errors [192] 100.0% [200] 678(0.1%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [153] 100.0% ------------------------------------------------------------------------------- pick-errors [192] 100.0% [201] 670(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [16] 100.0% ------------------------------------------------------------------------------- setfindf [188] 100.0% [202] 324(0.0%) 324(0.0%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 ------------------------------------------------------------------------------- for-loop [194] 100.0% [203] 14402(2.1%) 14402(2.1%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------- ??? [195] 100.0% [204] 9344(1.4%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [208] 89.2% loop [211] 10.8% ------------------------------------------------------------------------------- make-multiplication-subsubsubnode [205] 21.9% for-loop [196] 78.1% [205] 2306(0.3%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [209] 78.1% make-multiplication-subsubsubnode [205] 21.9% ------------------------------------------------------------------------------- add-splitpoint [199] 100.0% [206] 1038(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [210] 100.0% ------------------------------------------------------------------------------- group-by68 [198] 100.0% [207] 360(0.1%) 360(0.1%) hash-update ...cket/private/more-scheme.rkt:356:13 ------------------------------------------------------------------------------- generic-sort/key [204] 41.5% copying-mergesort [208] 58.5% [208] 8338(1.2%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [208] 58.5% loop [211] 27.5% jloop [12] 13.9% ------------------------------------------------------------------------------- for-loop [196] 29.9% make-multiplication-subsubsubnode [205] 70.1% [209] 3288(0.5%) 992(0.1%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 expression->type [213] 28.7% free-variables [212] 19.7% return/no-unsupplied [234] 11.3% f101 [156] 10.2% ------------------------------------------------------------------------------- for-loop [206] 100.0% [210] 1038(0.2%) 720(0.1%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [214] 30.6% ------------------------------------------------------------------------------- generic-sort/key [204] 15.8% ??? [195] 26.1% copying-mergesort [208] 58.0% [211] 6352(0.9%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [215] 94.7% ??? [217] 5.3% ------------------------------------------------------------------------------- mterm->expr [209] 15.2% append-map [160] 84.8% [212] 4256(0.6%) 994(0.1%) free-variables ...t-testing/src/programs.rkt:102:0 ??? [119] 46.6% variable? [80] 30.1% ------------------------------------------------------------------------------- rewriter [97] 4.9% loop [163] 12.0% for-loop [216] 41.2% mterm->expr [209] 41.8% [213] 2256(0.3%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [216] 58.2% ??? [119] 28.4% variable? [80] 13.5% ------------------------------------------------------------------------------- for-loop [210] 19.6% for-loop [176] 20.6% loop [168] 59.8% [214] 1622(0.2%) 1622(0.2%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------- loop [115] 0.4% ??? [16] 2.1% jloop [12] 6.0% loop [211] 7.8% for-loop [152] 33.4% loop [168] 50.3% [215] 77442(11.5%) 724(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [218] 72.3% ??? [219] 11.6% ??? [217] 10.7% loop [168] 4.5% ------------------------------------------------------------------------------- expression->type [213] 100.0% [216] 1312(0.2%) 0(0.0%) for-loop ...ie/alt-testing/src/type-check.rkt:52:5 expression->type [213] 70.9% f101 [156] 29.1% ------------------------------------------------------------------------------- loop [211] 0.2% for-loop [123] 0.5% atab-pick-alt8 [132] 0.8% for-loop [152] 1.2% f101 [156] 2.4% loop [168] 2.5% ??? [215] 5.9% ??? [10] 10.8% loop [22] 17.6% ??? [220] 29.0% for-loop [91] 29.0% [217] 136742(20.4%) 2276(0.3%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [220] 38.7% approximate9 [4] 29.0% hash-ref! [221] 28.3% best-alt [228] 0.8% ??? [245] 0.7% ...sting/src/common.rkt:47:2 [122] 0.5% ??? [120] 0.3% ------------------------------------------------------------------------------- ??? [215] 100.0% [218] 56020(8.3%) 24830(3.7%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [232] 15.3% bf* [223] 12.9% ??? [224] 12.3% for-loop [225] 6.4% ??? [226] 4.6% ...higher-order.rkt:346:33 [229] 1.8% ??? [227] 1.2% ------------------------------------------------------------------------------- loop [168] 16.8% ??? [215] 83.2% [219] 10778(1.6%) 332(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [222] 96.9% ------------------------------------------------------------------------------- simplify-alt [44] 0.1% f101 [156] 0.2% for-loop [66] 1.2% get-sigs [112] 2.0% ??? [220] 6.1% ??? [217] 19.1% for-loop [230] 34.4% ??? [75] 36.6% [220] 575804(85.8%) 21464(3.2%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [230] 34.4% iterate-egraph!13 [3] 34.0% ??? [217] 16.8% ??? [220] 6.1% loop [11] 2.8% ??? [231] 2.4% return/no-unsupplied [234] 0.7% ??? [233] 0.4% mk-egraph [237] 0.1% ??? [135] 0.1% ??? [238] 0.0% ------------------------------------------------------------------------------- for-loop [34] 0.1% for-loop [170] 0.1% simplify* [175] 0.1% ??? [18] 0.1% for-loop [88] 0.1% for-loop [31] 0.2% first-nonzero-exp [32] 0.2% update-leader! [79] 0.3% ??? [5] 0.5% ??? [10] 0.8% ??? [235] 1.4% compile [85] 1.5% loop [168] 1.6% eval-prog [153] 2.6% for-loop [40] 3.6% loop [22] 6.5% for-loop [25] 6.6% for-loop [23] 7.9% ??? [217] 12.2% for-loop [24] 18.5% ??? [39] 34.3% [221] 126456(18.8%) 6922(1.0%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [6] 33.3% ??? [7] 18.6% ??? [5] 10.3% simplify [37] 9.9% ??? [10] 7.3% ??? [8] 6.6% ??? [9] 3.6% ??? [235] 3.3% bigfloat-hash [236] 2.2% f101 [156] 1.9% parse-loop79 [164] 0.5% ??? [14] 0.2% ??? [18] 0.1% ------------------------------------------------------------------------------- ??? [219] 100.0% [222] 10446(1.6%) 7282(1.1%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [257] 30.3% ------------------------------------------------------------------------------- ??? [218] 100.0% [223] 7206(1.1%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [232] 100.0% ------------------------------------------------------------------------------- ??? [218] 100.0% [224] 6900(1.0%) 2586(0.4%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [233] 39.4% return/no-unsupplied [234] 23.1% ------------------------------------------------------------------------------- ??? [218] 100.0% [225] 3560(0.5%) 1528(0.2%) for-loop ...lt-testing/src/syntax/syntax.rkt:531:2 bf< [239] 38.7% ...higher-order.rkt:342:33 [240] 18.4% ------------------------------------------------------------------------------- ??? [218] 100.0% [226] 2588(0.4%) 2588(0.4%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------- for-loop [130] 15.8% ??? [135] 16.5% ??? [145] 33.0% ??? [218] 34.7% [227] 1956(0.3%) 1310(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [241] 16.6% ??? [242] 16.5% ------------------------------------------------------------------------------- ??? [217] 100.0% [228] 1296(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 loop [59] 77.2% argmins [243] 22.8% ------------------------------------------------------------------------------- ??? [218] 100.0% [229] 1010(0.2%) 0(0.0%) ...higher-order.rkt:346:33 (unknown source) ??? [135] 100.0% ------------------------------------------------------------------------------- ??? [220] 100.0% [230] 413294(61.6%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [220] 100.0% ------------------------------------------------------------------------------- hash-has-key? [127] 27.0% ??? [220] 73.0% [231] 53990(8.0%) 22722(3.4%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [244] 46.2% ??? [256] 9.9% ??? [135] 1.2% ------------------------------------------------------------------------------- bf* [223] 45.7% ??? [218] 54.3% [232] 15766(2.3%) 2068(0.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [247] 56.9% bfsqrt [249] 30.0% ------------------------------------------------------------------------------- ulp-difference [178] 3.6% debug7 [56] 7.1% ??? [131] 28.0% ??? [224] 29.4% ??? [220] 31.8% [233] 9244(1.4%) 1970(0.3%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [248] 57.6% ??? [245] 21.1% ------------------------------------------------------------------------------- ??? [131] 3.3% debug7 [56] 3.3% mterm->expr [209] 4.0% ulp-difference [178] 11.1% simplify* [175] 14.0% ??? [224] 17.3% ??? [220] 46.9% [234] 9206(1.4%) 6704(1.0%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [250] 27.2% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [235] 6452(1.0%) 326(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [168] 59.1% hash-ref! [221] 39.2% ------------------------------------------------------------------------------- hash-ref! [221] 100.0% [236] 4598(0.7%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [251] 53.3% sig+exp->bigfloat [252] 46.7% ------------------------------------------------------------------------------- ??? [220] 100.0% [237] 2004(0.3%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [253] 82.5% mk-enode! [77] 17.5% ------------------------------------------------------------------------------- ??? [220] 18.5% hash-has-key? [127] 81.5% [238] 1686(0.3%) 1686(0.3%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------- for-loop [225] 100.0% [239] 1376(0.2%) 344(0.1%) bf< ...th/private/bigfloat/bigfloat-mpfr.rkt:127:4 ??? [254] 75.0% ------------------------------------------------------------------------------- for-loop [225] 100.0% [240] 656(0.1%) 356(0.1%) ...higher-order.rkt:342:33 (unknown source) ??? [135] 45.7% ------------------------------------------------------------------------------- ??? [227] 100.0% [241] 324(0.0%) 0(0.0%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [255] 100.0% ------------------------------------------------------------------------------- ??? [227] 100.0% [242] 322(0.0%) 322(0.0%) ??? ...ects/racket/contract/private/list.rkt:628:0 ------------------------------------------------------------------------------- best-alt [228] 100.0% [243] 296(0.0%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [246] 100.0% ------------------------------------------------------------------------------- ??? [231] 100.0% [244] 24952(3.7%) 13914(2.1%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [256] 26.2% for-loop [130] 15.6% ??? [260] 2.4% ------------------------------------------------------------------------------- ??? [187] 1.8% ??? [119] 1.8% ??? [135] 3.7% ??? [217] 5.1% ??? [162] 5.4% ??? [233] 10.6% ??? [151] 11.0% ??? [145] 60.5% [245] 18382(2.7%) 12810(1.9%) ??? ...ects/racket/contract/private/guts.rkt:644:8 dict? [258] 10.6% ??? [119] 10.6% contract? [259] 9.1% ------------------------------------------------------------------------------- argmins [243] 2.7% loop [59] 12.4% f101 [156] 84.8% [246] 10836(1.6%) 334(0.0%) composed ...ollects/racket/private/list.rkt:321:16 f101 [156] 78.9% errors [149] 15.2% parse-loop79 [164] 2.9% ------------------------------------------------------------------------------- ??? [232] 100.0% [247] 8970(1.3%) 5552(0.8%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [257] 38.1% ------------------------------------------------------------------------------- ??? [187] 26.5% ??? [233] 73.5% [248] 7234(1.1%) 6908(1.0%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [261] 4.5% ------------------------------------------------------------------------------- ??? [232] 100.0% [249] 4728(0.7%) 2820(0.4%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [257] 40.4% ------------------------------------------------------------------------------- for-loop [64] 17.1% match-e [48] 17.3% return/no-unsupplied [234] 65.5% [250] 3818(0.6%) 3818(0.6%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------- bigfloat-hash [236] 100.0% [251] 2450(0.4%) 2450(0.4%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ------------------------------------------------------------------------------- bigfloat-hash [236] 100.0% [252] 2148(0.3%) 2148(0.3%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ------------------------------------------------------------------------------- mk-egraph [237] 47.7% mk-enode-rec! [253] 52.3% [253] 1654(0.2%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [253] 52.3% mk-enode! [77] 47.7% ------------------------------------------------------------------------------- bf< [239] 100.0% [254] 1032(0.2%) 1032(0.2%) ??? ...tract/private/arrow-higher-order.rkt:346:33 ------------------------------------------------------------------------------- ??? [241] 100.0% [255] 324(0.0%) 324(0.0%) ??? ...ects/racket/contract/private/list.rkt:141:5 ------------------------------------------------------------------------------- ??? [231] 44.9% for-loop [244] 55.1% [256] 11866(1.8%) 5758(0.9%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [262] 51.5% ------------------------------------------------------------------------------- bfsqrt [249] 22.5% real->bigfloat [222] 37.3% bfmul [247] 40.3% [257] 8490(1.3%) 8490(1.3%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------- ??? [245] 100.0% [258] 1954(0.3%) 1954(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------- ??? [245] 100.0% [259] 1676(0.2%) 1676(0.2%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------- for-loop [244] 100.0% [260] 606(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [263] 100.0% ------------------------------------------------------------------------------- ??? [248] 100.0% [261] 326(0.0%) 326(0.0%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------- parse-loop79 [164] 5.6% ??? [256] 94.4% [262] 6468(1.0%) 6468(1.0%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------- ??? [260] 100.0% [263] 606(0.1%) 606(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 -------------------------------------------------------------------------------