Profiling results ----------------- Total cpu time observed: 339672ms (out of 341964ms) Number of samples taken: 997 (once every 341ms) (Hiding functions with self<1.0% and local<2.0%: 7 of 253 hidden) ========================================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================= ??? [69] 100.0% [1] 292772(86.2%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [17] 100.0% ----------------------------------------------------------------------------------------- ??? [69] 100.0% [2] 253366(74.6%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [18] 89.6% get-final-combination [21] 9.6% setup-alt-simplified [31] 0.3% loop [86] 0.3% prepare-points [85] 0.3% ----------------------------------------------------------------------------------------- ??? [205] 100.0% [3] 202262(59.5%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [19] 97.7% map-enodes [25] 1.8% debug-print [90] 0.3% debug7 [89] 0.2% ----------------------------------------------------------------------------------------- ??? [205] 100.0% [4] 25244(7.4%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [20] 100.0% ----------------------------------------------------------------------------------------- ??? [204] 100.0% [5] 11212(3.3%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [22] 77.5% f101 [48] 11.3% for-loop [30] 8.5% taylor-exp [32] 2.8% ----------------------------------------------------------------------------------------- generic-sort/key [194] 8.2% copying-mergesort [200] 91.8% [6] 4336(1.3%) 352(0.1%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [150] 76.0% errors-score [34] 8.2% ??? [204] 7.7% ----------------------------------------------------------------------------------------- hash-ref! [206] 100.0% [7] 3842(1.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [24] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [206] 100.0% [8] 2576(0.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [26] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [206] 100.0% [9] 2230(0.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [27] 100.0% ----------------------------------------------------------------------------------------- rewriter [93] 100.0% [10] 1358(0.4%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [78] 100.0% ----------------------------------------------------------------------------------------- for-loop [193] 31.8% loop [152] 68.2% [11] 974(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [150] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [206] 100.0% [12] 952(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:483:23 for-loop [29] 100.0% ----------------------------------------------------------------------------------------- f101 [48] 100.0% [13] 680(0.2%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [28] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [206] 100.0% [14] 632(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 for-loop [33] 100.0% ----------------------------------------------------------------------------------------- map [65] 49.7% f101 [48] 50.3% [15] 608(0.2%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [40] 50.3% first-nonzero-exp [28] 49.7% ----------------------------------------------------------------------------------------- append-map [94] 100.0% [16] 310(0.1%) 0(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 variable? [23] 100.0% ----------------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [17] 292772(86.2%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [69] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [18] 227084(66.9%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [35] 100.0% ----------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [19] 197622(58.2%) 4208(1.2%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [36] 66.5% for-loop [37] 31.1% filter [240] 0.2% ----------------------------------------------------------------------------------------- loop [4] 100.0% [20] 25244(7.4%) 0(0.0%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [38] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [21] 24304(7.2%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [39] 97.4% extract-alt [43] 2.6% ----------------------------------------------------------------------------------------- approximate9 [5] 100.0% [22] 8690(2.6%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 hash-ref! [206] 92.9% ??? [204] 3.7% loop [44] 3.4% ----------------------------------------------------------------------------------------- free-variables [16] 4.6% substitute-e [62] 14.2% match-e [47] 81.2% [23] 6788(2.0%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [99] 100.0% ----------------------------------------------------------------------------------------- ??? [7] 100.0% [24] 3842(1.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [206] 75.7% simplify [40] 24.3% ----------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [25] 3644(1.1%) 322(0.1%) map-enodes ...lt-testing/src/core/egraph.rkt:140:0 loop [152] 74.3% for-loop [161] 16.9% ----------------------------------------------------------------------------------------- ??? [8] 100.0% [26] 2576(0.8%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [41] 100.0% ----------------------------------------------------------------------------------------- ??? [9] 100.0% [27] 2230(0.7%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 hash-ref! [206] 100.0% ----------------------------------------------------------------------------------------- taylor-invert [15] 30.8% taylor-quotient [13] 69.2% [28] 982(0.3%) 358(0.1%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [206] 63.5% ----------------------------------------------------------------------------------------- ??? [12] 100.0% [29] 952(0.3%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:487:35 parse-loop12 [211] 100.0% ----------------------------------------------------------------------------------------- approximate9 [5] 100.0% [30] 950(0.3%) 0(0.0%) for-loop .../alt-testing/src/core/taylor.rkt:29:18 f101 [48] 66.1% taylor [77] 33.9% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [31] 662(0.2%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [42] 100.0% ----------------------------------------------------------------------------------------- approximate9 [5] 47.8% f101 [48] 52.2% [32] 648(0.2%) 0(0.0%) taylor-exp ...lt-testing/src/core/taylor.rkt:386:0 simplify [40] 100.0% ----------------------------------------------------------------------------------------- ??? [14] 100.0% [33] 632(0.2%) 298(0.1%) for-loop ...alt-testing/src/core/taylor.rkt:324:46 simplify [40] 52.8% ----------------------------------------------------------------------------------------- jloop [6] 100.0% [34] 356(0.1%) 0(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 loop [152] 100.0% ----------------------------------------------------------------------------------------- for-loop [18] 100.0% [35] 227084(66.9%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [45] 81.9% finalize-iter! [49] 10.9% gen-series! [51] 4.9% choose-best-alt! [54] 1.1% localize-error [55] 0.6% gen-rewrites! [56] 0.6% ----------------------------------------------------------------------------------------- one-iter [19] 100.0% [36] 131374(38.7%) 972(0.3%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [46] 90.1% match-e [47] 7.9% reduce-to-single! [57] 0.8% update-leader! [72] 0.5% ----------------------------------------------------------------------------------------- for-loop [37] 48.1% one-iter [19] 51.9% [37] 61374(18.1%) 14758(4.3%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [37] 48.1% match-e [47] 38.0% ----------------------------------------------------------------------------------------- pass [20] 100.0% [38] 25244(7.4%) 0(0.0%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [50] 62.9% loop [52] 26.5% for-loop [53] 10.6% ----------------------------------------------------------------------------------------- get-final-combination [21] 100.0% [39] 23684(7.0%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f101 [48] 100.0% ----------------------------------------------------------------------------------------- taylor-invert [15] 4.3% loop [152] 4.5% for-loop [33] 4.7% taylor-exp [32] 9.2% for-loop [24] 13.2% hash-ref! [206] 64.0% [40] 7060(2.1%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f101 [48] 77.5% debug7 [89] 8.9% parse-loop12 [211] 4.6% simplify* [218] 4.6% debug-print [90] 4.6% ----------------------------------------------------------------------------------------- for-loop [26] 100.0% [41] 2576(0.8%) 312(0.1%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [206] 87.9% ----------------------------------------------------------------------------------------- setup-alt-simplified [31] 100.0% [42] 662(0.2%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [205] 100.0% ----------------------------------------------------------------------------------------- get-final-combination [21] 100.0% [43] 620(0.2%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [216] 50.6% loop [58] 49.4% ----------------------------------------------------------------------------------------- loop [22] 100.0% [44] 298(0.1%) 298(0.1%) loop ...rbie/alt-testing/src/core/taylor.rkt:154:2 ----------------------------------------------------------------------------------------- run-iter! [35] 100.0% [45] 185892(54.7%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [59] 100.0% ----------------------------------------------------------------------------------------- for-loop [36] 100.0% [46] 118378(34.9%) 0(0.0%) for-loop ...t-testing/src/core/simplify.rkt:148:10 mk-enode! [70] 35.7% merge-egraph-nodes! [61] 25.9% substitute-e [62] 19.2% loop! [156] 17.0% list-member? [212] 2.2% ----------------------------------------------------------------------------------------- for-loop [36] 11.6% for-loop [71] 23.9% for-loop [37] 64.5% [47] 56964(16.8%) 19576(5.8%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [60] 47.8% ??? [99] 9.4% for-loop [71] 6.7% variable? [23] 4.5% list-cartesian-product [76] 1.5% loop [152] 0.8% ----------------------------------------------------------------------------------------- composed [220] 0.3% append-map [94] 0.8% eval-const-expr [180] 1.0% for-loop [30] 1.2% approximate9 [5] 1.7% eval-prog [188] 1.9% hash-ref! [206] 2.7% f101 [48] 5.8% map [65] 6.2% simplify [40] 8.3% split-table [39] 69.9% [48] 33080(9.7%) 2652(0.8%) f101 .../collects/racket/match/compiler.rkt:507:40 loop [152] 63.9% map [65] 13.3% option-on-expr [157] 6.0% f101 [48] 5.8% loop [68] 1.7% ??? [204] 1.5% append-map [94] 1.0% taylor-quotient [13] 0.7% composed [220] 0.3% taylor-invert [15] 0.2% taylor-exp [32] 0.2% taylor [77] 0.1% ----------------------------------------------------------------------------------------- run-iter! [35] 100.0% [49] 24686(7.3%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [99] 100.0% ----------------------------------------------------------------------------------------- for-loop [38] 100.0% [50] 15878(4.7%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [63] 89.8% expression-cost [66] 10.2% ----------------------------------------------------------------------------------------- run-iter! [35] 100.0% [51] 11212(3.3%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [64] 100.0% ----------------------------------------------------------------------------------------- for-loop [38] 100.0% [52] 6700(2.0%) 340(0.1%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [63] 94.9% ----------------------------------------------------------------------------------------- for-loop [38] 100.0% [53] 2666(0.8%) 2666(0.8%) for-loop ...t-testing/src/core/simplify.rkt:217:13 ----------------------------------------------------------------------------------------- run-iter! [35] 100.0% [54] 2572(0.8%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [99] 100.0% ----------------------------------------------------------------------------------------- run-iter! [35] 100.0% [55] 1364(0.4%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [206] 73.9% ??? [185] 26.1% ----------------------------------------------------------------------------------------- run-iter! [35] 100.0% [56] 1358(0.4%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 for-loop [67] 100.0% ----------------------------------------------------------------------------------------- for-loop [36] 100.0% [57] 996(0.3%) 334(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 make-sequence [178] 66.5% ----------------------------------------------------------------------------------------- extract-alt [43] 100.0% [58] 306(0.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [220] 100.0% ----------------------------------------------------------------------------------------- simplify! [45] 98.3% [59] 189020(55.6%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [69] 99.7% debug7 [89] 0.3% ----------------------------------------------------------------------------------------- match-e [47] 100.0% [60] 36312(10.7%) 13102(3.9%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [71] 58.0% list-cartesian-product [76] 7.4% curry* [82] 1.4% loop [152] 0.9% foldl [167] 0.4% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [61] 3.8% for-loop [74] 6.1% for-loop [46] 90.2% [61] 30668(9.0%) 686(0.2%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [72] 50.1% for-loop [75] 13.8% for-loop [74] 12.9% loop! [156] 11.3% enode-merge! [81] 4.4% merge-egraph-nodes! [61] 3.8% for-loop [78] 1.5% ----------------------------------------------------------------------------------------- substitute-e [62] 9.4% for-loop [46] 90.6% [62] 22678(6.7%) 1944(0.6%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [70] 76.9% substitute-e [62] 9.4% ??? [99] 4.9% variable? [23] 1.6% ----------------------------------------------------------------------------------------- loop [52] 30.8% argmin [50] 69.2% [63] 20622(6.1%) 328(0.1%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [205] 75.2% ...sting/src/common.rkt:47:2 [121] 19.7% ??? [119] 3.5% ----------------------------------------------------------------------------------------- gen-series! [51] 100.0% [64] 11212(3.3%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [73] 100.0% ----------------------------------------------------------------------------------------- ??? [164] 4.8% parse-loop12 [211] 5.0% f101 [48] 90.2% [65] 6834(2.0%) 298(0.1%) map ...acket/collects/racket/private/map.rkt:20:13 f101 [48] 48.7% simplify-node [83] 9.9% simplify* [218] 9.5% taylor [77] 9.3% parse-loop12 [211] 6.1% ??? [204] 4.8% ??? [164] 2.6% loop [223] 2.6% taylor-invert [15] 2.2% ----------------------------------------------------------------------------------------- argmin [50] 100.0% [66] 1616(0.5%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [79] 100.0% ----------------------------------------------------------------------------------------- gen-rewrites! [56] 100.0% [67] 1358(0.4%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:138:11 ??? [80] 100.0% ----------------------------------------------------------------------------------------- f101 [48] 100.0% [68] 1282(0.4%) 0(0.0%) loop ...rbie/alt-testing/src/core/taylor.rkt:262:2 hash-ref! [206] 100.0% ----------------------------------------------------------------------------------------- for-loop [59] 19.3% run [17] 34.3% [69] 337024(99.2%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 34.3% ??? [205] 30.6% run-improve50 [2] 28.8% prepare-points [85] 3.9% loop [86] 2.4% ----------------------------------------------------------------------------------------- mk-egraph [214] 0.6% mk-enode-rec! [225] 1.1% substitute-e [62] 28.7% for-loop [46] 69.6% [70] 60780(17.9%) 4922(1.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [84] 91.4% hash-has-key? [111] 0.5% ----------------------------------------------------------------------------------------- match-e [47] 20.6% for-loop [60] 79.4% [71] 27332(8.0%) 1342(0.4%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [47] 91.5% ??? [95] 4.8% ----------------------------------------------------------------------------------------- for-loop [36] 3.8% merge-egraph-nodes! [61] 96.2% [72] 17886(5.3%) 1908(0.6%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [87] 77.8% custom-set-union! [92] 7.7% update-en-expr [175] 1.9% ----------------------------------------------------------------------------------------- for-loop [64] 100.0% [73] 11212(3.3%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [88] 100.0% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [61] 100.0% [74] 5646(1.7%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [61] 62.7% loop! [156] 37.3% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [61] 100.0% [75] 4222(1.2%) 3892(1.1%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [175] 7.8% ----------------------------------------------------------------------------------------- list-cartesian-product [76] 8.3% match-e [47] 25.6% for-loop [60] 66.1% [76] 4030(1.2%) 2638(0.8%) list-cartesian-product ...src/core/ematch.rkt:20:0 for-loop [91] 34.5% list-cartesian-product [76] 8.3% ----------------------------------------------------------------------------------------- f101 [48] 14.3% for-loop [30] 14.4% map [65] 28.5% hash-ref! [206] 42.9% [77] 2242(0.7%) 972(0.3%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 debug-print [90] 27.6% debug7 [89] 14.8% loop [152] 14.3% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [61] 31.3% *rules* [10] 68.7% [78] 1978(0.6%) 620(0.2%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 ormap [221] 34.7% flag-set? [230] 18.2% list-member? [212] 15.8% ----------------------------------------------------------------------------------------- expression-cost [66] 100.0% [79] 1616(0.5%) 312(0.1%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [206] 80.7% ----------------------------------------------------------------------------------------- for-loop [67] 100.0% [80] 1358(0.4%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [93] 100.0% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [61] 100.0% [81] 1338(0.4%) 358(0.1%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [96] 49.3% custom-set-intersect! [98] 23.9% ----------------------------------------------------------------------------------------- for-loop [60] 100.0% [82] 676(0.2%) 334(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [97] 50.6% ----------------------------------------------------------------------------------------- map [65] 100.0% [83] 674(0.2%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 append-map [94] 100.0% ----------------------------------------------------------------------------------------- mk-enode! [70] 100.0% [84] 55524(16.3%) 308(0.1%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [100] 98.9% ----------------------------------------------------------------------------------------- run-improve50 [2] 2.4% ??? [69] 97.6% [85] 26758(7.9%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [109] 46.4% loop [102] 29.9% make-exacts* [110] 21.1% for-loop [103] 2.5% ----------------------------------------------------------------------------------------- run-improve50 [2] 3.9% ??? [69] 96.1% [86] 16860(5.0%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 make-exacts* [110] 38.2% loop [102] 32.7% loop [109] 22.5% for-loop [103] 6.7% ----------------------------------------------------------------------------------------- update-leader! [72] 100.0% [87] 13916(4.1%) 332(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [101] 97.6% ----------------------------------------------------------------------------------------- taylor-alt [73] 100.0% [88] 11212(3.3%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [204] 100.0% ----------------------------------------------------------------------------------------- taylor [77] 17.1% iterate-egraph!13 [3] 17.3% simplify [40] 32.2% for-loop [59] 33.4% [89] 1942(0.6%) 954(0.3%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 ??? [99] 33.6% ??? [234] 17.3% ----------------------------------------------------------------------------------------- simplify [40] 20.1% taylor [77] 38.6% iterate-egraph!13 [3] 41.2% [90] 1600(0.5%) 956(0.3%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 for-loop [105] 40.2% ----------------------------------------------------------------------------------------- list-cartesian-product [76] 100.0% [91] 1392(0.4%) 1392(0.4%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 ----------------------------------------------------------------------------------------- update-leader! [72] 100.0% [92] 1376(0.4%) 1376(0.4%) custom-set-union! ...t/private/set-types.rkt:245:0 ----------------------------------------------------------------------------------------- ??? [80] 33.7% matcher [115] 66.3% [93] 1358(0.4%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [104] 66.3% *rules* [10] 33.7% ----------------------------------------------------------------------------------------- f101 [48] 49.7% simplify-node [83] 50.3% [94] 1340(0.4%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 parse-loop12 [211] 50.3% f101 [48] 45.1% free-variables [16] 4.6% ----------------------------------------------------------------------------------------- for-loop [71] 100.0% [95] 1302(0.4%) 972(0.3%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [106] 25.3% ----------------------------------------------------------------------------------------- enode-merge! [81] 100.0% [96] 660(0.2%) 0(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [172] 100.0% ----------------------------------------------------------------------------------------- curry* [82] 100.0% [97] 342(0.1%) 342(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ----------------------------------------------------------------------------------------- enode-merge! [81] 100.0% [98] 320(0.1%) 320(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ----------------------------------------------------------------------------------------- setfindf [179] 0.6% for-loop [106] 0.6% debug7 [89] 1.2% ??? [243] 1.5% substitute-e [62] 4.2% choose-best-alt! [54] 4.6% variable? [23] 12.2% get-sigs [107] 13.7% match-e [47] 17.7% finalize-iter! [49] 43.7% [99] 55426(16.3%) 14656(4.3%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [108] 42.5% hash-has-key? [111] 24.7% atab-pick-alt8 [113] 4.6% atab-add-altns [116] 1.1% ??? [243] 0.6% ----------------------------------------------------------------------------------------- new-enode [84] 100.0% [100] 54904(16.2%) 654(0.2%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [107] 98.8% ----------------------------------------------------------------------------------------- for-loop [87] 100.0% [101] 13584(4.0%) 0(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [112] 100.0% ----------------------------------------------------------------------------------------- loop [86] 40.7% prepare-points [85] 59.3% [102] 13522(4.0%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [110] 57.7% loop [109] 42.3% ----------------------------------------------------------------------------------------- prepare-points [85] 36.9% loop [86] 63.1% [103] 1790(0.5%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [114] 100.0% ----------------------------------------------------------------------------------------- rewriter [93] 100.0% [104] 1358(0.4%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [115] 100.0% ----------------------------------------------------------------------------------------- debug-print [90] 100.0% [105] 644(0.2%) 644(0.2%) for-loop ...herbie/alt-testing/src/debug.rkt:113:2 ----------------------------------------------------------------------------------------- ??? [95] 100.0% [106] 330(0.1%) 0(0.0%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ??? [99] 100.0% ----------------------------------------------------------------------------------------- type-of-enode-expr [100] 100.0% [107] 54250(16.0%) 1352(0.4%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [119] 44.2% ??? [205] 32.3% ??? [99] 13.9% ...sting/src/common.rkt:47:2 [121] 7.1% ----------------------------------------------------------------------------------------- ??? [99] 100.0% [108] 24056(7.1%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:53:2 atab-add-altn [118] 100.0% ----------------------------------------------------------------------------------------- loop [86] 17.3% loop [102] 26.1% prepare-points [85] 56.7% [109] 21926(6.5%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [152] 100.0% ----------------------------------------------------------------------------------------- prepare-points [85] 28.4% loop [86] 32.3% loop [102] 39.2% [110] 19902(5.9%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [152] 100.0% ----------------------------------------------------------------------------------------- mk-enode! [70] 2.3% ??? [99] 97.7% [111] 14480(4.3%) 5202(1.5%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [117] 59.2% ??? [125] 4.9% ----------------------------------------------------------------------------------------- for-loop [101] 100.0% [112] 13584(4.0%) 334(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [120] 97.5% ----------------------------------------------------------------------------------------- ??? [99] 100.0% [113] 2572(0.8%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:64:0 point-best-alt [123] 61.4% write-json* [126] 14.0% errors [135] 13.0% ??? [204] 11.7% ----------------------------------------------------------------------------------------- for-loop [103] 100.0% [114] 1790(0.5%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 for-loop [122] 100.0% ----------------------------------------------------------------------------------------- for-loop [124] 23.7% matcher [115] 26.3% for-loop [104] 50.0% [115] 1358(0.4%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [93] 50.0% matcher [115] 26.3% for-loop [124] 23.7% ----------------------------------------------------------------------------------------- ??? [99] 100.0% [116] 630(0.2%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [118] 100.0% ----------------------------------------------------------------------------------------- hash-has-key? [111] 28.8% ??? [205] 71.2% [117] 29720(8.7%) 9386(2.8%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [128] 50.1% ??? [138] 12.0% ??? [233] 3.2% arrow-higher-order:lnp [139] 2.2% successfully-got-the-right-kind-of-function [134] 1.0% ----------------------------------------------------------------------------------------- atab-add-altns [116] 2.6% for-loop [108] 97.4% [118] 24686(7.3%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [127] 98.5% ----------------------------------------------------------------------------------------- for-loop [63] 2.9% get-sigs [107] 97.1% [119] 24672(7.3%) 1658(0.5%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [130] 51.2% for-loop [136] 36.7% get/build-late-neg-projection [155] 5.4% ----------------------------------------------------------------------------------------- hash-update! [112] 100.0% [120] 13250(3.9%) 312(0.1%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [129] 97.6% ----------------------------------------------------------------------------------------- get-sigs [107] 48.8% for-loop [63] 51.2% [121] 7932(2.3%) 2728(0.8%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [131] 32.9% ??? [132] 32.7% ----------------------------------------------------------------------------------------- ??? [114] 100.0% [122] 1790(0.5%) 0(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:231:9 ??? [204] 100.0% ----------------------------------------------------------------------------------------- atab-pick-alt8 [113] 100.0% [123] 1578(0.5%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [152] 100.0% ----------------------------------------------------------------------------------------- matcher [115] 100.0% [124] 1046(0.3%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [115] 100.0% ----------------------------------------------------------------------------------------- hash-has-key? [111] 100.0% [125] 704(0.2%) 704(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ----------------------------------------------------------------------------------------- atab-pick-alt8 [113] 100.0% [126] 360(0.1%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:69:0 loop [133] 100.0% ----------------------------------------------------------------------------------------- atab-add-altn [118] 100.0% [127] 24316(7.2%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [135] 94.8% for-loop [140] 5.2% ----------------------------------------------------------------------------------------- ??? [117] 100.0% [128] 14880(4.4%) 6096(1.8%) for-loop ...acket/contract/private/list.rkt:743:12 for-loop [136] 28.7% ??? [138] 25.8% arrow-higher-order:lnp [139] 4.6% ----------------------------------------------------------------------------------------- ??? [120] 100.0% [129] 12938(3.8%) 12604(3.7%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [175] 2.6% ----------------------------------------------------------------------------------------- ??? [119] 100.0% [130] 12636(3.7%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [137] 100.0% ----------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [121] 100.0% [131] 2612(0.8%) 682(0.2%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [234] 35.1% assoc-ref [141] 25.4% return/no-unsupplied [235] 13.3% ----------------------------------------------------------------------------------------- for-loop [241] 6.6% ??? [233] 12.3% ...sting/src/common.rkt:47:2 [121] 81.1% [132] 2592(0.8%) 1012(0.3%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [233] 68.1% ??? [243] 5.9% ----------------------------------------------------------------------------------------- loop [133] 25.0% for-loop [142] 25.0% for-loop [143] 25.0% write-json* [126] 25.0% [133] 360(0.1%) 360(0.1%) loop .../share/racket/collects/json/main.rkt:103:2 for-loop [143] 25.0% for-loop [142] 25.0% loop [133] 25.0% ----------------------------------------------------------------------------------------- ??? [117] 100.0% [134] 300(0.1%) 0(0.0%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [144] 100.0% ----------------------------------------------------------------------------------------- atab-pick-alt8 [113] 1.0% composed [220] 2.7% loop [152] 13.1% option-on-expr [157] 16.6% best-and-tied-at-points [127] 66.7% [135] 34572(10.2%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [145] 91.2% eval-prog [188] 8.8% ----------------------------------------------------------------------------------------- for-loop [128] 32.1% ??? [119] 67.9% [136] 13314(3.9%) 2904(0.9%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [233] 70.8% ??? [239] 7.3% ----------------------------------------------------------------------------------------- ??? [130] 100.0% [137] 12636(3.7%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [146] 100.0% ----------------------------------------------------------------------------------------- ??? [117] 48.2% for-loop [128] 51.8% [138] 7402(2.2%) 4548(1.3%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [147] 38.6% ----------------------------------------------------------------------------------------- ??? [117] 48.9% for-loop [128] 51.1% [139] 1326(0.4%) 636(0.2%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [148] 52.0% ----------------------------------------------------------------------------------------- best-and-tied-at-points [127] 100.0% [140] 1268(0.4%) 1268(0.4%) for-loop ...-testing/src/core/alt-table.rkt:155:16 ----------------------------------------------------------------------------------------- ??? [131] 100.0% [141] 664(0.2%) 664(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ----------------------------------------------------------------------------------------- loop [133] 100.0% [142] 360(0.1%) 0(0.0%) for-loop ...e/racket/collects/json/main.rkt:113:13 loop [133] 100.0% ----------------------------------------------------------------------------------------- loop [133] 100.0% [143] 360(0.1%) 0(0.0%) for-loop ...e/racket/collects/json/main.rkt:118:11 loop [133] 100.0% ----------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [134]100.0% [144] 300(0.1%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [149] 100.0% ----------------------------------------------------------------------------------------- errors [135] 100.0% [145] 31528(9.3%) 1300(0.4%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [150] 88.8% ulp-difference [229] 4.0% ??? [204] 3.1% ----------------------------------------------------------------------------------------- ??? [137] 100.0% [146] 12636(3.7%) 358(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [151] 97.2% ----------------------------------------------------------------------------------------- ??? [138] 100.0% [147] 2854(0.8%) 2854(0.8%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ----------------------------------------------------------------------------------------- arrow-higher-order:lnp [139] 100.0% [148] 690(0.2%) 690(0.2%) ??? ...et/contract/private/arity-checking.rkt:19:2 ----------------------------------------------------------------------------------------- arity-checking-wrapper [144] 100.0% [149] 300(0.1%) 300(0.1%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ----------------------------------------------------------------------------------------- ??? [11] 1.2% jloop [6] 4.1% loop [202] 8.0% for-loop [145] 35.0% loop [152] 51.7% [150] 80068(23.6%) 2246(0.7%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [153] 46.2% loop [152] 34.8% ??? [158] 9.7% ??? [204] 6.5% ----------------------------------------------------------------------------------------- ??? [146] 100.0% [151] 12278(3.6%) 2368(0.7%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [154] 54.9% get/build-late-neg-projection [155] 25.9% ----------------------------------------------------------------------------------------- errors-score [34] 0.0% taylor [77] 0.3% for-loop [60] 0.4% ??? [213] 0.4% match-e [47] 0.4% map-enodes [25] 0.6% loop [109] 0.6% make-exacts* [110] 0.8% parse-loop12 [211] 0.9% point-best-alt [123] 1.1% option-on-expr [157] 1.7% loop! [156] 3.8% ??? [150] 6.3% f101 [48] 9.8% loop [152] 73.0% [152] 92538(27.2%) 3072(0.9%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [152] 73.0% option-on-expr [157] 9.8% ??? [204] 5.7% loop! [156] 3.8% errors [135] 2.7% ??? [150] 1.5% ??? [164] 0.9% curried [203] 0.7% hash-ref! [206] 0.4% set-precompute! [168] 0.4% simplify [40] 0.3% ??? [158] 0.3% for-loop [161] 0.2% ??? [11] 0.1% foldl [167] 0.0% ----------------------------------------------------------------------------------------- ??? [150] 100.0% [153] 36956(10.9%) 17804(5.2%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [159] 13.9% bf* [160] 13.8% ??? [173] 13.3% ??? [163] 7.2% ...higher-order.rkt:346:33 [166] 1.8% ??? [239] 1.0% parse-loop12 [211] 0.9% ----------------------------------------------------------------------------------------- for-loop [151] 100.0% [154] 6736(2.0%) 6736(2.0%) add-list-context ...ontract/private/list.rkt:752:0 ----------------------------------------------------------------------------------------- ??? [165] 7.0% ??? [119] 22.6% for-loop [151] 70.4% [155] 4508(1.3%) 968(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [162] 60.6% ??? [165] 14.5% listof-late-neg-projection [169] 3.4% ----------------------------------------------------------------------------------------- for-loop [74] 5.5% merge-egraph-nodes! [61] 11.1% loop [152] 33.1% for-loop [46] 50.2% [156] 26672(7.9%) 5800(1.7%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [172] 34.1% loop [152] 33.1% set [174] 14.1% update-en-expr [175] 6.3% ----------------------------------------------------------------------------------------- f101 [48] 8.3% loop [152] 91.7% [157] 23684(7.0%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [171] 45.3% errors [135] 24.2% loop [152] 20.9% err-lsts->split-indices [177] 6.8% point->alt [181] 1.4% pick-errors [183] 1.3% ----------------------------------------------------------------------------------------- ??? [150] 34.9% loop [152] 65.1% [158] 22306(6.6%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [170] 100.0% ----------------------------------------------------------------------------------------- ??? [153] 100.0% [159] 5120(1.5%) 2100(0.6%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [234] 33.7% return/no-unsupplied [235] 19.0% list-member? [212] 6.3% ----------------------------------------------------------------------------------------- ??? [153] 100.0% [160] 5096(1.5%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [173] 100.0% ----------------------------------------------------------------------------------------- map-enodes [25] 20.7% loop [152] 79.3% [161] 2982(0.9%) 688(0.2%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [179] 33.3% eval-const-expr [180] 11.4% curried [203] 11.3% compose [182] 10.9% composed [220] 10.1% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [155] 100.0% [162] 2896(0.9%) 952(0.3%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [176] 67.1% ----------------------------------------------------------------------------------------- ??? [153] 100.0% [163] 2670(0.8%) 2670(0.8%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ----------------------------------------------------------------------------------------- map [65] 11.8% loop [152] 88.2% [164] 1008(0.3%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [206] 67.7% map [65] 32.3% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [155] 100.0% [165] 968(0.3%) 336(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [155] 65.3% ----------------------------------------------------------------------------------------- ??? [153] 100.0% [166] 660(0.2%) 0(0.0%) ...higher-order.rkt:346:33 (unknown source) ??? [233] 100.0% ----------------------------------------------------------------------------------------- loop [152] 49.0% for-loop [60] 51.0% [167] 608(0.2%) 310(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [184] 49.0% ----------------------------------------------------------------------------------------- loop [152] 100.0% [168] 340(0.1%) 0(0.0%) set-precompute! ...ing/src/core/simplify.rkt:193:0 make-sequence [178] 100.0% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [155] 100.0% [169] 308(0.1%) 308(0.1%) listof-late-neg-projection ...ivate/list.rkt:162:0 ----------------------------------------------------------------------------------------- ??? [158] 100.0% [170] 22306(6.6%) 18078(5.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [195] 19.0% ----------------------------------------------------------------------------------------- option-on-expr [157] 100.0% [171] 10736(3.2%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [185] 100.0% ----------------------------------------------------------------------------------------- adopt-enode! [96] 6.2% loop! [156] 93.8% [172] 10592(3.1%) 3340(1.0%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [187] 59.4% for-loop [191] 9.0% ----------------------------------------------------------------------------------------- ??? [153] 49.1% bf* [160] 50.9% [173] 10016(2.9%) 304(0.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [186] 97.0% ----------------------------------------------------------------------------------------- loop! [156] 100.0% [174] 7604(2.2%) 7604(2.2%) set ...collects/racket/private/set-types.rkt:981:0 ----------------------------------------------------------------------------------------- for-loop [75] 7.6% for-loop [129] 7.7% update-leader! [72] 7.9% loop! [156] 76.8% [175] 4342(1.3%) 4342(1.3%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ----------------------------------------------------------------------------------------- contract-struct-name [189] 25.8% ??? [162] 74.2% [176] 1944(0.6%) 980(0.3%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [189] 66.9% ----------------------------------------------------------------------------------------- option-on-expr [157] 100.0% [177] 1620(0.5%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [190] 100.0% ----------------------------------------------------------------------------------------- set-precompute! [168] 33.9% reduce-to-single! [57] 66.1% [178] 1002(0.3%) 340(0.1%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [192] 66.1% ----------------------------------------------------------------------------------------- for-loop [161] 100.0% [179] 992(0.3%) 680(0.2%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 ??? [99] 31.5% ----------------------------------------------------------------------------------------- for-loop [161] 100.0% [180] 340(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f101 [48] 100.0% ----------------------------------------------------------------------------------------- option-on-expr [157] 100.0% [181] 332(0.1%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [188] 100.0% ----------------------------------------------------------------------------------------- for-loop [161] 100.0% [182] 324(0.1%) 324(0.1%) compose ...collects/racket/private/list.rkt:385:12 ----------------------------------------------------------------------------------------- option-on-expr [157] 100.0% [183] 310(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [193] 100.0% ----------------------------------------------------------------------------------------- foldl [167] 100.0% [184] 298(0.1%) 298(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 ----------------------------------------------------------------------------------------- localize-error [55] 3.2% sort-context-on-expr [171] 96.8% [185] 11092(3.3%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [194] 88.0% loop [202] 12.0% ----------------------------------------------------------------------------------------- ??? [173] 100.0% [186] 9712(2.9%) 5726(1.7%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [195] 41.0% ----------------------------------------------------------------------------------------- custom-set-union [172] 100.0% [187] 6296(1.9%) 2352(0.7%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [196] 62.6% ----------------------------------------------------------------------------------------- point->alt [181] 9.8% errors [135] 90.2% [188] 3376(1.0%) 1050(0.3%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f101 [48] 49.8% hash-ref! [206] 10.2% parse-lambda [199] 8.9% ----------------------------------------------------------------------------------------- build-compound-type-name [176] 100.0% [189] 1636(0.5%) 964(0.3%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [176] 51.2% ----------------------------------------------------------------------------------------- err-lsts->split-indices [177] 100.0% [190] 1620(0.5%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [197] 100.0% ----------------------------------------------------------------------------------------- custom-set-union [172] 100.0% [191] 956(0.3%) 956(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 ----------------------------------------------------------------------------------------- make-sequence [178] 100.0% [192] 662(0.2%) 322(0.1%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [198] 51.4% ----------------------------------------------------------------------------------------- pick-errors [183] 100.0% [193] 310(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [11] 100.0% ----------------------------------------------------------------------------------------- ??? [185] 100.0% [194] 9760(2.9%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [200] 76.1% loop [202] 20.2% jloop [6] 3.6% ----------------------------------------------------------------------------------------- bfmul [186] 48.5% real->bigfloat [170] 51.5% [195] 8214(2.4%) 8214(2.4%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ----------------------------------------------------------------------------------------- for-loop [187] 100.0% [196] 3944(1.2%) 3944(1.2%) for-loop ...cts/racket/private/set-types.rkt:178:5 ----------------------------------------------------------------------------------------- add-splitpoint [190] 100.0% [197] 1620(0.5%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [201] 100.0% ----------------------------------------------------------------------------------------- ??? [192] 100.0% [198] 340(0.1%) 340(0.1%) custom-in-set ...acket/private/set-types.rkt:577:0 ----------------------------------------------------------------------------------------- eval-prog [188] 100.0% [199] 302(0.1%) 302(0.1%) parse-lambda ...llects/racket/private/kw.rkt:437:2 ----------------------------------------------------------------------------------------- generic-sort/key [194] 45.7% copying-mergesort [200] 54.3% [200] 7430(2.2%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [200] 54.3% loop [202] 32.3% jloop [6] 13.4% ----------------------------------------------------------------------------------------- for-loop [197] 100.0% [201] 1620(0.5%) 950(0.3%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [203] 41.4% ----------------------------------------------------------------------------------------- ??? [185] 19.7% generic-sort/key [194] 29.2% copying-mergesort [200] 51.1% [202] 6756(2.0%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [150] 94.8% ??? [204] 5.2% ----------------------------------------------------------------------------------------- for-loop [161] 20.3% loop [152] 39.6% for-loop [201] 40.2% [203] 1668(0.5%) 1668(0.5%) curried ...cket/collects/racket/function.rkt:71:18 ----------------------------------------------------------------------------------------- loop [22] 0.3% atab-pick-alt8 [113] 0.9% map [65] 0.9% jloop [6] 1.0% loop [202] 1.0% for-loop [145] 2.8% f101 [48] 3.8% for-loop [122] 5.2% ??? [209] 7.2% ??? [205] 12.5% for-loop [88] 12.5% ??? [150] 15.1% loop [152] 35.8% [204] 34560(10.2%) 2770(0.8%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [205] 67.3% approximate9 [5] 12.5% hash-ref! [206] 7.5% ??? [243] 3.8% best-alt [207] 0.9% ----------------------------------------------------------------------------------------- simplify-alt [42] 0.1% for-loop [63] 2.0% get-sigs [107] 2.3% ??? [204] 9.6% ??? [205] 10.2% for-loop [208] 33.8% ??? [69] 41.7% [205] 259348(76.4%) 16172(4.8%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [3] 37.9% for-loop [208] 33.9% ??? [205] 10.2% loop [4] 3.9% ??? [117] 2.7% ??? [204] 2.3% return/no-unsupplied [235] 2.0% ??? [234] 1.8% loop [215] 0.3% mk-egraph [214] 0.2% list-member? [212] 0.1% *simplify-rules* [217] 0.1% dict? [245] 0.0% ----------------------------------------------------------------------------------------- first-nonzero-exp [28] 0.6% for-loop [222] 0.6% loop [152] 1.4% eval-prog [188] 1.4% for-loop [27] 2.4% for-loop [41] 2.5% for-loop [24] 3.6% ??? [164] 4.0% localize-error [55] 4.4% compile [79] 5.3% ??? [213] 5.5% ??? [210] 6.1% loop [68] 8.4% ??? [204] 11.7% loop [22] 13.3% ??? [209] 28.7% [206] 12006(3.5%) 2256(0.7%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [209] 39.9% ??? [7] 9.1% ??? [213] 8.4% simplify [40] 8.2% parse-loop12 [211] 7.7% ??? [210] 6.1% f101 [48] 3.4% ??? [8] 3.3% ??? [9] 2.4% taylor [77] 2.0% ??? [12] 0.6% ??? [14] 0.5% ----------------------------------------------------------------------------------------- ??? [204] 100.0% [207] 300(0.1%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [216] 100.0% ----------------------------------------------------------------------------------------- ??? [205] 100.0% [208] 184702(54.4%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [205] 99.8% ??? [228] 0.2% ----------------------------------------------------------------------------------------- hash-ref! [206] 100.0% [209] 8072(2.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 hash-ref! [206] 69.2% ??? [204] 30.8% ----------------------------------------------------------------------------------------- hash-ref! [206] 100.0% [210] 4490(1.3%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [206] 100.0% ----------------------------------------------------------------------------------------- simplify [40] 4.1% ??? [153] 8.4% append-map [94] 17.3% for-loop [29] 20.3% map [65] 23.9% hash-ref! [206] 25.9% [211] 3890(1.1%) 1290(0.4%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 for-loop [222] 20.3% loop [152] 20.1% map [65] 11.4% for-loop [227] 8.6% simplify* [218] 7.7% loop [223] 2.8% ----------------------------------------------------------------------------------------- for-loop [78] 8.6% ??? [159] 8.8% ??? [205] 9.9% for-loop [46] 72.7% [212] 3642(1.1%) 994(0.3%) list-member? ...llects/racket/private/set.rkt:24:0 loop [219] 54.1% member [224] 18.6% ----------------------------------------------------------------------------------------- hash-ref! [206] 100.0% [213] 1324(0.4%) 356(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 hash-ref! [206] 60.6% loop [152] 26.0% ----------------------------------------------------------------------------------------- ??? [205] 100.0% [214] 1032(0.3%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [225] 65.1% mk-enode! [70] 34.9% ----------------------------------------------------------------------------------------- ??? [205] 100.0% [215] 654(0.2%) 318(0.1%) loop ...ies/herbie/alt-testing/src/points.rkt:66:6 random-exp [226] 51.4% ----------------------------------------------------------------------------------------- best-alt [207] 48.9% extract-alt [43] 51.1% [216] 614(0.2%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [220] 100.0% ----------------------------------------------------------------------------------------- ??? [205] 100.0% [217] 324(0.1%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 ormap [221] 100.0% ----------------------------------------------------------------------------------------- parse-loop12 [211] 13.3% simplify [40] 14.3% map [65] 72.4% [218] 2250(0.7%) 1926(0.6%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 return/no-unsupplied [235] 14.4% ----------------------------------------------------------------------------------------- list-member? [212] 100.0% [219] 1972(0.6%) 1972(0.6%) loop (unknown source) ----------------------------------------------------------------------------------------- for-loop [161] 15.9% loop [58] 16.2% argmins [216] 32.6% f101 [48] 35.3% [220] 1886(0.6%) 300(0.1%) composed ...ollects/racket/private/list.rkt:321:16 errors [135] 48.8% f101 [48] 35.3% ----------------------------------------------------------------------------------------- *simplify-rules* [217] 32.1% for-loop [78] 67.9% [221] 1010(0.3%) 324(0.1%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [230] 67.9% ----------------------------------------------------------------------------------------- parse-loop12 [211] 100.0% [222] 952(0.3%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:490:59 hash-ref! [206] 100.0% ----------------------------------------------------------------------------------------- map [65] 1.4% parse-loop12 [211] 4.3% loop [223] 94.2% [223] 682(0.2%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [223] 94.2% ulp-difference [229] 4.3% ----------------------------------------------------------------------------------------- list-member? [212] 100.0% [224] 676(0.2%) 676(0.2%) member (unknown source) ----------------------------------------------------------------------------------------- mk-enode-rec! [225] 50.0% mk-egraph [214] 50.0% [225] 672(0.2%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [225] 50.0% mk-enode! [70] 50.0% ----------------------------------------------------------------------------------------- loop [215] 100.0% [226] 336(0.1%) 336(0.1%) random-exp ...bie/alt-testing/src/common.rkt:253:0 ----------------------------------------------------------------------------------------- parse-loop12 [211] 100.0% [227] 336(0.1%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:99:13 make-multiplication-node [231] 100.0% ----------------------------------------------------------------------------------------- for-loop [208] 100.0% [228] 320(0.1%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 ??? [232] 100.0% ----------------------------------------------------------------------------------------- loop [223] 20.5% for-loop [145] 79.5% [229] 1594(0.5%) 952(0.3%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [235] 40.3% ----------------------------------------------------------------------------------------- for-loop [78] 34.4% ormap [221] 65.6% [230] 1046(0.3%) 360(0.1%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [235] 33.8% ??? [234] 31.7% ----------------------------------------------------------------------------------------- for-loop [227] 100.0% [231] 336(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [236] 100.0% ----------------------------------------------------------------------------------------- ??? [228] 100.0% [232] 320(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:354:44 ??? [233] 100.0% ----------------------------------------------------------------------------------------- ??? [232] 2.4% ...higher-order.rkt:346:33 [166] 4.9% ??? [117] 6.9% ??? [132] 16.6% for-loop [136] 69.3% [233] 13608(4.0%) 2272(0.7%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [237] 66.8% ??? [239] 6.9% for-loop [241] 4.9% ??? [132] 4.7% ----------------------------------------------------------------------------------------- flag-set? [230] 3.7% debug7 [89] 3.8% ??? [131] 10.3% ??? [159] 19.3% ??? [205] 63.0% [234] 8938(2.6%) 2994(0.9%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [238] 51.8% ??? [243] 14.7% ----------------------------------------------------------------------------------------- simplify* [218] 3.8% ??? [131] 4.0% flag-set? [230] 4.1% ulp-difference [229] 7.5% ??? [159] 11.3% ??? [205] 69.3% [235] 8614(2.5%) 7004(2.1%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [240] 18.7% ----------------------------------------------------------------------------------------- make-multiplication-node [231] 100.0% [236] 336(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 group-by68 [242] 100.0% ----------------------------------------------------------------------------------------- ??? [233] 100.0% [237] 9094(2.7%) 1350(0.4%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [243] 85.2% ----------------------------------------------------------------------------------------- ??? [234] 100.0% [238] 4626(1.4%) 4626(1.4%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ----------------------------------------------------------------------------------------- ??? [153] 15.7% ??? [233] 41.3% for-loop [136] 43.0% [239] 2276(0.7%) 1938(0.6%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [244] 14.9% ----------------------------------------------------------------------------------------- one-iter [19] 17.8% return/no-unsupplied [235] 82.2% [240] 1958(0.6%) 1958(0.6%) filter ...t/collects/racket/private/list.rkt:256:2 ----------------------------------------------------------------------------------------- ??? [233] 100.0% [241] 664(0.2%) 320(0.1%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [132] 51.8% ----------------------------------------------------------------------------------------- make-multiplication-subnode [236] 100.0% [242] 336(0.1%) 336(0.1%) group-by68 ...acket/collects/racket/list.rkt:749:0 ----------------------------------------------------------------------------------------- ??? [132] 2.8% ??? [99] 3.0% ??? [234] 12.0% ??? [204] 12.0% ??? [237] 70.2% [243] 11024(3.2%) 8752(2.6%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [99] 12.0% dict? [245] 5.8% contract? [246] 2.8% ----------------------------------------------------------------------------------------- ??? [239] 100.0% [244] 338(0.1%) 338(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ----------------------------------------------------------------------------------------- ??? [205] 35.9% ??? [243] 64.1% [245] 1002(0.3%) 1002(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 ----------------------------------------------------------------------------------------- ??? [243] 100.0% [246] 306(0.1%) 306(0.1%) contract? ...acket/contract/private/guts.rkt:109:0 -----------------------------------------------------------------------------------------