Profiling results ----------------- Total cpu time observed: 2253804ms (out of 2264484ms) Number of samples taken: 6604 (once every 341ms) (Hiding functions with self<1.0% and local<2.0%: 28 of 302 hidden) ================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ================================================================================== ??? [72] 100.0% [1] 1896310(84.1%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [14] 100.0% ---------------------------------------------------------------------------------- ??? [72] 100.0% [2] 1568260(69.6%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [15] 84.1% get-final-combination [19] 14.7% prepare-points [143] 0.7% loop [144] 0.4% setup-alt-simplified [25] 0.1% ---------------------------------------------------------------------------------- ??? [171] 100.0% [3] 1327774(58.9%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [16] 99.1% debug7 [224] 0.0% ---------------------------------------------------------------------------------- ??? [242] 0.4% jloop [141] 0.9% loop [140] 1.7% loop [160] 1.8% for-loop [247] 12.3% loop [225] 82.8% [4] 407552(18.1%) 5846(0.3%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [17] 93.6% ??? [20] 2.8% ??? [166] 2.0% ---------------------------------------------------------------------------------- ??? [171] 100.0% [5] 254304(11.3%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [18] 100.0% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [6] 9566(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [21] 100.0% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [7] 6592(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [188] 72.1% for-loop [24] 27.9% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [8] 5544(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [22] 100.0% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [9] 3016(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [23] 100.0% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [10] 1698(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:483:23 for-loop [26] 100.0% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [11] 982(0.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:408:23 for-loop [27] 100.0% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [12] 354(0.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 for-loop [28] 100.0% ---------------------------------------------------------------------------------- f6 [45] 100.0% [13] 310(0.0%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [205] 100.0% ---------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [14] 1896964(84.2%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [72] 100.0% ---------------------------------------------------------------------------------- run-improve50 [2] 100.0% [15] 1319362(58.5%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [29] 100.0% ---------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [16] 1315366(58.4%) 10184(0.5%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [30] 82.6% for-loop [33] 16.5% loop [167] 0.2% ---------------------------------------------------------------------------------- ??? [4] 100.0% [17] 381320(16.9%) 47364(2.1%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [236] 76.8% bf* [34] 4.5% ??? [35] 3.3% ??? [219] 0.6% parse-loop145 [217] 0.5% ---------------------------------------------------------------------------------- loop [5] 100.0% [18] 254304(11.3%) 1346(0.1%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [31] 99.2% ---------------------------------------------------------------------------------- run-improve50 [2] 100.0% [19] 230094(10.2%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [32] 99.6% extract-alt [40] 0.4% ---------------------------------------------------------------------------------- ??? [4] 100.0% [20] 11372(0.5%) 1012(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [36] 91.1% ---------------------------------------------------------------------------------- ??? [6] 100.0% [21] 9566(0.4%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [188] 100.0% ---------------------------------------------------------------------------------- ??? [8] 100.0% [22] 5544(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 hash-ref! [188] 79.5% ??? [39] 20.5% ---------------------------------------------------------------------------------- ??? [9] 100.0% [23] 3016(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [37] 100.0% ---------------------------------------------------------------------------------- ??? [7] 100.0% [24] 2002(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [188] 100.0% ---------------------------------------------------------------------------------- run-improve50 [2] 100.0% [25] 1982(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [38] 100.0% ---------------------------------------------------------------------------------- ??? [10] 100.0% [26] 1698(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:487:35 parse-loop145 [217] 100.0% ---------------------------------------------------------------------------------- ??? [11] 100.0% [27] 982(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:411:30 for-loop [41] 100.0% ---------------------------------------------------------------------------------- ??? [12] 100.0% [28] 354(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:324:46 hash-ref! [188] 100.0% ---------------------------------------------------------------------------------- for-loop [15] 100.0% [29] 1319362(58.5%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [42] 94.3% finalize-iter! [48] 3.4% gen-series! [50] 1.1% choose-best-alt! [51] 0.7% gen-rewrites! [53] 0.3% ---------------------------------------------------------------------------------- one-iter [16] 100.0% [30] 1086140(48.2%) 4046(0.2%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [43] 86.1% match-e [44] 9.0% update-leader! [74] 4.1% reduce-to-single! [52] 0.4% ---------------------------------------------------------------------------------- pass [18] 100.0% [31] 252260(11.2%) 1600(0.1%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [46] 61.6% loop [47] 30.7% for-loop [49] 6.5% make-sequence [149] 0.4% filter [271] 0.1% ---------------------------------------------------------------------------------- get-final-combination [19] 100.0% [32] 229092(10.2%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f6 [45] 99.9% ??? [137] 0.1% ---------------------------------------------------------------------------------- for-loop [33] 49.3% one-iter [16] 50.7% [33] 217066(9.6%) 48936(2.2%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [33] 49.3% match-e [44] 38.5% ??? [103] 0.2% ---------------------------------------------------------------------------------- ??? [17] 100.0% [34] 17294(0.8%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [236] 100.0% ---------------------------------------------------------------------------------- ??? [17] 100.0% [35] 12772(0.6%) 8092(0.4%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [265] 20.8% return/no-unsupplied [266] 13.2% list-member? [61] 2.6% ---------------------------------------------------------------------------------- ??? [20] 100.0% [36] 10360(0.5%) 7672(0.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [259] 25.9% ---------------------------------------------------------------------------------- for-loop [23] 100.0% [37] 3016(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [188] 100.0% ---------------------------------------------------------------------------------- setup-alt-simplified [25] 100.0% [38] 1982(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [171] 100.0% ---------------------------------------------------------------------------------- for-loop [22] 100.0% [39] 1316(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [188] 100.0% ---------------------------------------------------------------------------------- get-final-combination [19] 100.0% [40] 1002(0.0%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 loop [186] 64.1% argmins [54] 35.9% ---------------------------------------------------------------------------------- for-loop [27] 100.0% [41] 982(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:414:42 hash-ref! [188] 100.0% ---------------------------------------------------------------------------------- run-iter! [29] 100.0% [42] 1244032(55.2%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [55] 100.0% ---------------------------------------------------------------------------------- for-loop [30] 100.0% [43] 935306(41.5%) 3924(0.2%) for-loop ...t-testing/src/core/simplify.rkt:148:10 merge-egraph-nodes! [56] 30.1% mk-enode! [73] 29.2% substitute-e [59] 18.8% loop! [95] 17.0% list-member? [61] 4.5% ---------------------------------------------------------------------------------- for-loop [30] 22.2% for-loop [76] 27.1% for-loop [33] 50.7% [44] 265306(11.8%) 88396(3.9%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [60] 48.9% for-loop [76] 9.2% ??? [137] 6.2% variable? [98] 3.4% list-cartesian-product [80] 1.6% loop [225] 1.2% curry* [253] 0.2% filter [271] 0.1% loop [167] 0.1% ---------------------------------------------------------------------------------- composed [195] 0.0% append-map [68] 0.1% for-loop [134] 0.1% approximate9 [174] 0.3% rewriter [104] 0.3% mterm->expr [267] 0.3% parse-loop145 [217] 0.3% hash-ref! [188] 0.8% map [64] 1.0% eval-prog [165] 1.1% simplify [205] 1.3% f6 [45] 2.8% split-table [32] 91.5% [45] 246886(11.0%) 1314(0.1%) f6 ...et/collects/racket/match/compiler.rkt:507:40 loop [225] 89.9% f6 [45] 2.8% map [64] 2.8% option-on-expr [57] 1.6% ??? [166] 1.1% ??? [172] 0.3% taylor-quotient [67] 0.3% composed [195] 0.2% append-map [68] 0.2% ??? [137] 0.2% ...sting/src/common.rkt:47:2 [173] 0.1% taylor [69] 0.1% gather-multiplicative-terms [70] 0.0% variable? [98] 0.0% taylor-invert [13] 0.0% ---------------------------------------------------------------------------------- for-loop [31] 100.0% [46] 155472(6.9%) 360(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [58] 91.2% expression-cost [62] 8.6% ---------------------------------------------------------------------------------- for-loop [31] 100.0% [47] 77524(3.4%) 956(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [58] 89.0% expression-cost [62] 9.8% ---------------------------------------------------------------------------------- run-iter! [29] 100.0% [48] 44926(2.0%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [137] 100.0% ---------------------------------------------------------------------------------- for-loop [31] 100.0% [49] 16358(0.7%) 16358(0.7%) for-loop ...t-testing/src/core/simplify.rkt:217:13 ---------------------------------------------------------------------------------- run-iter! [29] 100.0% [50] 14506(0.6%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [63] 100.0% ---------------------------------------------------------------------------------- run-iter! [29] 100.0% [51] 8898(0.4%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [137] 100.0% ---------------------------------------------------------------------------------- for-loop [30] 100.0% [52] 4314(0.2%) 2034(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [66] 45.4% for-loop [71] 7.4% ---------------------------------------------------------------------------------- run-iter! [29] 100.0% [53] 4310(0.2%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 for-loop [65] 100.0% ---------------------------------------------------------------------------------- extract-alt [40] 100.0% [54] 360(0.0%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [195] 100.0% ---------------------------------------------------------------------------------- simplify! [42] 98.7% [55] 1260694(55.9%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [72] 100.0% ---------------------------------------------------------------------------------- for-loop [79] 4.3% merge-egraph-nodes! [56] 4.6% for-loop [43] 91.1% [56] 281462(12.5%) 5754(0.3%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [74] 49.0% for-loop [77] 17.9% loop! [95] 13.3% for-loop [79] 7.9% merge-egraph-nodes! [56] 4.6% enode-merge! [84] 3.9% make-sequence [149] 0.9% for-loop [194] 0.5% ---------------------------------------------------------------------------------- f6 [45] 1.7% loop [225] 98.3% [57] 228794(10.2%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [75] 82.1% loop [225] 9.7% sort-context-on-expr [83] 5.2% err-lsts->split-indices [87] 1.5% errors [237] 1.3% pick-errors [91] 0.3% ---------------------------------------------------------------------------------- loop [47] 32.7% argmin [46] 67.3% [58] 210714(9.3%) 3292(0.1%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [171] 70.1% ...sting/src/common.rkt:47:2 [173] 25.0% ??? [172] 3.3% ---------------------------------------------------------------------------------- substitute-e [59] 5.2% for-loop [43] 94.8% [59] 175612(7.8%) 7472(0.3%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [73] 88.9% substitute-e [59] 5.2% ??? [137] 1.9% variable? [98] 0.8% ---------------------------------------------------------------------------------- match-e [44] 100.0% [60] 166864(7.4%) 57560(2.6%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [76] 54.5% list-cartesian-product [80] 8.7% loop [225] 4.5% curry* [253] 1.1% foldl [241] 1.0% curried [250] 0.9% ---------------------------------------------------------------------------------- ??? [35] 0.8% for-loop [43] 99.2% [61] 42158(1.9%) 978(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [78] 84.5% member [85] 13.2% ---------------------------------------------------------------------------------- loop [47] 36.3% argmin [46] 63.7% [62] 20966(0.9%) 972(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [81] 95.4% ---------------------------------------------------------------------------------- gen-series! [50] 100.0% [63] 14506(0.6%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [82] 100.0% ---------------------------------------------------------------------------------- ??? [88] 3.5% parse-loop145 [217] 3.9% f6 [45] 92.6% [64] 8978(0.4%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 f6 [45] 37.2% parse-loop145 [217] 27.3% loop [225] 15.3% make-multiplication-node [230] 4.8% ??? [92] 4.0% ??? [88] 4.0% simplify* [90] 4.0% ??? [166] 3.5% ---------------------------------------------------------------------------------- gen-rewrites! [53] 100.0% [65] 4310(0.2%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:138:11 ??? [86] 100.0% ---------------------------------------------------------------------------------- reduce-to-single! [52] 100.0% [66] 1960(0.1%) 1960(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 ---------------------------------------------------------------------------------- approximate9 [174] 39.1% f6 [45] 60.9% [67] 1700(0.1%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [89] 79.6% simplify [205] 20.4% ---------------------------------------------------------------------------------- f6 [45] 100.0% [68] 958(0.0%) 334(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 f6 [45] 38.2% free-variables [93] 26.9% ---------------------------------------------------------------------------------- f6 [45] 100.0% [69] 690(0.0%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 debug-print [222] 100.0% ---------------------------------------------------------------------------------- f6 [45] 100.0% [70] 362(0.0%) 0(0.0%) gather-multiplicative-terms ...re/reduce.rkt:116:0 curry* [253] 100.0% ---------------------------------------------------------------------------------- reduce-to-single! [52] 100.0% [71] 320(0.0%) 320(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:329:21 ---------------------------------------------------------------------------------- for-loop [55] 19.3% run [14] 33.1% [72] 2239510(99.4%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [171] 33.5% profile-thunk16 [1] 33.1% run-improve50 [2] 25.8% prepare-points [143] 5.1% loop [144] 2.5% unpack245 [268] 0.0% ---------------------------------------------------------------------------------- mk-egraph [184] 0.1% mk-enode-rec! [193] 1.3% substitute-e [59] 35.9% for-loop [43] 62.7% [73] 435482(19.3%) 30656(1.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [94] 90.9% hash-has-key? [146] 1.8% mutable-set [119] 0.3% ---------------------------------------------------------------------------------- for-loop [30] 22.8% merge-egraph-nodes! [56] 77.2% [74] 193948(8.6%) 13744(0.6%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [97] 90.1% custom-set-union! [107] 1.1% update-en-expr [204] 0.7% make-sequence [149] 0.4% hash-ref! [188] 0.4% mutable-set [119] 0.4% ---------------------------------------------------------------------------------- option-on-expr [57] 100.0% [75] 187754(8.3%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [96] 100.0% ---------------------------------------------------------------------------------- match-e [44] 28.9% for-loop [60] 71.1% [76] 139800(6.2%) 6628(0.3%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [44] 92.8% ??? [103] 3.4% ---------------------------------------------------------------------------------- merge-egraph-nodes! [56] 100.0% [77] 50964(2.3%) 42206(1.9%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [204] 17.2% ---------------------------------------------------------------------------------- list-member? [61] 100.0% [78] 35626(1.6%) 35626(1.6%) loop (unknown source) ---------------------------------------------------------------------------------- merge-egraph-nodes! [56] 100.0% [79] 35604(1.6%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [56] 69.2% loop! [95] 30.8% ---------------------------------------------------------------------------------- match-e [44] 15.5% list-cartesian-product [80] 30.6% for-loop [60] 53.9% [80] 23464(1.0%) 15632(0.7%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [80] 30.6% for-loop [101] 21.9% ---------------------------------------------------------------------------------- expression-cost [62] 100.0% [81] 19994(0.9%) 1342(0.1%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [188] 93.3% ---------------------------------------------------------------------------------- for-loop [63] 100.0% [82] 14506(0.6%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [99] 100.0% ---------------------------------------------------------------------------------- option-on-expr [57] 100.0% [83] 11858(0.5%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [100] 100.0% ---------------------------------------------------------------------------------- merge-egraph-nodes! [56] 100.0% [84] 11400(0.5%) 2316(0.1%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [102] 59.1% custom-set-intersect! [106] 20.6% ---------------------------------------------------------------------------------- list-member? [61] 100.0% [85] 5554(0.2%) 5554(0.2%) member (unknown source) ---------------------------------------------------------------------------------- for-loop [65] 100.0% [86] 4310(0.2%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [104] 100.0% ---------------------------------------------------------------------------------- option-on-expr [57] 100.0% [87] 3338(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [105] 100.0% ---------------------------------------------------------------------------------- map [64] 2.7% loop [225] 97.3% [88] 2690(0.1%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [188] 98.1% map [64] 1.9% ---------------------------------------------------------------------------------- taylor-quotient [67] 100.0% [89] 1354(0.1%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [188] 100.0% ---------------------------------------------------------------------------------- map [64] 100.0% [90] 972(0.0%) 346(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [188] 33.3% ??? [110] 31.1% ---------------------------------------------------------------------------------- option-on-expr [57] 100.0% [91] 674(0.0%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [108] 100.0% ---------------------------------------------------------------------------------- parse-loop145 [217] 46.6% map [64] 53.4% [92] 670(0.0%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 for-loop [109] 100.0% ---------------------------------------------------------------------------------- append-map [68] 100.0% [93] 624(0.0%) 326(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 variable? [98] 47.8% ---------------------------------------------------------------------------------- mk-enode! [73] 100.0% [94] 395664(17.6%) 1652(0.1%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [111] 98.1% set [115] 0.8% mutable-set [119] 0.3% ---------------------------------------------------------------------------------- for-loop [79] 3.5% merge-egraph-nodes! [56] 15.8% loop [225] 27.0% for-loop [43] 53.6% [95] 218902(9.7%) 37154(1.6%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [114] 41.3% loop [225] 31.0% set [115] 12.8% update-en-expr [204] 5.0% ---------------------------------------------------------------------------------- parse-loop145 [217] 0.0% loop [96] 0.2% sindices->spoints [75] 99.8% [96] 188088(8.3%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 sidx->spoint [112] 99.8% loop [96] 0.2% ??? [166] 0.0% ---------------------------------------------------------------------------------- update-leader! [74] 100.0% [97] 174786(7.8%) 5380(0.2%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [113] 96.7% update-en-expr [204] 0.2% ---------------------------------------------------------------------------------- free-variables [93] 1.0% f6 [45] 1.3% substitute-e [59] 13.4% match-e [44] 84.3% [98] 28640(1.3%) 1008(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [137] 96.5% ---------------------------------------------------------------------------------- taylor-alt [82] 100.0% [99] 14506(0.6%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [166] 100.0% ---------------------------------------------------------------------------------- sort-context-on-expr [83] 100.0% [100] 11858(0.5%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [116] 94.3% loop [140] 5.7% ---------------------------------------------------------------------------------- list-cartesian-product [80] 100.0% [101] 7832(0.3%) 7832(0.3%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 ---------------------------------------------------------------------------------- enode-merge! [84] 100.0% [102] 6736(0.3%) 2034(0.1%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [114] 69.8% ---------------------------------------------------------------------------------- for-loop [33] 15.0% for-loop [76] 85.0% [103] 6632(0.3%) 4636(0.2%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [120] 30.1% ---------------------------------------------------------------------------------- ??? [86] 34.8% matcher [131] 65.2% [104] 4310(0.2%) 1308(0.1%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [117] 65.2% *rules* [121] 16.1% f6 [45] 5.7% expression->type [123] 4.0% ---------------------------------------------------------------------------------- err-lsts->split-indices [87] 100.0% [105] 3338(0.1%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [118] 100.0% ---------------------------------------------------------------------------------- enode-merge! [84] 100.0% [106] 2348(0.1%) 2348(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ---------------------------------------------------------------------------------- update-leader! [74] 100.0% [107] 2042(0.1%) 1024(0.0%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [122] 49.9% ---------------------------------------------------------------------------------- pick-errors [91] 100.0% [108] 674(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [242] 100.0% ---------------------------------------------------------------------------------- ??? [92] 100.0% [109] 670(0.0%) 358(0.0%) for-loop ...e/alt-testing/src/core/reduce.rkt:62:7 pattern-match [124] 46.6% ---------------------------------------------------------------------------------- simplify* [90] 100.0% [110] 302(0.0%) 0(0.0%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [270] 100.0% ---------------------------------------------------------------------------------- new-enode [94] 100.0% [111] 388172(17.2%) 5772(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [125] 98.3% parse-loop145 [217] 0.2% ---------------------------------------------------------------------------------- loop [96] 100.0% [112] 187754(8.3%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [127] 70.8% pred [136] 29.2% ---------------------------------------------------------------------------------- for-loop [97] 100.0% [113] 169094(7.5%) 1320(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [126] 99.2% ---------------------------------------------------------------------------------- adopt-enode! [102] 4.7% loop! [95] 95.3% [114] 100046(4.4%) 30272(1.3%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [128] 61.4% for-loop [129] 8.3% ---------------------------------------------------------------------------------- new-enode [94] 5.3% loop! [95] 94.7% [115] 58434(2.6%) 58434(2.6%) set ...collects/racket/private/set-types.rkt:981:0 ---------------------------------------------------------------------------------- ??? [100] 100.0% [116] 11180(0.5%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [130] 73.4% loop [140] 26.6% ---------------------------------------------------------------------------------- rewriter [104] 100.0% [117] 4310(0.2%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [131] 100.0% ---------------------------------------------------------------------------------- add-splitpoint [105] 100.0% [118] 3338(0.1%) 1028(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [132] 69.2% ---------------------------------------------------------------------------------- update-leader! [74] 20.6% mk-enode! [73] 39.5% new-enode [94] 40.0% [119] 3324(0.1%) 2978(0.1%) mutable-set .../racket/private/set-types.rkt:999:0 for-loop [133] 10.4% ---------------------------------------------------------------------------------- ??? [103] 100.0% [120] 1996(0.1%) 1350(0.1%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ??? [137] 32.4% ---------------------------------------------------------------------------------- rewriter [104] 100.0% [121] 1988(0.1%) 324(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [194] 83.7% ---------------------------------------------------------------------------------- custom-set-union! [107] 100.0% [122] 1018(0.0%) 1018(0.0%) for-loop ...cts/racket/private/set-types.rkt:253:4 ---------------------------------------------------------------------------------- for-loop [134] 50.0% rewriter [104] 50.0% [123] 346(0.0%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [134] 100.0% ---------------------------------------------------------------------------------- for-loop [135] 50.0% for-loop [109] 50.0% [124] 312(0.0%) 0(0.0%) pattern-match ...testing/src/core/matcher.rkt:48:0 for-loop [135] 50.0% ??? [137] 50.0% ---------------------------------------------------------------------------------- type-of-enode-expr [111] 100.0% [125] 381682(16.9%) 7336(0.3%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [172] 38.9% ??? [171] 32.5% ??? [137] 15.0% ...sting/src/common.rkt:47:2 [173] 11.7% ---------------------------------------------------------------------------------- for-loop [113] 100.0% [126] 167774(7.4%) 3408(0.2%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [138] 98.0% ---------------------------------------------------------------------------------- sidx->spoint [112] 100.0% [127] 132852(5.9%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [136] 100.0% ---------------------------------------------------------------------------------- custom-set-union [114] 100.0% [128] 61446(2.7%) 20628(0.9%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [139] 66.4% ---------------------------------------------------------------------------------- custom-set-union [114] 100.0% [129] 8328(0.4%) 8328(0.4%) for-loop ...cts/racket/private/set-types.rkt:152:2 ---------------------------------------------------------------------------------- generic-sort/key [116] 41.2% copying-mergesort [130] 58.8% [130] 8206(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [130] 58.8% loop [140] 29.8% jloop [141] 11.4% ---------------------------------------------------------------------------------- matcher [131] 19.5% for-loop [142] 30.5% for-loop [117] 50.0% [131] 4310(0.2%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [104] 50.0% for-loop [142] 30.5% matcher [131] 19.5% ---------------------------------------------------------------------------------- for-loop [118] 100.0% [132] 2310(0.1%) 1618(0.1%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [250] 30.0% ---------------------------------------------------------------------------------- mutable-set [119] 100.0% [133] 346(0.0%) 346(0.0%) for-loop ...cts/racket/private/set-types.rkt:943:2 ---------------------------------------------------------------------------------- expression->type [123] 100.0% [134] 346(0.0%) 0(0.0%) for-loop ...ie/alt-testing/src/type-check.rkt:52:5 expression->type [123] 50.0% f6 [45] 50.0% ---------------------------------------------------------------------------------- pattern-match [124] 100.0% [135] 312(0.0%) 0(0.0%) for-loop .../alt-testing/src/core/matcher.rkt:66:9 pattern-match [124] 100.0% ---------------------------------------------------------------------------------- sidx->spoint [112] 29.2% binary-search-floats [127] 70.8% [136] 187754(8.3%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 loop [144] 68.1% prepare-points [143] 31.4% errors [237] 0.6% ---------------------------------------------------------------------------------- split-table [32] 0.2% pattern-match [124] 0.2% for-loop [120] 0.3% f6 [45] 0.4% ??? [269] 1.6% substitute-e [59] 4.4% choose-best-alt! [51] 4.8% variable? [98] 14.8% match-e [44] 18.5% finalize-iter! [48] 23.9% get-sigs [125] 31.0% [137] 184960(8.2%) 57832(2.6%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [146] 39.2% for-loop [147] 23.7% atab-pick-alt8 [148] 4.8% ??? [269] 0.8% split-atab [150] 0.2% ---------------------------------------------------------------------------------- hash-update! [126] 100.0% [138] 164366(7.3%) 948(0.0%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [145] 99.2% make-sequence [149] 0.2% ---------------------------------------------------------------------------------- for-loop [128] 100.0% [139] 40818(1.8%) 40818(1.8%) for-loop ...cts/racket/private/set-types.rkt:178:5 ---------------------------------------------------------------------------------- ??? [100] 8.4% generic-sort/key [116] 36.7% copying-mergesort [130] 54.9% [140] 8102(0.4%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [4] 87.8% ??? [166] 12.2% ---------------------------------------------------------------------------------- copying-mergesort [130] 100.0% [141] 3756(0.2%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [4] 100.0% ---------------------------------------------------------------------------------- matcher [131] 100.0% [142] 3288(0.1%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [131] 100.0% ---------------------------------------------------------------------------------- run-improve50 [2] 3.7% pred [136] 19.9% ??? [72] 76.4% [143] 295578(13.1%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [160] 51.9% make-exacts* [159] 32.1% loop [151] 15.9% for-loop [154] 0.1% ---------------------------------------------------------------------------------- run-improve50 [2] 2.4% ??? [72] 45.2% pred [136] 52.4% [144] 243724(10.8%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 make-exacts* [159] 63.9% loop [151] 20.0% loop [160] 15.2% for-loop [154] 0.8% ---------------------------------------------------------------------------------- ??? [138] 100.0% [145] 163062(7.2%) 139532(6.2%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [204] 14.4% ---------------------------------------------------------------------------------- mk-enode! [73] 9.7% ??? [137] 90.3% [146] 80874(3.6%) 25588(1.1%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [178] 66.2% ??? [185] 2.2% ---------------------------------------------------------------------------------- ??? [137] 100.0% [147] 44588(2.0%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:52:2 atab-add-altn [152] 100.0% ---------------------------------------------------------------------------------- ??? [137] 100.0% [148] 8898(0.4%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:61:0 point-best-alt [153] 59.5% ??? [166] 25.8% for-loop [155] 11.1% for-loop [157] 3.6% ---------------------------------------------------------------------------------- ??? [138] 8.0% update-leader! [74] 16.0% for-loop [31] 21.2% merge-egraph-nodes! [56] 54.8% [149] 4436(0.2%) 3740(0.2%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [156] 15.7% ---------------------------------------------------------------------------------- ??? [137] 100.0% [150] 298(0.0%) 0(0.0%) split-atab ...testing/src/core/alt-table.rkt:109:0 for-loop [158] 100.0% ---------------------------------------------------------------------------------- prepare-points [143] 49.0% loop [144] 51.0% [151] 95810(4.3%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [159] 59.1% loop [160] 40.9% ---------------------------------------------------------------------------------- for-loop [147] 99.2% [152] 44926(2.0%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:243:0 best-and-tied-at-points [161] 85.2% override-at-pnts [162] 14.1% ---------------------------------------------------------------------------------- atab-pick-alt8 [148] 100.0% [153] 5298(0.2%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:55:0 loop [225] 100.0% ---------------------------------------------------------------------------------- prepare-points [143] 14.5% loop [144] 85.5% [154] 2258(0.1%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [163] 100.0% ---------------------------------------------------------------------------------- atab-pick-alt8 [148] 100.0% [155] 990(0.0%) 656(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:81:2 debug-print [222] 33.7% ---------------------------------------------------------------------------------- make-sequence [149] 100.0% [156] 696(0.0%) 696(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 ---------------------------------------------------------------------------------- atab-pick-alt8 [148] 100.0% [157] 318(0.0%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:88:2 debug-print [222] 100.0% ---------------------------------------------------------------------------------- split-atab [150] 100.0% [158] 298(0.0%) 0(0.0%) for-loop ...t-testing/src/core/alt-table.rkt:110:2 for-loop [164] 100.0% ---------------------------------------------------------------------------------- loop [151] 18.4% prepare-points [143] 30.8% loop [144] 50.7% [159] 307204(13.6%) 324(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [165] 62.5% loop [225] 37.4% ---------------------------------------------------------------------------------- loop [144] 16.2% loop [151] 17.0% prepare-points [143] 66.8% [160] 229840(10.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [225] 96.7% ??? [4] 3.3% ---------------------------------------------------------------------------------- atab-add-altn [152] 100.0% [161] 38266(1.7%) 334(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:157:0 errors [237] 94.5% for-loop [168] 4.6% ---------------------------------------------------------------------------------- atab-add-altn [152] 100.0% [162] 6346(0.3%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:180:0 errors [237] 94.5% for-loop [169] 5.5% ---------------------------------------------------------------------------------- for-loop [154] 100.0% [163] 2258(0.1%) 330(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [166] 70.9% for-loop [170] 14.5% ---------------------------------------------------------------------------------- for-loop [158] 100.0% [164] 298(0.0%) 0(0.0%) for-loop ...-testing/src/core/alt-table.rkt:115:53 loop [167] 100.0% ---------------------------------------------------------------------------------- errors [237] 6.5% make-exacts* [159] 93.5% [165] 205222(9.1%) 7422(0.3%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 hash-ref! [188] 91.4% f6 [45] 4.5% ---------------------------------------------------------------------------------- map [64] 0.7% ??? [242] 0.8% loop [96] 0.8% loop [183] 1.1% loop [140] 2.3% ??? [163] 3.7% loop [225] 5.0% atab-pick-alt8 [148] 5.3% ??? [206] 6.6% for-loop [247] 8.6% ??? [171] 13.0% for-loop [99] 13.0% ??? [4] 18.6% f6 [45] 20.6% [166] 43100(1.9%) 3894(0.2%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [171] 52.4% approximate9 [174] 12.6% ??? [269] 8.0% hash-ref! [188] 7.6% best-alt [175] 5.3% ...sting/src/common.rkt:47:2 [173] 3.1% ??? [172] 1.5% simplify [205] 0.4% ---------------------------------------------------------------------------------- for-loop [164] 11.4% match-e [44] 12.7% one-iter [16] 75.9% [167] 2604(0.1%) 2306(0.1%) loop ...ket/collects/racket/private/list.rkt:264:4 ??? [176] 11.4% ---------------------------------------------------------------------------------- best-and-tied-at-points [161] 100.0% [168] 1752(0.1%) 1752(0.1%) for-loop ...-testing/src/core/alt-table.rkt:159:16 ---------------------------------------------------------------------------------- override-at-pnts [162] 100.0% [169] 350(0.0%) 350(0.0%) for-loop ...-testing/src/core/alt-table.rkt:181:43 ---------------------------------------------------------------------------------- ??? [163] 100.0% [170] 328(0.0%) 328(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:231:9 ---------------------------------------------------------------------------------- simplify-alt [38] 0.1% ??? [166] 1.5% get-sigs [125] 2.5% for-loop [58] 3.0% ??? [171] 6.8% for-loop [177] 39.9% ??? [72] 46.0% [171] 1621074(71.9%) 79296(3.5%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [177] 39.9% iterate-egraph!13 [3] 39.7% ??? [171] 6.8% loop [5] 6.3% ??? [178] 3.7% ??? [166] 0.5% return/no-unsupplied [266] 0.3% ??? [265] 0.2% mk-egraph [184] 0.2% ??? [189] 0.1% dict? [273] 0.0% *simplify-rules* [187] 0.0% ??? [185] 0.0% ---------------------------------------------------------------------------------- ??? [166] 0.4% f6 [45] 1.0% for-loop [58] 4.5% get-sigs [125] 94.1% [172] 157888(7.0%) 11042(0.5%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [180] 42.9% for-loop [179] 40.4% get/build-late-neg-projection [226] 8.5% coerce-contract [221] 0.6% ??? [208] 0.4% ---------------------------------------------------------------------------------- f6 [45] 0.3% ??? [166] 1.3% get-sigs [125] 45.1% for-loop [58] 53.2% [173] 98858(4.4%) 27410(1.2%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [181] 37.5% ??? [182] 33.8% coerce-contract [221] 1.0% ---------------------------------------------------------------------------------- ??? [166] 100.0% [174] 14172(0.6%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [183] 74.3% f6 [45] 18.8% taylor-quotient [67] 4.7% listof [210] 2.2% ---------------------------------------------------------------------------------- ??? [166] 100.0% [175] 2292(0.1%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 loop [186] 100.0% ---------------------------------------------------------------------------------- loop [167] 100.0% [176] 298(0.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:302:4 ??? [242] 100.0% ---------------------------------------------------------------------------------- ??? [171] 100.0% [177] 1367220(60.7%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [171] 100.0% ---------------------------------------------------------------------------------- hash-has-key? [146] 23.5% ??? [171] 76.5% [178] 228138(10.1%) 97594(4.3%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [190] 42.7% ??? [203] 13.6% ??? [189] 0.8% arrow-higher-order:lnp [198] 0.1% ---------------------------------------------------------------------------------- for-loop [190] 24.1% ??? [172] 75.9% [179] 84018(3.7%) 15250(0.7%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [189] 79.5% ??? [219] 2.4% ---------------------------------------------------------------------------------- ??? [172] 100.0% [180] 67670(3.0%) 2956(0.1%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [191] 95.6% ---------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [173] 100.0% [181] 37042(1.6%) 9566(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [265] 33.0% assoc-ref [192] 22.6% return/no-unsupplied [266] 18.5% ---------------------------------------------------------------------------------- for-loop [207] 7.6% ??? [189] 17.2% ...sting/src/common.rkt:47:2 [173] 75.2% [182] 33396(1.5%) 7954(0.4%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [189] 62.2% ??? [269] 17.4% ??? [208] 4.0% ---------------------------------------------------------------------------------- approximate9 [174] 100.0% [183] 10530(0.5%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 hash-ref! [188] 80.5% ??? [166] 13.3% get-coeffs [196] 6.3% ---------------------------------------------------------------------------------- ??? [171] 100.0% [184] 6490(0.3%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [193] 90.2% mk-enode! [73] 9.8% ---------------------------------------------------------------------------------- ??? [171] 46.6% hash-has-key? [146] 53.4% [185] 3268(0.1%) 3268(0.1%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ---------------------------------------------------------------------------------- extract-alt [40] 21.9% best-alt [175] 78.1% [186] 2934(0.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [195] 77.5% errors-score [197] 22.5% ---------------------------------------------------------------------------------- ??? [171] 100.0% [187] 680(0.0%) 314(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 for-loop [194] 53.8% ---------------------------------------------------------------------------------- simplify* [90] 0.0% for-loop [28] 0.0% for-loop [41] 0.0% ??? [39] 0.1% for-loop [231] 0.1% for-loop [24] 0.1% for-loop [37] 0.2% ??? [206] 0.3% ??? [7] 0.3% update-leader! [74] 0.3% for-loop [22] 0.3% first-nonzero-exp [89] 0.3% loop [183] 0.6% ??? [166] 0.7% ??? [88] 0.9% for-loop [21] 1.3% compile [81] 4.2% ??? [200] 4.2% eval-prog [165] 31.2% loop [225] 53.5% [188] 221456(9.8%) 17704(0.8%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [200] 58.3% bigfloat-hash [199] 31.1% ??? [6] 1.3% simplify [205] 1.3% parse-loop145 [217] 1.0% ??? [206] 0.9% ??? [7] 0.4% ??? [8] 0.4% ??? [9] 0.2% f6 [45] 0.2% ??? [10] 0.1% ??? [11] 0.0% ??? [12] 0.0% ---------------------------------------------------------------------------------- ??? [178] 1.9% ??? [171] 3.2% ??? [182] 28.4% for-loop [179] 65.4% [189] 102100(4.5%) 17828(0.8%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [201] 61.5% ??? [182] 11.2% for-loop [207] 7.9% ??? [219] 1.6% ??? [269] 0.4% ---------------------------------------------------------------------------------- ??? [178] 100.0% [190] 97338(4.3%) 49316(2.2%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [203] 26.9% for-loop [179] 20.8% ??? [208] 1.7% ---------------------------------------------------------------------------------- ??? [180] 100.0% [191] 64714(2.9%) 1970(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [202] 97.0% ---------------------------------------------------------------------------------- ??? [181] 100.0% [192] 8370(0.4%) 8370(0.4%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ---------------------------------------------------------------------------------- mk-egraph [184] 38.6% mk-enode-rec! [193] 61.4% [193] 5856(0.3%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [193] 61.4% mk-enode! [73] 36.7% curried [250] 1.9% ---------------------------------------------------------------------------------- *simplify-rules* [187] 9.8% *rules* [121] 44.5% merge-egraph-nodes! [56] 45.7% [194] 3740(0.2%) 1362(0.1%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 update-en-expr [204] 27.4% loop [209] 17.9% flag-set? [223] 9.3% ormap [211] 9.0% ---------------------------------------------------------------------------------- argmins [54] 10.0% f6 [45] 27.1% loop [186] 63.0% [195] 3612(0.2%) 354(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [237] 72.9% f6 [45] 17.3% ---------------------------------------------------------------------------------- loop [183] 100.0% [196] 660(0.0%) 0(0.0%) get-coeffs ...alt-testing/src/core/taylor.rkt:64:2 listof [210] 50.6% build--> [212] 49.4% ---------------------------------------------------------------------------------- loop [186] 100.0% [197] 660(0.0%) 336(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 loop [225] 49.1% ---------------------------------------------------------------------------------- ??? [178] 100.0% [198] 300(0.0%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [213] 100.0% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [199] 186526(8.3%) 1380(0.1%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [214] 94.2% sig+exp->bigfloat [218] 4.7% bigfloat->sig+exp [229] 0.2% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [200] 181174(8.0%) 3004(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [225] 91.9% hash-ref! [188] 7.4% ---------------------------------------------------------------------------------- ??? [189] 100.0% [201] 62748(2.8%) 5638(0.3%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [269] 86.9% ??? [219] 4.2% ---------------------------------------------------------------------------------- ??? [191] 100.0% [202] 62744(2.8%) 3328(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [215] 94.7% ---------------------------------------------------------------------------------- for-loop [190] 45.8% ??? [178] 54.2% [203] 57172(2.5%) 28590(1.3%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [216] 50.0% ---------------------------------------------------------------------------------- for-loop [97] 0.5% for-loop [194] 1.8% update-leader! [74] 2.3% for-loop [77] 15.4% loop! [95] 38.6% for-loop [145] 41.4% [204] 56854(2.5%) 56140(2.5%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ---------------------------------------------------------------------------------- taylor-invert [13] 2.4% ??? [166] 2.6% taylor-quotient [67] 2.7% hash-ref! [188] 92.3% [205] 12846(0.6%) 332(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f6 [45] 56.1% parse-loop145 [217] 31.2% make-multiplication-node [230] 5.3% debug-print [222] 2.5% debug7 [224] 2.4% ---------------------------------------------------------------------------------- hash-ref! [188] 100.0% [206] 8474(0.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [166] 74.9% hash-ref! [188] 25.1% ---------------------------------------------------------------------------------- ??? [189] 100.0% [207] 8086(0.4%) 3024(0.1%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [182] 62.6% ---------------------------------------------------------------------------------- ??? [172] 18.2% ??? [182] 37.2% for-loop [190] 44.6% [208] 3620(0.2%) 1000(0.0%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [220] 72.4% ---------------------------------------------------------------------------------- for-loop [194] 100.0% [209] 670(0.0%) 0(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [223] 100.0% ---------------------------------------------------------------------------------- approximate9 [174] 48.1% get-coeffs [196] 51.9% [210] 644(0.0%) 310(0.0%) listof .../racket/contract/private/guts.rkt:411:15 coerce-contract [221] 51.9% ---------------------------------------------------------------------------------- for-loop [194] 100.0% [211] 336(0.0%) 336(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 ---------------------------------------------------------------------------------- get-coeffs [196] 100.0% [212] 326(0.0%) 326(0.0%) build--> ...ract/private/arrow-val-first.rkt:924:0 ---------------------------------------------------------------------------------- arrow-higher-order:lnp [198] 100.0% [213] 300(0.0%) 300(0.0%) ??? ...et/contract/private/arity-checking.rkt:19:2 ---------------------------------------------------------------------------------- bigfloat-hash [199] 100.0% [214] 175668(7.8%) 173586(7.7%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 bigfloat->sig+exp [229] 1.2% ---------------------------------------------------------------------------------- ??? [202] 100.0% [215] 59416(2.6%) 14910(0.7%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [227] 42.3% get/build-late-neg-projection [226] 32.6% ---------------------------------------------------------------------------------- ??? [203] 100.0% [216] 28582(1.3%) 28582(1.3%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ---------------------------------------------------------------------------------- type-of-enode-expr [111] 5.6% loop [225] 6.5% for-loop [26] 6.5% parse-loop145 [217] 11.4% simplify [205] 14.7% ??? [17] 15.9% map [64] 18.2% hash-ref! [188] 21.1% [217] 12734(0.6%) 7710(0.3%) parse-loop145 .../racket/match/compiler.rkt:418:15 loop [225] 26.7% parse-loop145 [217] 11.4% f6 [45] 8.5% for-loop [231] 6.5% make-multiplication-node [230] 2.5% loop [96] 0.9% ??? [92] 0.8% map [64] 0.7% ---------------------------------------------------------------------------------- bigfloat-hash [199] 100.0% [218] 8814(0.4%) 8446(0.4%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 integer->mpz [233] 4.2% ---------------------------------------------------------------------------------- ??? [189] 18.7% for-loop [179] 23.3% ??? [17] 27.6% ??? [201] 30.4% [219] 8602(0.4%) 5290(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [228] 38.5% ---------------------------------------------------------------------------------- ??? [208] 100.0% [220] 2620(0.1%) 1326(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [232] 49.4% ---------------------------------------------------------------------------------- listof [210] 14.3% ??? [172] 42.6% ...sting/src/common.rkt:47:2 [173] 43.2% [221] 2340(0.1%) 2006(0.1%) coerce-contract ...contract/private/guts.rkt:257:0 coerce-contract/f4 [235] 14.3% ---------------------------------------------------------------------------------- for-loop [157] 19.2% simplify [205] 19.2% for-loop [155] 20.1% taylor [69] 41.6% [222] 1660(0.1%) 1302(0.1%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 for-loop [234] 21.6% ---------------------------------------------------------------------------------- for-loop [194] 34.1% loop [209] 65.9% [223] 1016(0.0%) 670(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ??? [265] 34.1% ---------------------------------------------------------------------------------- simplify [205] 47.3% iterate-egraph!13 [3] 52.7% [224] 656(0.0%) 0(0.0%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 ??? [265] 100.0% ---------------------------------------------------------------------------------- errors-score [197] 0.0% map [64] 0.0% parse-loop145 [217] 0.3% point-best-alt [153] 0.3% make-exacts* [159] 0.5% match-e [44] 0.7% option-on-expr [57] 0.7% for-loop [60] 0.8% loop [160] 1.0% loop! [95] 2.5% f6 [45] 11.1% ??? [200] 16.3% loop [225] 65.5% [225] 734350(32.6%) 18636(0.8%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [225] 65.5% hash-ref! [188] 16.3% option-on-expr [57] 11.1% loop! [95] 2.4% ??? [4] 1.5% errors [237] 1.1% foldl [241] 0.4% parse-loop145 [217] 0.2% curried [250] 0.1% ??? [88] 0.1% for-loop [240] 0.1% ??? [166] 0.0% ??? [242] 0.0% ??? [236] 0.0% ---------------------------------------------------------------------------------- ??? [239] 14.5% ??? [172] 25.7% for-loop [215] 59.1% [226] 32744(1.5%) 6044(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [238] 63.1% ??? [239] 20.7% ---------------------------------------------------------------------------------- for-loop [215] 100.0% [227] 25150(1.1%) 25150(1.1%) add-list-context ...ontract/private/list.rkt:752:0 ---------------------------------------------------------------------------------- ??? [219] 100.0% [228] 3312(0.1%) 1336(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [244] 59.7% ---------------------------------------------------------------------------------- bigfloat-hash [199] 13.2% bfcanonicalize [214] 86.8% [229] 2398(0.1%) 660(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:370:0 size+limbs->integer [245] 58.0% new-mpz [246] 14.5% ---------------------------------------------------------------------------------- parse-loop145 [217] 14.0% simplify [205] 29.3% map [64] 56.8% [230] 2308(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [243] 100.0% ---------------------------------------------------------------------------------- parse-loop145 [217] 100.0% [231] 1698(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:490:59 hash-ref! [188] 100.0% ---------------------------------------------------------------------------------- check-hash/c [220] 100.0% [232] 1294(0.1%) 1294(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 ---------------------------------------------------------------------------------- sig+exp->bigfloat [218] 100.0% [233] 368(0.0%) 368(0.0%) integer->mpz ...math/private/bigfloat/gmp.rkt:87:0 ---------------------------------------------------------------------------------- debug-print [222] 100.0% [234] 358(0.0%) 358(0.0%) for-loop ...herbie/alt-testing/src/debug.rkt:113:2 ---------------------------------------------------------------------------------- coerce-contract [221] 100.0% [235] 334(0.0%) 334(0.0%) coerce-contract/f4 ...tract/private/guts.rkt:299:0 ---------------------------------------------------------------------------------- loop [225] 0.5% bf* [34] 5.5% ??? [17] 93.9% [236] 311716(13.8%) 281698(12.5%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [248] 8.1% bfsin [252] 1.5% ---------------------------------------------------------------------------------- pred [136] 1.5% composed [195] 3.6% option-on-expr [57] 4.2% override-at-pnts [162] 8.2% loop [225] 33.0% best-and-tied-at-points [161] 49.5% [237] 73018(3.2%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [247] 80.9% eval-prog [165] 18.2% ---------------------------------------------------------------------------------- get/build-late-neg-projection [226] 100.0% [238] 24352(1.1%) 7144(0.3%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [249] 70.7% ---------------------------------------------------------------------------------- get/build-late-neg-projection [226] 100.0% [239] 11754(0.5%) 2014(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [226] 82.9% ---------------------------------------------------------------------------------- loop [225] 100.0% [240] 10058(0.4%) 2564(0.1%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [251] 50.4% curried [250] 14.1% curry* [253] 3.6% compose [256] 3.3% eval-const-expr [257] 3.1% ---------------------------------------------------------------------------------- for-loop [60] 40.8% loop [225] 59.2% [241] 5798(0.3%) 3068(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [254] 47.1% ---------------------------------------------------------------------------------- ??? [176] 11.6% for-loop [108] 26.2% loop [225] 62.3% [242] 2576(0.1%) 690(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [4] 60.3% ??? [166] 12.9% ---------------------------------------------------------------------------------- make-multiplication-node [230] 100.0% [243] 2308(0.1%) 356(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [255] 70.6% compose [256] 14.0% ---------------------------------------------------------------------------------- ??? [228] 100.0% [244] 1976(0.1%) 1976(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 ---------------------------------------------------------------------------------- bigfloat->sig+exp [229] 100.0% [245] 1390(0.1%) 1390(0.1%) size+limbs->integer ...vate/bigfloat/gmp.rkt:103:0 ---------------------------------------------------------------------------------- bigfloat->sig+exp [229] 100.0% [246] 348(0.0%) 348(0.0%) new-mpz ...-lib/math/private/bigfloat/gmp.rkt:73:0 ---------------------------------------------------------------------------------- errors [237] 100.0% [247] 59102(2.6%) 1944(0.1%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [4] 84.8% ??? [166] 6.3% ulp-difference [260] 5.6% ---------------------------------------------------------------------------------- ??? [236] 100.0% [248] 25262(1.1%) 18100(0.8%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [259] 28.4% ---------------------------------------------------------------------------------- contract-struct-name [258] 19.7% ??? [238] 80.3% [249] 17208(0.8%) 9086(0.4%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [258] 60.2% ---------------------------------------------------------------------------------- mk-enode-rec! [193] 6.3% for-loop [132] 13.4% loop [225] 20.1% for-loop [240] 27.5% for-loop [60] 32.7% [250] 5172(0.2%) 5172(0.2%) curried ...cket/collects/racket/function.rkt:71:18 ---------------------------------------------------------------------------------- for-loop [240] 100.0% [251] 5066(0.2%) 2692(0.1%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 for-loop [261] 46.9% ---------------------------------------------------------------------------------- ??? [236] 100.0% [252] 4756(0.2%) 3244(0.1%) bfsin ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [259] 31.8% ---------------------------------------------------------------------------------- for-loop [240] 9.6% gather-multiplicative-terms [70] 9.7% match-e [44] 17.3% for-loop [60] 63.4% [253] 3748(0.2%) 2032(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [262] 45.8% ---------------------------------------------------------------------------------- foldl [241] 100.0% [254] 2730(0.1%) 2730(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 ---------------------------------------------------------------------------------- make-multiplication-subnode [243] 100.0% [255] 1630(0.1%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:242:3 make-multiplication-subsubsubnode [263] 58.5% mterm->expr [267] 41.5% ---------------------------------------------------------------------------------- make-multiplication-subnode [243] 49.4% for-loop [240] 50.6% [256] 652(0.0%) 652(0.0%) compose ...collects/racket/private/list.rkt:385:12 ---------------------------------------------------------------------------------- for-loop [240] 100.0% [257] 316(0.0%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 ??? [264] 100.0% ---------------------------------------------------------------------------------- build-compound-type-name [249] 100.0% [258] 12594(0.6%) 8122(0.4%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [249] 44.7% ---------------------------------------------------------------------------------- bfsin [252] 13.3% real->bigfloat [36] 23.7% bfmul [248] 63.0% [259] 11362(0.5%) 11362(0.5%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ---------------------------------------------------------------------------------- for-loop [247] 100.0% [260] 3304(0.1%) 1674(0.1%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [266] 29.0% ??? [265] 20.3% ---------------------------------------------------------------------------------- setfindf [251] 100.0% [261] 2374(0.1%) 2374(0.1%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 ---------------------------------------------------------------------------------- curry* [253] 100.0% [262] 1716(0.1%) 1716(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ---------------------------------------------------------------------------------- for-loop [255] 100.0% [263] 954(0.0%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [267] 100.0% ---------------------------------------------------------------------------------- eval-const-expr [257] 100.0% [264] 316(0.0%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [268] 100.0% ---------------------------------------------------------------------------------- flag-set? [223] 1.4% debug7 [224] 2.7% ulp-difference [260] 2.7% ??? [35] 10.8% ??? [171] 32.6% ??? [181] 49.8% [265] 24596(1.1%) 4020(0.2%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [270] 65.5% ??? [269] 18.2% ---------------------------------------------------------------------------------- ulp-difference [260] 4.8% ??? [35] 8.4% ??? [181] 34.2% ??? [171] 52.7% [266] 20092(0.9%) 14876(0.7%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [271] 26.0% ---------------------------------------------------------------------------------- for-loop [255] 41.5% make-multiplication-subsubsubnode [263] 58.5% [267] 1630(0.1%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 f6 [45] 100.0% ---------------------------------------------------------------------------------- ??? [264] 49.5% ??? [72] 50.5% [268] 638(0.0%) 638(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 ---------------------------------------------------------------------------------- ??? [189] 0.5% ??? [137] 1.8% ??? [166] 4.5% ??? [265] 5.9% ??? [182] 15.2% ??? [201] 71.3% [269] 76402(3.4%) 61094(2.7%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [272] 13.0% ??? [137] 4.5% dict? [273] 2.5% ---------------------------------------------------------------------------------- ??? [110] 1.8% ??? [265] 98.2% [270] 16406(0.7%) 15770(0.7%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [274] 3.9% ---------------------------------------------------------------------------------- for-loop [31] 5.8% match-e [44] 11.0% return/no-unsupplied [266] 83.2% [271] 6272(0.3%) 6272(0.3%) filter ...t/collects/racket/private/list.rkt:256:2 ---------------------------------------------------------------------------------- ??? [269] 100.0% [272] 9952(0.4%) 9952(0.4%) contract? ...acket/contract/private/guts.rkt:109:0 ---------------------------------------------------------------------------------- ??? [269] 44.8% ??? [171] 55.2% [273] 4298(0.2%) 4298(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 ---------------------------------------------------------------------------------- ??? [270] 100.0% [274] 636(0.0%) 636(0.0%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ----------------------------------------------------------------------------------