Profiling results ----------------- Total cpu time observed: 1753532ms (out of 1768516ms) Number of samples taken: 5008 (once every 350ms) (Hiding functions with self<1.0% and local<2.0%: 19 of 275 hidden) ================================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ================================================================================= ??? [48] 100.0% [1] 1586376(90.5%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [13] 100.0% --------------------------------------------------------------------------------- ??? [48] 100.0% [2] 1063188(60.6%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:234:0 for-loop [14] 91.7% get-final-combination [17] 3.8% loop [52] 3.8% setup-alt-simplified [19] 0.5% prepare-points [53] 0.1% ??? [163] 0.1% --------------------------------------------------------------------------------- ??? [239] 0.1% loop [63] 0.3% jloop [249] 1.3% loop [248] 1.5% for-loop [218] 13.4% loop [179] 83.4% [3] 471478(26.9%) 4736(0.3%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [15] 93.7% ??? [64] 4.5% ??? [57] 0.8% ??? [252] 0.1% --------------------------------------------------------------------------------- hash-ref! [185] 100.0% [4] 143618(8.2%) 1344(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [179] 95.6% hash-ref! [185] 4.1% --------------------------------------------------------------------------------- ->flonum [79] 100.0% [5] 77970(4.4%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [16] 100.0% --------------------------------------------------------------------------------- pattern-substitute [99] 1.1% f137 [76] 2.2% substitute-e [111] 4.4% match-e [105] 92.3% [6] 31542(1.8%) 1322(0.1%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [163] 95.8% --------------------------------------------------------------------------------- ??? [57] 100.0% [7] 6562(0.4%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [18] 90.1% taylor-quotient [22] 5.1% f137 [76] 4.8% --------------------------------------------------------------------------------- hash-ref! [185] 100.0% [8] 3310(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [20] 100.0% --------------------------------------------------------------------------------- hash-ref! [185] 100.0% [9] 1650(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [185] 81.0% for-loop [23] 19.0% --------------------------------------------------------------------------------- rewriter [55] 100.0% [10] 1058(0.1%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [122] 100.0% --------------------------------------------------------------------------------- hash-ref! [185] 100.0% [11] 966(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [21] 100.0% --------------------------------------------------------------------------------- f137 [76] 100.0% [12] 318(0.0%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 debug7 [97] 100.0% --------------------------------------------------------------------------------- profile-thunk16 [1] 99.9% [13] 1587366(90.5%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [48] 100.0% --------------------------------------------------------------------------------- run-improve50 [2] 100.0% [14] 975192(55.6%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:249:10 run-iter! [24] 100.0% --------------------------------------------------------------------------------- ??? [3] 100.0% [15] 441728(25.2%) 145634(8.3%) ??? ...acket/collects/racket/private/kw.rkt:444:14 bf* [25] 27.3% ??? [184] 26.9% ??? [28] 4.8% ...higher-order.rkt:346:33 [29] 3.0% ??? [30] 2.2% parse-loop12 [203] 1.2% ??? [254] 0.9% --------------------------------------------------------------------------------- loop [5] 100.0% [16] 77970(4.4%) 338(0.0%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [26] 98.7% --------------------------------------------------------------------------------- run-improve50 [2] 100.0% [17] 40496(2.3%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:264:0 split-table [27] 96.7% extract-alt [32] 3.3% --------------------------------------------------------------------------------- approximate9 [7] 100.0% [18] 5912(0.3%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 ??? [57] 100.0% --------------------------------------------------------------------------------- run-improve50 [2] 100.0% [19] 5092(0.3%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [31] 100.0% --------------------------------------------------------------------------------- ??? [8] 100.0% [20] 3310(0.2%) 314(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [185] 90.5% --------------------------------------------------------------------------------- ??? [11] 100.0% [21] 966(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [33] 100.0% --------------------------------------------------------------------------------- approximate9 [7] 100.0% [22] 332(0.0%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 simplify [204] 100.0% --------------------------------------------------------------------------------- ??? [9] 100.0% [23] 314(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [185] 100.0% --------------------------------------------------------------------------------- for-loop [14] 100.0% [24] 975192(55.6%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:215:0 simplify! [34] 92.2% finalize-iter! [35] 5.4% choose-best-alt! [38] 1.2% gen-series! [39] 0.6% gen-rewrites! [41] 0.3% localize-error [42] 0.2% --------------------------------------------------------------------------------- ??? [15] 100.0% [25] 120660(6.9%) 646(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [184] 99.5% --------------------------------------------------------------------------------- pass [16] 100.0% [26] 76994(4.4%) 332(0.0%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [36] 66.3% loop [37] 25.6% for-loop [40] 6.5% make-sequence [208] 1.2% --------------------------------------------------------------------------------- get-final-combination [17] 100.0% [27] 39148(2.2%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f137 [76] 100.0% --------------------------------------------------------------------------------- ??? [15] 100.0% [28] 21020(1.2%) 10134(0.6%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [151] 28.5% return/no-unsupplied [152] 23.3% --------------------------------------------------------------------------------- ??? [15] 100.0% [29] 13160(0.8%) 3112(0.2%) ...higher-order.rkt:346:33 (unknown source) ??? [149] 73.8% ??? [160] 2.5% --------------------------------------------------------------------------------- ??? [15] 100.0% [30] 9708(0.6%) 9708(0.6%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 --------------------------------------------------------------------------------- setup-alt-simplified [19] 100.0% [31] 5092(0.3%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ->flonum [79] 100.0% --------------------------------------------------------------------------------- get-final-combination [17] 100.0% [32] 1348(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 loop [72] 75.7% argmins [74] 24.3% --------------------------------------------------------------------------------- for-loop [21] 100.0% [33] 966(0.1%) 330(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [185] 65.8% --------------------------------------------------------------------------------- run-iter! [24] 100.0% [34] 899126(51.3%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:155:0 for-loop [43] 100.0% --------------------------------------------------------------------------------- run-iter! [24] 100.0% [35] 53076(3.0%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:169:0 ??? [163] 100.0% --------------------------------------------------------------------------------- for-loop [26] 100.0% [36] 51040(2.9%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [44] 90.1% expression-cost [45] 9.9% --------------------------------------------------------------------------------- for-loop [26] 100.0% [37] 19704(1.1%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [44] 85.1% expression-cost [45] 14.9% --------------------------------------------------------------------------------- run-iter! [24] 100.0% [38] 11944(0.7%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:115:0 ??? [163] 100.0% --------------------------------------------------------------------------------- run-iter! [24] 100.0% [39] 6238(0.4%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:129:0 for-loop [46] 100.0% --------------------------------------------------------------------------------- for-loop [26] 100.0% [40] 5002(0.3%) 5002(0.3%) for-loop ...t-testing/src/core/simplify.rkt:217:13 --------------------------------------------------------------------------------- run-iter! [24] 100.0% [41] 3096(0.2%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:142:0 for-loop [47] 100.0% --------------------------------------------------------------------------------- run-iter! [24] 100.0% [42] 1712(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [185] 79.2% ??? [221] 20.8% --------------------------------------------------------------------------------- simplify! [34] 100.0% [43] 899126(51.3%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:159:6 ??? [48] 100.0% --------------------------------------------------------------------------------- loop [37] 26.7% argmin [36] 73.3% [44] 62780(3.6%) 2220(0.1%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ->flonum [79] 70.3% ...sting/src/common.rkt:47:2 [144] 23.6% ??? [142] 2.6% --------------------------------------------------------------------------------- loop [37] 36.8% argmin [36] 63.2% [45] 7964(0.5%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [49] 100.0% --------------------------------------------------------------------------------- gen-series! [39] 100.0% [46] 6238(0.4%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:135:7 taylor-alt [50] 100.0% --------------------------------------------------------------------------------- gen-rewrites! [41] 100.0% [47] 3096(0.2%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:147:11 ??? [51] 100.0% --------------------------------------------------------------------------------- for-loop [43] 17.4% run [13] 37.4% [48] 1720672(98.1%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 37.4% ->flonum [79] 24.7% run-improve50 [2] 22.3% loop [52] 14.7% prepare-points [53] 0.9% --------------------------------------------------------------------------------- expression-cost [45] 100.0% [49] 7964(0.5%) 1002(0.1%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [185] 87.4% --------------------------------------------------------------------------------- for-loop [46] 100.0% [50] 6238(0.4%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [54] 100.0% --------------------------------------------------------------------------------- for-loop [47] 100.0% [51] 3096(0.2%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [55] 88.4% loop [179] 11.6% --------------------------------------------------------------------------------- run-improve50 [2] 7.5% ??? [48] 92.5% [52] 542716(30.9%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 loop [56] 46.3% make-exacts* [62] 28.6% loop [63] 24.6% for-loop [59] 0.4% ??? [66] 0.1% filter-points [61] 0.1% --------------------------------------------------------------------------------- run-improve50 [2] 4.1% ??? [48] 95.9% [53] 31292(1.8%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 make-exacts* [62] 37.3% loop [56] 31.4% loop [63] 30.2% for-loop [59] 1.1% --------------------------------------------------------------------------------- taylor-alt [50] 100.0% [54] 6238(0.4%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [57] 100.0% --------------------------------------------------------------------------------- ??? [51] 33.5% matcher [67] 66.5% [55] 2736(0.2%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [58] 66.5% *rules* [10] 13.7% expression->type [60] 10.9% f137 [76] 8.8% --------------------------------------------------------------------------------- prepare-points [53] 3.8% loop [52] 96.2% [56] 261256(14.9%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [62] 72.7% loop [63] 27.3% --------------------------------------------------------------------------------- for-loop [85] 0.3% ??? [57] 0.3% loop [63] 0.5% ??? [215] 0.6% map [80] 1.1% loop [86] 1.7% ->flonum [79] 2.1% loop [18] 3.3% for-loop [54] 3.5% ??? [66] 3.6% for-loop [218] 3.7% atab-pick-alt8 [171] 4.1% ??? [3] 5.8% loop [179] 25.2% f137 [76] 43.6% [57] 61894(3.5%) 4950(0.3%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ->flonum [79] 48.5% ??? [160] 17.7% ??? [142] 6.1% ...sting/src/common.rkt:47:2 [144] 5.0% best-alt [65] 4.6% approximate9 [7] 3.8% hash-ref! [185] 3.3% ??? [64] 1.2% ??? [252] 0.6% ??? [57] 0.3% ??? [184] 0.3% arrow-higher-order:lnp [183] 0.3% --------------------------------------------------------------------------------- rewriter [55] 100.0% [58] 2736(0.2%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [67] 100.0% --------------------------------------------------------------------------------- prepare-points [53] 13.6% loop [52] 86.4% [59] 2466(0.1%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [66] 100.0% --------------------------------------------------------------------------------- for-loop [68] 33.4% rewriter [55] 66.6% [60] 718(0.0%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [68] 100.0% --------------------------------------------------------------------------------- loop [52] 100.0% [61] 324(0.0%) 0(0.0%) filter-points .../alt-testing/src/points.rkt:171:0 for-loop [69] 100.0% --------------------------------------------------------------------------------- prepare-points [53] 3.3% loop [52] 43.5% loop [56] 53.3% [62] 356734(20.3%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [179] 55.4% eval-prog [70] 44.6% --------------------------------------------------------------------------------- prepare-points [53] 4.4% loop [56] 33.3% loop [52] 62.3% [63] 214032(12.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [179] 99.2% ??? [3] 0.7% ??? [57] 0.1% --------------------------------------------------------------------------------- ??? [57] 3.3% ??? [3] 96.7% [64] 21846(1.2%) 340(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [71] 95.2% integer->bigfloat [75] 3.3% --------------------------------------------------------------------------------- ??? [57] 100.0% [65] 3354(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 loop [72] 79.1% argmins [74] 20.9% --------------------------------------------------------------------------------- loop [52] 15.5% for-loop [59] 84.5% [66] 2918(0.2%) 666(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [57] 77.2% --------------------------------------------------------------------------------- for-loop [73] 18.6% matcher [67] 31.4% for-loop [58] 50.0% [67] 2736(0.2%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [55] 50.0% matcher [67] 31.4% for-loop [73] 18.6% --------------------------------------------------------------------------------- expression->type [60] 100.0% [68] 718(0.0%) 0(0.0%) for-loop ...ie/alt-testing/src/type-check.rkt:52:5 f137 [76] 66.6% expression->type [60] 33.4% --------------------------------------------------------------------------------- filter-points [61] 100.0% [69] 324(0.0%) 324(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:174:4 --------------------------------------------------------------------------------- sindices->spoints [212] 0.2% sort-context-on-expr [201] 0.2% point->alt [225] 0.8% errors [196] 10.2% make-exacts* [62] 88.7% [70] 179358(10.2%) 4648(0.3%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 hash-ref! [185] 79.4% f137 [76] 17.7% ??? [227] 0.2% ??? [78] 0.2% --------------------------------------------------------------------------------- ??? [64] 100.0% [71] 20794(1.2%) 17032(1.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [217] 18.1% --------------------------------------------------------------------------------- extract-alt [32] 27.8% best-alt [65] 72.2% [72] 3674(0.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [77] 100.0% --------------------------------------------------------------------------------- matcher [67] 100.0% [73] 1686(0.1%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [67] 100.0% --------------------------------------------------------------------------------- extract-alt [32] 31.9% best-alt [65] 68.1% [74] 1028(0.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [77] 100.0% --------------------------------------------------------------------------------- ??? [64] 100.0% [75] 712(0.0%) 712(0.0%) integer->bigfloat ...ivate/bigfloat/mpfr.rkt:399:0 --------------------------------------------------------------------------------- free-variables [240] 0.1% approximate9 [7] 0.1% parse-loop12 [203] 0.2% loop [179] 0.3% append-map [82] 0.4% mterm->expr [107] 0.6% for-loop [68] 0.9% map [80] 1.2% rewriter [55] 1.3% eval-const-expr [206] 3.3% simplify [204] 3.7% eval-prog [70] 9.2% f137 [76] 31.7% split-table [27] 46.4% [76] 76668(4.4%) 1942(0.1%) f137 .../collects/racket/match/compiler.rkt:507:40 loop [179] 40.2% f137 [76] 31.7% ??? [57] 7.7% option-on-expr [187] 6.2% map [80] 4.8% ??? [81] 2.3% ??? [163] 1.9% ->flonum [79] 1.9% ??? [142] 1.1% append-map [82] 0.4% variable? [6] 0.1% taylor [12] 0.1% --------------------------------------------------------------------------------- argmins [74] 21.9% loop [72] 78.1% [77] 4702(0.3%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [196] 100.0% --------------------------------------------------------------------------------- eval-prog [70] 100.0% [78] 358(0.0%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [83] 100.0% --------------------------------------------------------------------------------- loop [86] 0.0% f137 [76] 0.1% simplify-alt [31] 0.2% for-loop [44] 1.4% get-sigs [139] 1.6% ??? [57] 2.8% ->flonum [79] 6.7% for-loop [85] 40.4% ??? [48] 46.3% [79] 1071250(61.1%) 42916(2.4%) ->flonum ...s/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [84] 43.9% for-loop [85] 40.5% ->flonum [79] 6.7% loop [5] 3.0% ??? [174] 2.3% return/no-unsupplied [152] 0.3% ??? [151] 0.3% loop [86] 0.2% ??? [88] 0.1% ??? [57] 0.1% mk-egraph [87] 0.1% ??? [149] 0.1% loop [91] 0.0% list-member? [109] 0.0% ??? [92] 0.0% --------------------------------------------------------------------------------- ??? [89] 6.2% parse-loop12 [203] 30.3% f137 [76] 63.5% [80] 5266(0.3%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 parse-loop12 [203] 43.6% f137 [76] 17.2% make-multiplication-node [90] 14.3% ??? [89] 12.6% ??? [57] 6.2% simplify* [226] 4.3% loop [179] 1.9% --------------------------------------------------------------------------------- f137 [76] 100.0% [81] 2308(0.1%) 356(0.0%) ??? ...tract/private/arrow-higher-order.rkt:336:46 ??? [160] 84.6% --------------------------------------------------------------------------------- f137 [76] 100.0% [82] 360(0.0%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 f137 [76] 87.5% free-variables [240] 12.5% --------------------------------------------------------------------------------- ??? [78] 100.0% [83] 358(0.0%) 358(0.0%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 --------------------------------------------------------------------------------- ->flonum [79] 100.0% [84] 955506(54.5%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [93] 98.7% map-enodes [94] 1.3% debug7 [97] 0.0% --------------------------------------------------------------------------------- ->flonum [79] 100.0% [85] 889320(50.7%) 312(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ->flonum [79] 99.9% ??? [57] 0.0% --------------------------------------------------------------------------------- loop [86] 28.7% ->flonum [79] 71.3% [86] 3948(0.2%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 ??? [57] 58.7% loop [86] 28.7% ->flonum [79] 12.6% --------------------------------------------------------------------------------- ->flonum [79] 100.0% [87] 2562(0.1%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [95] 100.0% --------------------------------------------------------------------------------- ->flonum [79] 100.0% [88] 1434(0.1%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:60:15 ??? [217] 100.0% --------------------------------------------------------------------------------- map [80] 18.3% loop [179] 81.7% [89] 1356(0.1%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [185] 89.9% map [80] 10.1% --------------------------------------------------------------------------------- map [80] 100.0% [90] 1306(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [96] 100.0% --------------------------------------------------------------------------------- ->flonum [79] 100.0% [91] 452(0.0%) 0(0.0%) loop ...ies/herbie/alt-testing/src/points.rkt:66:6 random-exp [98] 100.0% --------------------------------------------------------------------------------- ->flonum [79] 100.0% [92] 360(0.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:346:33 pattern-substitute [99] 100.0% --------------------------------------------------------------------------------- iterate-egraph!13 [84] 100.0% [93] 942912(53.8%) 5606(0.3%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [100] 85.3% for-loop [101] 14.0% filter [156] 0.0% --------------------------------------------------------------------------------- iterate-egraph!13 [84] 100.0% [94] 12258(0.7%) 0(0.0%) map-enodes ...lt-testing/src/core/egraph.rkt:140:0 loop [179] 97.4% for-loop [189] 2.6% --------------------------------------------------------------------------------- mk-enode-rec! [95] 46.4% mk-egraph [87] 53.6% [95] 2562(0.1%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode! [113] 53.6% mk-enode-rec! [95] 46.4% --------------------------------------------------------------------------------- make-multiplication-node [90] 100.0% [96] 1306(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [102] 75.0% group-by68 [103] 25.0% --------------------------------------------------------------------------------- taylor [12] 48.6% iterate-egraph!13 [84] 51.4% [97] 654(0.0%) 336(0.0%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 ??? [151] 48.6% --------------------------------------------------------------------------------- loop [91] 100.0% [98] 452(0.0%) 452(0.0%) random-exp ...bie/alt-testing/src/common.rkt:253:0 --------------------------------------------------------------------------------- ??? [92] 33.3% pattern-substitute [99] 66.7% [99] 360(0.0%) 0(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [99] 66.7% variable? [6] 33.3% --------------------------------------------------------------------------------- one-iter [93] 100.0% [100] 804360(45.9%) 3646(0.2%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [104] 79.8% match-e [105] 19.2% reduce-to-single! [106] 0.3% update-leader! [116] 0.2% --------------------------------------------------------------------------------- for-loop [101] 48.8% one-iter [93] 51.2% [101] 132004(7.5%) 29238(1.7%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [101] 48.8% match-e [105] 38.8% ??? [126] 0.1% --------------------------------------------------------------------------------- make-multiplication-subnode [96] 100.0% [102] 980(0.1%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:242:3 mterm->expr [107] 100.0% --------------------------------------------------------------------------------- make-multiplication-subnode [96] 100.0% [103] 326(0.0%) 326(0.0%) group-by68 ...acket/collects/racket/list.rkt:749:0 --------------------------------------------------------------------------------- for-loop [100] 100.0% [104] 642194(36.6%) 1296(0.1%) for-loop ...t-testing/src/core/simplify.rkt:148:10 list-member? [109] 27.8% merge-egraph-nodes! [110] 21.4% mk-enode! [113] 19.5% loop! [186] 17.3% substitute-e [111] 13.8% --------------------------------------------------------------------------------- for-loop [101] 32.3% for-loop [115] 33.6% for-loop [100] 34.1% [105] 256988(14.7%) 53074(3.0%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [108] 64.8% ??? [163] 5.7% for-loop [115] 4.4% variable? [6] 4.1% list-cartesian-product [117] 1.3% loop [179] 0.9% custom-in-set [238] 0.6% curry* [121] 0.4% --------------------------------------------------------------------------------- for-loop [100] 100.0% [106] 2654(0.2%) 990(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [112] 62.7% --------------------------------------------------------------------------------- for-loop [102] 100.0% [107] 980(0.1%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 f137 [76] 100.0% --------------------------------------------------------------------------------- match-e [105] 100.0% [108] 200556(11.4%) 56954(3.2%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [115] 59.2% list-cartesian-product [117] 10.8% loop [179] 8.2% curry* [121] 1.2% filter [156] 0.6% foldl [190] 0.3% curried [250] 0.3% --------------------------------------------------------------------------------- ->flonum [79] 0.2% for-loop [104] 99.8% [109] 178648(10.2%) 3050(0.2%) list-member? ...llects/racket/private/set.rkt:24:0 loop [114] 96.6% --------------------------------------------------------------------------------- for-loop [118] 7.5% merge-egraph-nodes! [110] 7.8% for-loop [104] 84.7% [110] 137354(7.8%) 3340(0.2%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [116] 38.9% loop! [186] 18.0% for-loop [119] 16.5% for-loop [118] 12.4% merge-egraph-nodes! [110] 7.8% enode-merge! [120] 2.9% for-loop [122] 1.0% make-sequence [208] 0.2% --------------------------------------------------------------------------------- substitute-e [111] 5.9% for-loop [104] 94.1% [111] 88748(5.1%) 3320(0.2%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [113] 88.5% substitute-e [111] 5.9% ??? [163] 2.5% variable? [6] 0.6% --------------------------------------------------------------------------------- reduce-to-single! [106] 100.0% [112] 1664(0.1%) 1664(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 --------------------------------------------------------------------------------- mk-enode-rec! [95] 1.2% substitute-e [111] 38.1% for-loop [104] 60.7% [113] 206186(11.8%) 15886(0.9%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [123] 89.3% hash-has-key? [169] 2.3% mutable-set [135] 0.6% --------------------------------------------------------------------------------- list-member? [109] 100.0% [114] 172650(9.8%) 172650(9.8%) loop (unknown source) --------------------------------------------------------------------------------- match-e [105] 10.9% for-loop [108] 89.1% [115] 165222(9.4%) 11386(0.6%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [105] 92.3% ??? [126] 2.2% --------------------------------------------------------------------------------- for-loop [100] 2.1% merge-egraph-nodes! [110] 97.9% [116] 62776(3.6%) 4322(0.2%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [124] 87.2% custom-set-union! [129] 2.1% update-en-expr [199] 1.6% make-sequence [208] 1.6% hash-ref! [185] 0.6% --------------------------------------------------------------------------------- match-e [105] 9.1% list-cartesian-product [117] 23.0% for-loop [108] 68.0% [117] 34878(2.0%) 27896(1.6%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [117] 23.0% for-loop [125] 15.7% --------------------------------------------------------------------------------- merge-egraph-nodes! [110] 100.0% [118] 28770(1.6%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [110] 74.8% loop! [186] 25.2% --------------------------------------------------------------------------------- merge-egraph-nodes! [110] 100.0% [119] 23188(1.3%) 19262(1.1%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [199] 16.9% --------------------------------------------------------------------------------- merge-egraph-nodes! [110] 100.0% [120] 4226(0.2%) 298(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [127] 77.1% custom-set-intersect! [130] 15.8% --------------------------------------------------------------------------------- match-e [105] 24.4% for-loop [108] 75.6% [121] 3890(0.2%) 1002(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [128] 74.2% --------------------------------------------------------------------------------- *rules* [10] 44.2% merge-egraph-nodes! [110] 55.8% [122] 2396(0.1%) 322(0.0%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 update-en-expr [199] 42.4% flag-set? [137] 15.4% loop [131] 15.3% ormap [132] 13.5% --------------------------------------------------------------------------------- mk-enode! [113] 100.0% [123] 184196(10.5%) 626(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [133] 97.8% set [198] 1.1% mutable-set [135] 0.2% --------------------------------------------------------------------------------- update-leader! [116] 100.0% [124] 54732(3.1%) 2000(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [134] 95.8% update-en-expr [199] 0.6% --------------------------------------------------------------------------------- list-cartesian-product [117] 100.0% [125] 6982(0.4%) 6982(0.4%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 --------------------------------------------------------------------------------- for-loop [101] 8.5% for-loop [115] 91.5% [126] 3920(0.2%) 2256(0.1%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [136] 42.4% --------------------------------------------------------------------------------- enode-merge! [120] 100.0% [127] 3260(0.2%) 1282(0.1%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [197] 60.7% --------------------------------------------------------------------------------- curry* [121] 100.0% [128] 2888(0.2%) 2888(0.2%) procedure-arity ...ket/private/norm-arity.rkt:7:27 --------------------------------------------------------------------------------- update-leader! [116] 100.0% [129] 1334(0.1%) 1012(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [138] 24.1% --------------------------------------------------------------------------------- enode-merge! [120] 100.0% [130] 668(0.0%) 668(0.0%) custom-set-intersect! ...ivate/set-types.rkt:269:0 --------------------------------------------------------------------------------- for-loop [122] 100.0% [131] 366(0.0%) 366(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 --------------------------------------------------------------------------------- for-loop [122] 100.0% [132] 324(0.0%) 0(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [137] 100.0% --------------------------------------------------------------------------------- new-enode [123] 100.0% [133] 180222(10.3%) 3302(0.2%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [139] 98.2% --------------------------------------------------------------------------------- for-loop [124] 100.0% [134] 52414(3.0%) 972(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [140] 98.1% --------------------------------------------------------------------------------- new-enode [123] 20.8% mk-enode! [113] 79.2% [135] 1666(0.1%) 1320(0.1%) mutable-set .../racket/private/set-types.rkt:999:0 for-loop [141] 20.8% --------------------------------------------------------------------------------- ??? [126] 100.0% [136] 1664(0.1%) 1664(0.1%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 --------------------------------------------------------------------------------- ormap [132] 46.8% for-loop [122] 53.2% [137] 692(0.0%) 324(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ??? [151] 53.2% --------------------------------------------------------------------------------- custom-set-union! [129] 100.0% [138] 322(0.0%) 322(0.0%) for-loop ...cts/racket/private/set-types.rkt:253:4 --------------------------------------------------------------------------------- type-of-enode-expr [133] 100.0% [139] 176920(10.1%) 3346(0.2%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [142] 42.9% ->flonum [79] 29.8% ...sting/src/common.rkt:47:2 [144] 12.8% ??? [163] 12.6% --------------------------------------------------------------------------------- for-loop [134] 100.0% [140] 51442(2.9%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [143] 100.0% --------------------------------------------------------------------------------- mutable-set [135] 100.0% [141] 346(0.0%) 346(0.0%) for-loop ...cts/racket/private/set-types.rkt:943:2 --------------------------------------------------------------------------------- for-loop [44] 2.0% f137 [76] 2.0% ??? [57] 4.5% get-sigs [139] 91.5% [142] 82980(4.7%) 3998(0.2%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 for-loop [146] 41.4% ??? [147] 41.3% get/build-late-neg-projection [161] 8.7% ??? [188] 1.7% ??? [191] 0.8% --------------------------------------------------------------------------------- hash-update! [140] 100.0% [143] 51442(2.9%) 2710(0.2%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [145] 94.7% --------------------------------------------------------------------------------- ??? [57] 7.9% for-loop [44] 36.1% get-sigs [139] 55.3% [144] 41074(2.3%) 13582(0.8%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [148] 35.4% ??? [159] 30.8% --------------------------------------------------------------------------------- ??? [143] 100.0% [145] 48732(2.8%) 37472(2.1%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [199] 23.1% --------------------------------------------------------------------------------- for-loop [181] 22.2% ??? [142] 77.8% [146] 44148(2.5%) 6280(0.4%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [149] 83.6% ??? [254] 2.2% --------------------------------------------------------------------------------- ??? [142] 100.0% [147] 34278(2.0%) 2170(0.1%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [150] 93.7% --------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [144] 100.0% [148] 14544(0.8%) 6888(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [151] 23.9% return/no-unsupplied [152] 17.1% assoc-ref [153] 11.6% --------------------------------------------------------------------------------- ->flonum [79] 2.7% ??? [174] 3.8% ...higher-order.rkt:346:33 [29] 15.8% ??? [159] 17.9% for-loop [146] 59.9% [149] 61612(3.5%) 15358(0.9%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [154] 55.6% ??? [159] 7.4% ??? [160] 5.4% for-loop [157] 4.9% ??? [254] 1.6% --------------------------------------------------------------------------------- ??? [147] 100.0% [150] 32108(1.8%) 2230(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [155] 93.1% --------------------------------------------------------------------------------- debug7 [97] 2.2% flag-set? [137] 2.6% ??? [148] 24.2% ->flonum [79] 29.4% ??? [28] 41.6% [151] 14368(0.8%) 3262(0.2%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [243] 64.1% ??? [160] 13.2% --------------------------------------------------------------------------------- ??? [148] 20.6% ->flonum [79] 39.0% ??? [28] 40.5% [152] 12118(0.7%) 8484(0.5%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [156] 30.0% --------------------------------------------------------------------------------- ??? [148] 100.0% [153] 1694(0.1%) 1694(0.1%) assoc-ref ...collects/racket/private/dict.rkt:56:0 --------------------------------------------------------------------------------- ??? [149] 100.0% [154] 34272(2.0%) 3258(0.2%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [160] 82.9% ??? [254] 7.6% --------------------------------------------------------------------------------- ??? [150] 100.0% [155] 29878(1.7%) 2310(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [158] 92.3% --------------------------------------------------------------------------------- one-iter [93] 5.5% for-loop [108] 33.1% return/no-unsupplied [152] 61.4% [156] 5916(0.3%) 5916(0.3%) filter ...t/collects/racket/private/list.rkt:256:2 --------------------------------------------------------------------------------- ??? [149] 100.0% [157] 3032(0.2%) 2004(0.1%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [159] 33.9% --------------------------------------------------------------------------------- ??? [155] 100.0% [158] 27568(1.6%) 7786(0.4%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [162] 44.6% get/build-late-neg-projection [161] 27.2% --------------------------------------------------------------------------------- for-loop [157] 4.1% ??? [149] 18.1% ...sting/src/common.rkt:47:2 [144] 77.8% [159] 12640(0.7%) 3340(0.2%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [149] 64.9% ??? [160] 14.2% ??? [191] 2.5% --------------------------------------------------------------------------------- ...higher-order.rkt:346:33 [29] 0.6% ??? [163] 3.2% ??? [151] 3.6% ??? [81] 3.7% ??? [149] 6.4% ??? [159] 6.8% ??? [57] 21.5% ??? [154] 54.2% [160] 52456(3.0%) 37296(2.1%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [163] 25.2% contract? [166] 2.5% --------------------------------------------------------------------------------- unconstrained-domain->-projection [167] 3.3% ??? [165] 16.8% ??? [142] 29.1% for-loop [158] 50.8% [161] 14758(0.8%) 2904(0.2%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [164] 56.6% ??? [165] 23.7% unconstrained-domain->-projection [167] 3.3% listof-late-neg-projection [168] 2.3% --------------------------------------------------------------------------------- for-loop [158] 100.0% [162] 12282(0.7%) 12282(0.7%) add-list-context ...ontract/private/list.rkt:752:0 --------------------------------------------------------------------------------- free-variables [240] 0.2% run-improve50 [2] 0.4% f137 [76] 1.5% substitute-e [111] 3.2% choose-best-alt! [38] 6.4% ??? [160] 6.5% get-sigs [139] 13.0% variable? [6] 17.4% match-e [105] 21.2% finalize-iter! [35] 30.1% [163] 171542(9.8%) 60380(3.4%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [170] 29.4% hash-has-key? [169] 27.0% atab-pick-alt8 [171] 6.4% atab-add-altns [173] 1.1% ??? [160] 1.0% --------------------------------------------------------------------------------- get/build-late-neg-projection [161] 100.0% [164] 10164(0.6%) 2276(0.1%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [172] 77.6% --------------------------------------------------------------------------------- get/build-late-neg-projection [161] 100.0% [165] 5984(0.3%) 1016(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [161] 83.0% --------------------------------------------------------------------------------- ??? [160] 100.0% [166] 1306(0.1%) 1306(0.1%) contract? ...acket/contract/private/guts.rkt:109:0 --------------------------------------------------------------------------------- get/build-late-neg-projection [161] 100.0% [167] 968(0.1%) 0(0.0%) unconstrained-domain->-projection ...rrow.rkt:60:0 get/build-late-neg-projection [161] 100.0% --------------------------------------------------------------------------------- get/build-late-neg-projection [161] 100.0% [168] 674(0.0%) 674(0.0%) listof-late-neg-projection ...ivate/list.rkt:162:0 --------------------------------------------------------------------------------- mk-enode! [113] 9.0% ??? [163] 91.0% [169] 53328(3.0%) 15802(0.9%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [174] 64.1% ??? [178] 6.3% --------------------------------------------------------------------------------- ??? [163] 100.0% [170] 51806(3.0%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:52:2 atab-add-altn [175] 100.0% --------------------------------------------------------------------------------- ??? [163] 100.0% [171] 11944(0.7%) 324(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:61:0 point-best-alt [176] 72.0% ??? [57] 25.3% --------------------------------------------------------------------------------- contract-struct-name [177] 12.9% ??? [164] 87.1% [172] 7888(0.4%) 4996(0.3%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [177] 49.5% --------------------------------------------------------------------------------- ??? [163] 100.0% [173] 1944(0.1%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:51:0 atab-add-altn [175] 100.0% --------------------------------------------------------------------------------- hash-has-key? [169] 34.8% ->flonum [79] 65.2% [174] 98284(5.6%) 42556(2.4%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [181] 40.1% ??? [188] 13.5% ??? [149] 2.4% arrow-higher-order:lnp [183] 0.7% --------------------------------------------------------------------------------- atab-add-altns [173] 3.6% for-loop [170] 96.4% [175] 53750(3.1%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:243:0 best-and-tied-at-points [180] 97.0% override-at-pnts [182] 3.0% --------------------------------------------------------------------------------- atab-pick-alt8 [171] 100.0% [176] 8600(0.5%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:55:0 loop [179] 100.0% --------------------------------------------------------------------------------- build-compound-type-name [172] 100.0% [177] 4924(0.3%) 2892(0.2%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [172] 41.3% --------------------------------------------------------------------------------- hash-has-key? [169] 100.0% [178] 3348(0.2%) 3348(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 --------------------------------------------------------------------------------- ??? [51] 0.0% map [80] 0.0% parse-loop12 [203] 0.1% map-enodes [94] 0.2% match-e [105] 0.4% point-best-alt [176] 0.6% option-on-expr [187] 0.8% for-loop [108] 1.0% loop [63] 1.2% make-exacts* [62] 1.2% loop! [186] 2.2% f137 [76] 3.2% ??? [4] 19.1% loop [179] 70.0% [179] 718244(41.0%) 19500(1.1%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [179] 70.0% hash-ref! [185] 19.1% option-on-expr [187] 3.2% ??? [3] 2.4% loop! [186] 2.0% errors [196] 1.4% foldl [190] 0.3% for-loop [189] 0.1% curried [250] 0.1% f137 [76] 0.1% ??? [89] 0.1% ??? [57] 0.0% set-precompute! [192] 0.0% ??? [184] 0.0% --------------------------------------------------------------------------------- atab-add-altn [175] 100.0% [180] 52134(3.0%) 318(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:157:0 errors [196] 99.4% --------------------------------------------------------------------------------- ??? [174] 100.0% [181] 39398(2.2%) 17888(1.0%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [188] 25.7% for-loop [146] 24.9% ??? [191] 3.1% --------------------------------------------------------------------------------- atab-add-altn [175] 100.0% [182] 1616(0.1%) 328(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:180:0 errors [196] 79.7% --------------------------------------------------------------------------------- ??? [57] 31.5% ??? [174] 68.5% [183] 1028(0.1%) 684(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [193] 33.5% --------------------------------------------------------------------------------- loop [179] 0.1% ??? [57] 0.1% ??? [15] 49.6% bf* [25] 50.1% [184] 239512(13.7%) 33948(1.9%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [194] 76.8% bfexp [200] 8.9% --------------------------------------------------------------------------------- simplify* [226] 0.1% for-loop [23] 0.1% for-loop [33] 0.1% localize-error [42] 0.2% update-leader! [116] 0.2% ??? [9] 0.3% ??? [89] 0.7% for-loop [20] 0.8% ??? [57] 1.3% compile [49] 1.7% ??? [4] 2.7% eval-prog [70] 26.5% loop [179] 64.2% [185] 156910(8.9%) 10940(0.6%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [4] 67.2% bigfloat-hash [195] 25.5% simplify [204] 1.1% parse-loop12 [203] 0.9% ??? [8] 0.8% ??? [9] 0.3% ??? [11] 0.2% --------------------------------------------------------------------------------- for-loop [118] 3.7% merge-egraph-nodes! [110] 16.2% loop [179] 28.2% for-loop [104] 51.9% [186] 154880(8.8%) 25222(1.4%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [197] 44.4% loop [179] 30.8% set [198] 11.5% update-en-expr [199] 4.5% --------------------------------------------------------------------------------- f137 [76] 12.8% loop [179] 87.2% [187] 39148(2.2%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [179] 38.1% sort-context-on-expr [201] 34.7% errors [196] 13.5% err-lsts->split-indices [207] 6.7% pick-errors [211] 3.6% sindices->spoints [212] 1.7% point->alt [225] 1.7% --------------------------------------------------------------------------------- ??? [142] 5.7% for-loop [181] 40.8% ??? [174] 53.5% [188] 24856(1.4%) 12858(0.7%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [202] 48.3% --------------------------------------------------------------------------------- map-enodes [94] 2.9% loop [179] 97.1% [189] 11030(0.6%) 2542(0.1%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [205] 39.1% eval-const-expr [206] 26.0% compose [213] 6.0% parse-app [214] 3.0% curried [250] 2.9% --------------------------------------------------------------------------------- for-loop [108] 22.1% loop [179] 77.9% [190] 4606(0.3%) 1972(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [209] 49.4% ??? [215] 7.8% --------------------------------------------------------------------------------- ??? [159] 14.6% ??? [142] 29.7% for-loop [181] 55.7% [191] 2210(0.1%) 634(0.0%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [210] 71.3% --------------------------------------------------------------------------------- loop [179] 100.0% [192] 640(0.0%) 330(0.0%) set-precompute! ...ing/src/core/simplify.rkt:193:0 make-sequence [208] 48.4% --------------------------------------------------------------------------------- arrow-higher-order:lnp [183] 100.0% [193] 344(0.0%) 344(0.0%) ??? ...et/contract/private/arity-checking.rkt:19:2 --------------------------------------------------------------------------------- ??? [184] 100.0% [194] 183970(10.5%) 125442(7.2%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [217] 31.8% --------------------------------------------------------------------------------- hash-ref! [185] 100.0% [195] 137672(7.9%) 2050(0.1%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [216] 76.1% sig+exp->bigfloat [220] 20.0% bigfloat->sig+exp [235] 2.4% --------------------------------------------------------------------------------- override-at-pnts [182] 1.5% composed [77] 5.4% option-on-expr [187] 6.1% loop [179] 27.1% best-and-tied-at-points [180] 59.8% [196] 86604(4.9%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [218] 78.9% eval-prog [70] 21.1% --------------------------------------------------------------------------------- adopt-enode! [127] 2.6% loop! [186] 97.4% [197] 77264(4.4%) 22692(1.3%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [219] 64.2% for-loop [222] 6.4% --------------------------------------------------------------------------------- new-enode [123] 5.3% loop! [186] 94.7% [198] 37816(2.2%) 37816(2.2%) set ...collects/racket/private/set-types.rkt:981:0 --------------------------------------------------------------------------------- for-loop [124] 1.0% for-loop [122] 3.2% update-leader! [116] 3.2% for-loop [119] 12.3% for-loop [145] 35.3% loop! [186] 45.0% [199] 31884(1.8%) 31562(1.8%) update-en-expr ...esting/src/core/egraph.rkt:212:0 --------------------------------------------------------------------------------- ??? [184] 100.0% [200] 21238(1.2%) 14092(0.8%) bfexp ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [217] 33.6% --------------------------------------------------------------------------------- option-on-expr [187] 100.0% [201] 13586(0.8%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [221] 97.5% eval-prog [70] 2.5% --------------------------------------------------------------------------------- ??? [188] 100.0% [202] 11998(0.7%) 11998(0.7%) make-keyword-procedure ...ket/private/kw.rkt:260:4 --------------------------------------------------------------------------------- parse-loop12 [203] 5.3% hash-ref! [185] 13.5% map [80] 27.8% ??? [15] 53.5% [203] 10072(0.6%) 6730(0.4%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 map [80] 18.1% loop [179] 11.6% parse-loop12 [203] 5.3% simplify* [226] 1.9% f137 [76] 1.8% loop [230] 0.7% --------------------------------------------------------------------------------- taylor-quotient [22] 5.9% hash-ref! [185] 94.1% [204] 5600(0.3%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f137 [76] 100.0% --------------------------------------------------------------------------------- for-loop [189] 100.0% [205] 4312(0.2%) 1264(0.1%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 for-loop [223] 70.7% --------------------------------------------------------------------------------- for-loop [189] 100.0% [206] 2864(0.2%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f137 [76] 88.5% ??? [227] 11.5% --------------------------------------------------------------------------------- option-on-expr [187] 100.0% [207] 2630(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [224] 100.0% --------------------------------------------------------------------------------- set-precompute! [192] 12.2% merge-egraph-nodes! [110] 12.2% for-loop [26] 35.9% update-leader! [116] 39.6% [208] 2548(0.1%) 2240(0.1%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [232] 12.1% --------------------------------------------------------------------------------- foldl [190] 100.0% [209] 2274(0.1%) 2274(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 --------------------------------------------------------------------------------- ??? [191] 100.0% [210] 1576(0.1%) 948(0.1%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [229] 39.8% --------------------------------------------------------------------------------- option-on-expr [187] 100.0% [211] 1412(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 point->alt [225] 51.4% for-loop [228] 48.6% --------------------------------------------------------------------------------- option-on-expr [187] 100.0% [212] 670(0.0%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 for-loop [231] 53.7% eval-prog [70] 46.3% --------------------------------------------------------------------------------- for-loop [189] 100.0% [213] 664(0.0%) 664(0.0%) compose ...collects/racket/private/list.rkt:385:12 --------------------------------------------------------------------------------- for-loop [189] 50.5% [214] 650(0.0%) 650(0.0%) parse-app .../collects/racket/private/kw.rkt:951:2 --------------------------------------------------------------------------------- foldl [190] 100.0% [215] 360(0.0%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:66:9 ??? [57] 100.0% --------------------------------------------------------------------------------- bigfloat-hash [195] 100.0% [216] 104836(6.0%) 99698(5.7%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 bigfloat->sig+exp [235] 4.9% --------------------------------------------------------------------------------- ??? [88] 2.0% real->bigfloat [71] 5.3% bfexp [200] 10.1% bfmul [194] 82.6% [217] 70870(4.0%) 70870(4.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 --------------------------------------------------------------------------------- errors [196] 100.0% [218] 68304(3.9%) 2274(0.1%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [3] 92.4% ??? [57] 3.3% --------------------------------------------------------------------------------- custom-set-union [197] 100.0% [219] 49636(2.8%) 14210(0.8%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [233] 71.4% --------------------------------------------------------------------------------- bigfloat-hash [195] 100.0% [220] 27486(1.6%) 21266(1.2%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 integer->mpz [236] 22.6% --------------------------------------------------------------------------------- localize-error [42] 2.6% sort-context-on-expr [201] 97.4% [221] 13606(0.8%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [234] 83.9% loop [248] 16.1% --------------------------------------------------------------------------------- custom-set-union [197] 100.0% [222] 4936(0.3%) 4936(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 --------------------------------------------------------------------------------- setfindf [205] 100.0% [223] 3048(0.2%) 3048(0.2%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 --------------------------------------------------------------------------------- err-lsts->split-indices [207] 100.0% [224] 2630(0.1%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [237] 100.0% --------------------------------------------------------------------------------- option-on-expr [187] 47.3% pick-errors [211] 52.7% [225] 1378(0.1%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [70] 100.0% --------------------------------------------------------------------------------- parse-loop12 [203] 49.4% map [80] 50.6% [226] 1304(0.1%) 668(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 ??? [241] 24.7% hash-ref! [185] 24.1% --------------------------------------------------------------------------------- eval-const-expr [206] 47.7% eval-prog [70] 52.3% [227] 688(0.0%) 688(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 --------------------------------------------------------------------------------- pick-errors [211] 100.0% [228] 686(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [239] 100.0% --------------------------------------------------------------------------------- check-hash/c [210] 100.0% [229] 628(0.0%) 628(0.0%) flat-contract? .../contract/private/guts.rkt:111:0 --------------------------------------------------------------------------------- parse-loop12 [203] 2.8% loop [230] 97.2% [230] 370(0.0%) 370(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [230] 97.2% --------------------------------------------------------------------------------- sindices->spoints [212] 100.0% [231] 360(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:137:2 free-variables [240] 100.0% --------------------------------------------------------------------------------- make-sequence [208] 100.0% [232] 308(0.0%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [238] 100.0% --------------------------------------------------------------------------------- for-loop [219] 100.0% [233] 35426(2.0%) 35426(2.0%) for-loop ...cts/racket/private/set-types.rkt:178:5 --------------------------------------------------------------------------------- ??? [221] 100.0% [234] 11414(0.7%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [242] 85.1% loop [248] 11.8% jloop [249] 3.1% --------------------------------------------------------------------------------- bigfloat-hash [195] 39.1% bfcanonicalize [216] 60.9% [235] 8438(0.5%) 3300(0.2%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:370:0 size+limbs->integer [244] 37.1% new-mpz [246] 15.6% mpz->integer [247] 8.2% --------------------------------------------------------------------------------- sig+exp->bigfloat [220] 100.0% [236] 6220(0.4%) 6220(0.4%) integer->mpz ...math/private/bigfloat/gmp.rkt:87:0 --------------------------------------------------------------------------------- add-splitpoint [224] 100.0% [237] 2630(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [245] 100.0% --------------------------------------------------------------------------------- ??? [232] 16.0% match-e [105] 84.0% [238] 1924(0.1%) 1924(0.1%) custom-in-set ...acket/private/set-types.rkt:577:0 --------------------------------------------------------------------------------- for-loop [228] 100.0% [239] 686(0.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [3] 100.0% --------------------------------------------------------------------------------- append-map [82] 50.0% for-loop [231] 50.0% [240] 360(0.0%) 0(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 f137 [76] 50.0% ??? [163] 50.0% --------------------------------------------------------------------------------- simplify* [226] 100.0% [241] 322(0.0%) 0(0.0%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [243] 100.0% --------------------------------------------------------------------------------- generic-sort/key [234] 36.7% copying-mergesort [242] 63.3% [242] 9714(0.6%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [242] 63.3% loop [248] 20.2% jloop [249] 16.5% --------------------------------------------------------------------------------- ??? [241] 3.4% ??? [151] 96.6% [243] 9532(0.5%) 8862(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [251] 7.0% --------------------------------------------------------------------------------- bigfloat->sig+exp [235] 100.0% [244] 3130(0.2%) 3130(0.2%) size+limbs->integer ...vate/bigfloat/gmp.rkt:103:0 --------------------------------------------------------------------------------- for-loop [237] 100.0% [245] 2630(0.1%) 2316(0.1%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [250] 11.9% --------------------------------------------------------------------------------- bigfloat->sig+exp [235] 100.0% [246] 1316(0.1%) 1316(0.1%) new-mpz ...-lib/math/private/bigfloat/gmp.rkt:73:0 --------------------------------------------------------------------------------- bigfloat->sig+exp [235] 100.0% [247] 692(0.0%) 692(0.0%) mpz->integer ...ath/private/bigfloat/gmp.rkt:115:0 --------------------------------------------------------------------------------- generic-sort/key [234] 19.6% ??? [221] 32.0% copying-mergesort [242] 48.3% [248] 6846(0.4%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [3] 100.0% --------------------------------------------------------------------------------- generic-sort/key [234] 5.3% copying-mergesort [242] 94.7% [249] 6760(0.4%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [3] 89.4% ??? [252] 5.3% errors-score [253] 5.3% --------------------------------------------------------------------------------- for-loop [245] 11.8% for-loop [189] 12.1% for-loop [108] 26.1% loop [179] 50.0% [250] 2654(0.2%) 2654(0.2%) curried ...cket/collects/racket/function.rkt:71:18 --------------------------------------------------------------------------------- ??? [243] 100.0% [251] 670(0.0%) 670(0.0%) ??? ...ects/racket/contract/private/prop.rkt:256:4 --------------------------------------------------------------------------------- ??? [3] 30.5% ??? [57] 34.4% jloop [249] 35.2% [252] 1018(0.1%) 668(0.0%) ??? ...tract/private/arrow-higher-order.rkt:145:21 ??? [254] 34.4% --------------------------------------------------------------------------------- jloop [249] 100.0% [253] 356(0.0%) 356(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 --------------------------------------------------------------------------------- ??? [252] 3.9% for-loop [146] 10.6% ??? [149] 11.2% ??? [154] 28.8% ??? [15] 45.6% [254] 9034(0.5%) 3758(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [255] 58.4% --------------------------------------------------------------------------------- ??? [254] 100.0% [255] 5276(0.3%) 3684(0.2%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [256] 30.2% --------------------------------------------------------------------------------- ??? [255] 100.0% [256] 1592(0.1%) 1592(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 ---------------------------------------------------------------------------------