Profiling results ----------------- Total cpu time observed: 878020ms (out of 880912ms) Number of samples taken: 2593 (once every 339ms) (Hiding functions with self<1.0% and local<2.0%: 8 of 268 hidden) ========================================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================= ??? [68] 100.0% [1] 707100(80.5%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [17] 100.0% ----------------------------------------------------------------------------------------- ??? [68] 100.0% [2] 692752(78.9%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [18] 94.3% get-final-combination [21] 5.5% setup-alt-simplified [28] 0.1% prepare-points [86] 0.1% ----------------------------------------------------------------------------------------- ??? [203] 100.0% [3] 657730(74.9%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [19] 98.7% map-enodes [22] 1.3% ----------------------------------------------------------------------------------------- ??? [203] 100.0% [4] 115214(13.1%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [20] 100.0% ----------------------------------------------------------------------------------------- substitute-e [57] 24.8% match-e [44] 75.2% [5] 14798(1.7%) 318(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [113] 97.9% ----------------------------------------------------------------------------------------- map-enodes [22] 4.2% loop [134] 95.8% [6] 7872(0.9%) 2006(0.2%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [24] 41.8% eval-const-expr [26] 20.1% compose [30] 4.5% composed [220] 4.2% curried [146] 3.8% ----------------------------------------------------------------------------------------- ??? [195] 100.0% [7] 5206(0.6%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [23] 79.3% f137 [46] 13.8% taylor-quotient [67] 6.9% ----------------------------------------------------------------------------------------- hash-ref! [196] 100.0% [8] 2072(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [25] 100.0% ----------------------------------------------------------------------------------------- rewriter [90] 100.0% [9] 2048(0.2%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [228] 100.0% ----------------------------------------------------------------------------------------- copying-mergesort [187] 100.0% [10] 1700(0.2%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [192] 100.0% ----------------------------------------------------------------------------------------- map [81] 33.7% loop [134] 66.3% [11] 1028(0.1%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [196] 66.3% f137 [46] 33.7% ----------------------------------------------------------------------------------------- hash-ref! [196] 100.0% [12] 994(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [27] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [196] 100.0% [13] 986(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [196] 63.7% for-loop [31] 36.3% ----------------------------------------------------------------------------------------- hash-ref! [196] 100.0% [14] 626(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [29] 100.0% ----------------------------------------------------------------------------------------- f137 [46] 100.0% [15] 358(0.0%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [207] 100.0% ----------------------------------------------------------------------------------------- f137 [46] 100.0% [16] 358(0.0%) 0(0.0%) taylor-log ...lt-testing/src/core/taylor.rkt:476:0 simplify [207] 100.0% ----------------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [17] 707100(80.5%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [68] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [18] 653550(74.4%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [32] 100.0% ----------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [19] 649182(73.9%) 7450(0.8%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [33] 77.7% for-loop [34] 21.0% loop [145] 0.1% ----------------------------------------------------------------------------------------- loop [4] 100.0% [20] 115214(13.1%) 0(0.0%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [35] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [21] 37770(4.3%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [36] 99.1% extract-alt [41] 0.9% ----------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [22] 8548(1.0%) 0(0.0%) map-enodes ...lt-testing/src/core/egraph.rkt:140:0 loop [134] 92.2% set-precompute! [147] 3.9% for-loop [6] 3.9% ----------------------------------------------------------------------------------------- approximate9 [7] 100.0% [23] 4128(0.5%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 hash-ref! [196] 66.7% ??? [195] 33.3% ----------------------------------------------------------------------------------------- for-loop [6] 100.0% [24] 3294(0.4%) 2284(0.3%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 custom-in-set [183] 10.7% ??? [113] 10.1% for-loop [40] 9.8% ----------------------------------------------------------------------------------------- ??? [8] 100.0% [25] 2072(0.2%) 360(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 hash-ref! [196] 82.6% ----------------------------------------------------------------------------------------- for-loop [6] 100.0% [26] 1580(0.2%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f137 [46] 79.0% ??? [39] 21.0% ----------------------------------------------------------------------------------------- ??? [12] 100.0% [27] 994(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [196] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [28] 716(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [37] 100.0% ----------------------------------------------------------------------------------------- ??? [14] 100.0% [29] 626(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [38] 100.0% ----------------------------------------------------------------------------------------- for-loop [6] 100.0% [30] 358(0.0%) 358(0.0%) compose ...collects/racket/private/list.rkt:385:12 ----------------------------------------------------------------------------------------- ??? [13] 100.0% [31] 358(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [196] 100.0% ----------------------------------------------------------------------------------------- for-loop [18] 100.0% [32] 653550(74.4%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [42] 93.6% finalize-iter! [47] 4.3% gen-series! [50] 0.8% choose-best-alt! [51] 0.8% gen-rewrites! [53] 0.4% ----------------------------------------------------------------------------------------- one-iter [19] 100.0% [33] 504630(57.5%) 2672(0.3%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [43] 89.4% match-e [44] 7.1% update-leader! [70] 2.3% reduce-to-single! [52] 0.7% for-loop [73] 0.1% ----------------------------------------------------------------------------------------- for-loop [34] 48.6% one-iter [19] 51.4% [34] 136482(15.5%) 30432(3.5%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [34] 48.6% match-e [44] 38.7% ??? [89] 0.1% ----------------------------------------------------------------------------------------- pass [20] 100.0% [35] 115214(13.1%) 1048(0.1%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [45] 74.5% loop [48] 18.5% for-loop [49] 5.8% make-sequence [157] 0.3% ----------------------------------------------------------------------------------------- get-final-combination [21] 100.0% [36] 37448(4.3%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f137 [46] 97.4% ??? [113] 2.6% ----------------------------------------------------------------------------------------- setup-alt-simplified [28] 100.0% [37] 716(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [203] 100.0% ----------------------------------------------------------------------------------------- for-loop [29] 100.0% [38] 626(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [196] 100.0% ----------------------------------------------------------------------------------------- eval-const-expr [26] 100.0% [39] 332(0.0%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [54] 100.0% ----------------------------------------------------------------------------------------- setfindf [24] 100.0% [40] 324(0.0%) 324(0.0%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 ----------------------------------------------------------------------------------------- get-final-combination [21] 100.0% [41] 322(0.0%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [213] 100.0% ----------------------------------------------------------------------------------------- run-iter! [32] 100.0% [42] 612046(69.7%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [55] 100.0% ----------------------------------------------------------------------------------------- for-loop [33] 100.0% [43] 451238(51.4%) 2018(0.2%) for-loop ...t-testing/src/core/simplify.rkt:148:10 merge-egraph-nodes! [56] 33.1% mk-enode! [69] 30.0% substitute-e [57] 22.9% loop! [140] 12.0% list-member? [61] 1.6% ----------------------------------------------------------------------------------------- for-loop [33] 15.8% for-loop [71] 24.0% for-loop [34] 60.2% [44] 141320(16.1%) 54424(6.2%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [59] 45.3% for-loop [71] 7.5% ??? [113] 6.4% variable? [5] 3.3% list-cartesian-product [74] 3.0% loop [134] 1.5% custom-in-set [183] 1.1% curry* [82] 0.5% filter [256] 0.1% ----------------------------------------------------------------------------------------- for-loop [35] 100.0% [45] 85820(9.8%) 678(0.1%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [58] 91.9% expression-cost [60] 7.4% ----------------------------------------------------------------------------------------- ??? [11] 0.1% hash-ref! [196] 0.5% approximate9 [7] 0.5% simplify [207] 0.8% parse-loop12 [217] 0.8% eval-const-expr [26] 2.7% map [81] 3.0% eval-prog [151] 4.8% f137 [46] 16.1% split-table [36] 70.6% [46] 46034(5.2%) 694(0.1%) f137 .../collects/racket/match/compiler.rkt:507:40 loop [134] 63.8% f137 [46] 16.1% option-on-expr [142] 6.8% ??? [195] 4.7% map [81] 3.5% ??? [65] 2.1% ...sting/src/common.rkt:47:2 [116] 0.7% gather-multiplicative-terms [66] 0.5% taylor-invert [15] 0.3% taylor-log [16] 0.2% ??? [113] 0.1% taylor [95] 0.1% taylor-quotient [67] 0.1% ----------------------------------------------------------------------------------------- run-iter! [32] 100.0% [47] 27972(3.2%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [113] 100.0% ----------------------------------------------------------------------------------------- for-loop [35] 100.0% [48] 21266(2.4%) 326(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [58] 88.8% expression-cost [60] 9.6% ----------------------------------------------------------------------------------------- for-loop [35] 100.0% [49] 6736(0.8%) 6736(0.8%) for-loop ...t-testing/src/core/simplify.rkt:217:13 ----------------------------------------------------------------------------------------- run-iter! [32] 100.0% [50] 5206(0.6%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [62] 100.0% ----------------------------------------------------------------------------------------- run-iter! [32] 100.0% [51] 4952(0.6%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [113] 100.0% ----------------------------------------------------------------------------------------- for-loop [33] 100.0% [52] 3362(0.4%) 1360(0.2%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 make-sequence [157] 30.0% for-loop [64] 29.6% ----------------------------------------------------------------------------------------- run-iter! [32] 100.0% [53] 2692(0.3%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 for-loop [63] 100.0% ----------------------------------------------------------------------------------------- ??? [39] 100.0% [54] 332(0.0%) 332(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 ----------------------------------------------------------------------------------------- simplify! [42] 100.0% [55] 612046(69.7%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [68] 100.0% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [56] 4.4% for-loop [72] 7.3% for-loop [43] 88.3% [56] 149136(17.0%) 4628(0.5%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [70] 56.4% for-loop [73] 11.1% for-loop [72] 10.6% loop! [140] 9.9% merge-egraph-nodes! [56] 4.4% enode-merge! [76] 3.9% for-loop [228] 0.9% ----------------------------------------------------------------------------------------- substitute-e [57] 4.5% for-loop [43] 95.5% [57] 103524(11.8%) 3726(0.4%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [69] 90.9% substitute-e [57] 4.5% variable? [5] 1.5% ??? [113] 0.7% ----------------------------------------------------------------------------------------- loop [48] 19.3% argmin [45] 80.7% [58] 97714(11.1%) 2010(0.2%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [203] 70.3% ...sting/src/common.rkt:47:2 [116] 26.0% ??? [115] 1.7% ----------------------------------------------------------------------------------------- match-e [44] 100.0% [59] 85004(9.7%) 26964(3.1%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [71] 56.4% list-cartesian-product [74] 9.2% loop [134] 5.4% filter [256] 0.6% curry* [82] 0.2% foldl [144] 0.2% ----------------------------------------------------------------------------------------- loop [48] 24.5% argmin [45] 75.5% [60] 8368(1.0%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [75] 100.0% ----------------------------------------------------------------------------------------- for-loop [43] 100.0% [61] 7078(0.8%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [78] 62.3% member [80] 37.7% ----------------------------------------------------------------------------------------- gen-series! [50] 100.0% [62] 5206(0.6%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [77] 100.0% ----------------------------------------------------------------------------------------- gen-rewrites! [53] 100.0% [63] 2692(0.3%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:138:11 ??? [79] 100.0% ----------------------------------------------------------------------------------------- reduce-to-single! [52] 100.0% [64] 994(0.1%) 994(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 ----------------------------------------------------------------------------------------- f137 [46] 100.0% [65] 946(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:336:46 ??? [254] 100.0% ----------------------------------------------------------------------------------------- map [81] 25.1% f137 [46] 74.9% [66] 714(0.1%) 356(0.0%) gather-multiplicative-terms ...re/reduce.rkt:116:0 map [81] 50.1% ----------------------------------------------------------------------------------------- f137 [46] 49.0% approximate9 [7] 51.0% [67] 706(0.1%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 first-nonzero-exp [83] 51.0% simplify [207] 49.0% ----------------------------------------------------------------------------------------- for-loop [55] 23.5% run [17] 29.0% [68] 868346(98.9%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 ??? [203] 42.0% profile-thunk16 [1] 29.0% run-improve50 [2] 28.2% prepare-points [86] 0.9% ----------------------------------------------------------------------------------------- mk-egraph [218] 0.1% mk-enode-rec! [229] 1.5% substitute-e [57] 40.3% for-loop [43] 58.0% [69] 233242(26.6%) 15762(1.8%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [84] 90.9% hash-has-key? [120] 2.3% ----------------------------------------------------------------------------------------- for-loop [33] 11.1% merge-egraph-nodes! [56] 88.9% [70] 103278(11.8%) 8294(0.9%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [85] 87.7% make-sequence [157] 1.3% update-en-expr [234] 1.0% custom-set-union! [94] 1.0% mutable-set [96] 0.7% hash-ref! [196] 0.3% ----------------------------------------------------------------------------------------- match-e [44] 25.8% for-loop [59] 74.2% [71] 67850(7.7%) 4320(0.5%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [44] 91.6% ??? [89] 3.5% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [56] 100.0% [72] 26368(3.0%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [56] 80.9% loop! [140] 19.1% ----------------------------------------------------------------------------------------- for-loop [33] 1.9% merge-egraph-nodes! [56] 98.1% [73] 17026(1.9%) 14690(1.7%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [234] 13.7% ----------------------------------------------------------------------------------------- match-e [44] 22.4% list-cartesian-product [74] 29.3% for-loop [59] 48.2% [74] 14648(1.7%) 12314(1.4%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [74] 29.3% for-loop [91] 10.3% ----------------------------------------------------------------------------------------- expression-cost [60] 100.0% [75] 8368(1.0%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [196] 100.0% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [56] 100.0% [76] 6270(0.7%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [88] 73.8% custom-set-intersect! [92] 26.2% ----------------------------------------------------------------------------------------- for-loop [62] 100.0% [77] 5206(0.6%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [87] 100.0% ----------------------------------------------------------------------------------------- list-member? [61] 100.0% [78] 4410(0.5%) 4410(0.5%) loop (unknown source) ----------------------------------------------------------------------------------------- for-loop [63] 100.0% [79] 2692(0.3%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [90] 88.4% loop [134] 11.6% ----------------------------------------------------------------------------------------- list-member? [61] 100.0% [80] 2668(0.3%) 2668(0.3%) member (unknown source) ----------------------------------------------------------------------------------------- gather-multiplicative-terms [66] 3.2% f137 [46] 96.8% [81] 2482(0.3%) 358(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 f137 [46] 81.4% taylor [95] 7.5% ??? [11] 3.5% simplify* [97] 2.9% parse-loop12 [217] 1.6% gather-multiplicative-terms [66] 1.6% ----------------------------------------------------------------------------------------- for-loop [59] 25.3% match-e [44] 74.7% [82] 1430(0.2%) 0(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [93] 100.0% ----------------------------------------------------------------------------------------- taylor-quotient [67] 100.0% [83] 360(0.0%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [196] 100.0% ----------------------------------------------------------------------------------------- mk-enode! [69] 100.0% [84] 212090(24.2%) 360(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [98] 98.6% set [152] 0.9% ----------------------------------------------------------------------------------------- update-leader! [70] 100.0% [85] 90602(10.3%) 2212(0.3%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [99] 97.6% ----------------------------------------------------------------------------------------- run-improve50 [2] 3.0% pred [190] 34.3% ??? [68] 62.8% [86] 23912(2.7%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 make-exacts* [109] 51.3% loop [100] 24.9% loop [110] 19.7% for-loop [103] 2.8% ??? [112] 1.3% ----------------------------------------------------------------------------------------- taylor-alt [77] 100.0% [87] 5206(0.6%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [195] 100.0% ----------------------------------------------------------------------------------------- enode-merge! [76] 100.0% [88] 4626(0.5%) 1962(0.2%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [149] 57.6% ----------------------------------------------------------------------------------------- for-loop [34] 10.9% for-loop [71] 89.1% [89] 3040(0.3%) 1986(0.2%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [102] 34.7% ----------------------------------------------------------------------------------------- ??? [79] 28.0% matcher [111] 72.0% [90] 2380(0.3%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [101] 74.8% *rules* [9] 25.2% ----------------------------------------------------------------------------------------- list-cartesian-product [74] 100.0% [91] 2334(0.3%) 2334(0.3%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 ----------------------------------------------------------------------------------------- enode-merge! [76] 100.0% [92] 1644(0.2%) 1644(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ----------------------------------------------------------------------------------------- curry* [82] 100.0% [93] 1430(0.2%) 1430(0.2%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ----------------------------------------------------------------------------------------- update-leader! [70] 100.0% [94] 1004(0.1%) 336(0.0%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [104] 66.5% ----------------------------------------------------------------------------------------- f137 [46] 48.3% map [81] 51.7% [95] 716(0.1%) 346(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 debug-print [105] 51.7% ----------------------------------------------------------------------------------------- update-leader! [70] 100.0% [96] 706(0.1%) 342(0.0%) mutable-set .../racket/private/set-types.rkt:999:0 for-loop [106] 51.6% ----------------------------------------------------------------------------------------- map [81] 100.0% [97] 358(0.0%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 return/no-unsupplied [250] 100.0% ----------------------------------------------------------------------------------------- new-enode [84] 100.0% [98] 209046(23.8%) 5632(0.6%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [107] 97.1% parse-loop12 [217] 0.2% ----------------------------------------------------------------------------------------- for-loop [85] 100.0% [99] 88390(10.1%) 678(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [108] 99.2% ----------------------------------------------------------------------------------------- prepare-points [86] 100.0% [100] 5956(0.7%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [109] 57.6% loop [110] 42.4% ----------------------------------------------------------------------------------------- rewriter [90] 100.0% [101] 2380(0.3%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [111] 100.0% ----------------------------------------------------------------------------------------- ??? [89] 100.0% [102] 1054(0.1%) 694(0.1%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ??? [113] 34.2% ----------------------------------------------------------------------------------------- prepare-points [86] 100.0% [103] 672(0.1%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [112] 100.0% ----------------------------------------------------------------------------------------- custom-set-union! [94] 100.0% [104] 668(0.1%) 668(0.1%) for-loop ...cts/racket/private/set-types.rkt:253:4 ----------------------------------------------------------------------------------------- taylor [95] 100.0% [105] 370(0.0%) 370(0.0%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ----------------------------------------------------------------------------------------- mutable-set [96] 100.0% [106] 364(0.0%) 364(0.0%) for-loop ...cts/racket/private/set-types.rkt:943:2 ----------------------------------------------------------------------------------------- type-of-enode-expr [98] 100.0% [107] 203046(23.1%) 4316(0.5%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [115] 35.7% ??? [203] 33.4% ??? [113] 14.8% ...sting/src/common.rkt:47:2 [116] 14.0% ----------------------------------------------------------------------------------------- for-loop [99] 100.0% [108] 87712(10.0%) 688(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [114] 99.2% ----------------------------------------------------------------------------------------- loop [100] 21.9% prepare-points [86] 78.1% [109] 15692(1.8%) 330(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [151] 59.6% loop [134] 38.3% ----------------------------------------------------------------------------------------- loop [100] 34.9% prepare-points [86] 65.1% [110] 7234(0.8%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [134] 100.0% ----------------------------------------------------------------------------------------- for-loop [117] 17.5% matcher [111] 32.5% for-loop [101] 50.0% [111] 2380(0.3%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [90] 48.6% matcher [111] 32.5% for-loop [117] 17.5% ??? [113] 1.4% ----------------------------------------------------------------------------------------- prepare-points [86] 31.8% for-loop [103] 68.2% [112] 986(0.1%) 314(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [195] 36.7% for-loop [118] 31.4% ----------------------------------------------------------------------------------------- setfindf [24] 0.3% matcher [111] 0.3% f137 [46] 0.4% for-loop [102] 0.4% split-table [36] 1.0% substitute-e [57] 2.1% ??? [254] 3.2% choose-best-alt! [51] 4.8% match-e [44] 14.4% variable? [5] 14.6% finalize-iter! [47] 28.2% get-sigs [107] 30.4% [113] 99204(11.3%) 22014(2.5%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [120] 42.9% for-loop [123] 27.9% atab-pick-alt8 [126] 4.8% ??? [254] 1.0% split-atab [127] 1.0% ----------------------------------------------------------------------------------------- hash-update! [108] 100.0% [114] 87024(9.9%) 2710(0.3%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [119] 96.5% make-sequence [157] 0.4% ----------------------------------------------------------------------------------------- ??? [195] 0.9% for-loop [58] 2.2% get-sigs [107] 96.9% [115] 74868(8.5%) 4318(0.5%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 for-loop [121] 43.9% ??? [122] 41.7% get/build-late-neg-projection [154] 6.8% ??? [236] 1.8% ----------------------------------------------------------------------------------------- f137 [46] 0.6% ??? [195] 1.3% for-loop [58] 46.4% get-sigs [107] 51.8% [116] 54688(6.2%) 17388(2.0%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [124] 36.4% ??? [125] 31.9% ----------------------------------------------------------------------------------------- matcher [111] 100.0% [117] 1688(0.2%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [111] 100.0% ----------------------------------------------------------------------------------------- ??? [112] 100.0% [118] 310(0.0%) 0(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:231:9 ??? [195] 100.0% ----------------------------------------------------------------------------------------- ??? [114] 100.0% [119] 83954(9.6%) 71710(8.2%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [234] 14.6% ----------------------------------------------------------------------------------------- mk-enode! [69] 11.2% ??? [113] 88.8% [120] 47992(5.5%) 13596(1.5%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [215] 68.8% ??? [221] 2.9% ----------------------------------------------------------------------------------------- for-loop [227] 21.9% ??? [115] 78.1% [121] 42078(4.8%) 6268(0.7%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [226] 82.7% ??? [243] 2.4% ----------------------------------------------------------------------------------------- ??? [115] 100.0% [122] 31224(3.6%) 1772(0.2%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [128] 94.3% ----------------------------------------------------------------------------------------- ??? [113] 100.0% [123] 27644(3.1%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:52:2 atab-add-altn [129] 100.0% ----------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [116] 100.0% [124] 19880(2.3%) 6182(0.7%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [249] 35.7% return/no-unsupplied [250] 18.1% assoc-ref [130] 15.0% ----------------------------------------------------------------------------------------- for-loop [235] 7.7% ??? [226] 12.8% ...sting/src/common.rkt:47:2 [116] 79.5% [125] 17420(2.0%) 3658(0.4%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [226] 71.7% ??? [254] 11.0% ??? [236] 5.8% ----------------------------------------------------------------------------------------- ??? [113] 100.0% [126] 4952(0.6%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:61:0 point-best-alt [131] 59.3% ??? [195] 27.4% for-loop [133] 13.3% ----------------------------------------------------------------------------------------- ??? [113] 100.0% [127] 968(0.1%) 0(0.0%) split-atab ...testing/src/core/alt-table.rkt:109:0 for-loop [132] 100.0% ----------------------------------------------------------------------------------------- ??? [122] 100.0% [128] 29452(3.4%) 1298(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [135] 95.6% ----------------------------------------------------------------------------------------- for-loop [123] 98.8% [129] 27972(3.2%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:243:0 best-and-tied-at-points [136] 93.9% override-at-pnts [137] 6.1% ----------------------------------------------------------------------------------------- ??? [124] 100.0% [130] 2986(0.3%) 2986(0.3%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ----------------------------------------------------------------------------------------- atab-pick-alt8 [126] 100.0% [131] 2938(0.3%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:55:0 loop [134] 100.0% ----------------------------------------------------------------------------------------- split-atab [127] 100.0% [132] 968(0.1%) 0(0.0%) for-loop ...t-testing/src/core/alt-table.rkt:110:2 for-loop [138] 66.5% for-loop [139] 33.5% ----------------------------------------------------------------------------------------- atab-pick-alt8 [126] 100.0% [133] 658(0.1%) 658(0.1%) for-loop ...lt-testing/src/core/alt-table.rkt:88:2 ----------------------------------------------------------------------------------------- make-exacts* [109] 0.0% ??? [79] 0.0% parse-loop12 [217] 0.0% loop [110] 0.1% map-enodes [22] 0.7% point-best-alt [131] 1.7% match-e [44] 2.0% option-on-expr [142] 2.2% ??? [204] 2.5% for-loop [59] 3.0% loop! [140] 11.4% f137 [46] 17.6% loop [134] 58.7% [134] 118770(13.5%) 10452(1.2%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [134] 58.7% option-on-expr [142] 17.6% loop! [140] 10.4% errors [141] 3.8% hash-ref! [196] 2.5% foldl [144] 1.1% for-loop [6] 0.7% curried [146] 0.4% ??? [195] 0.1% ??? [192] 0.0% ??? [169] 0.0% ??? [11] 0.0% set-precompute! [147] 0.0% ----------------------------------------------------------------------------------------- ??? [128] 100.0% [135] 28154(3.2%) 2098(0.2%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [143] 92.5% ----------------------------------------------------------------------------------------- atab-add-altn [129] 100.0% [136] 26270(3.0%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:157:0 errors [141] 97.4% for-loop [148] 2.6% ----------------------------------------------------------------------------------------- atab-add-altn [129] 100.0% [137] 1702(0.2%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:180:0 errors [141] 100.0% ----------------------------------------------------------------------------------------- for-loop [132] 100.0% [138] 644(0.1%) 0(0.0%) for-loop ...-testing/src/core/alt-table.rkt:115:53 loop [145] 100.0% ----------------------------------------------------------------------------------------- for-loop [132] 100.0% [139] 324(0.0%) 0(0.0%) for-loop ...-testing/src/core/alt-table.rkt:111:45 ??? [161] 100.0% ----------------------------------------------------------------------------------------- for-loop [72] 4.1% merge-egraph-nodes! [56] 17.8% loop [134] 30.1% for-loop [43] 48.0% [140] 82238(9.4%) 15124(1.7%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [149] 37.8% loop [134] 35.2% set [152] 11.2% update-en-expr [234] 6.1% ----------------------------------------------------------------------------------------- composed [220] 3.6% override-at-pnts [137] 3.7% pred [190] 8.9% option-on-expr [142] 10.5% loop [134] 18.0% best-and-tied-at-points [136] 55.3% [141] 46272(5.3%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [150] 77.4% eval-prog [151] 22.6% ----------------------------------------------------------------------------------------- f137 [46] 10.1% loop [134] 89.9% [142] 36480(4.2%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [155] 34.6% sort-context-on-expr [156] 24.2% loop [134] 19.4% errors [141] 13.3% pick-errors [158] 3.9% err-lsts->split-indices [160] 2.8% point->alt [173] 1.8% ----------------------------------------------------------------------------------------- ??? [135] 100.0% [143] 26056(3.0%) 3990(0.5%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [153] 53.2% get/build-late-neg-projection [154] 31.5% ----------------------------------------------------------------------------------------- for-loop [59] 12.7% loop [134] 87.3% [144] 2656(0.3%) 1320(0.2%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [159] 38.6% ??? [162] 11.7% ----------------------------------------------------------------------------------------- one-iter [19] 49.1% for-loop [138] 50.9% [145] 1264(0.1%) 620(0.1%) loop ...ket/collects/racket/private/list.rkt:264:4 ??? [161] 50.9% ----------------------------------------------------------------------------------------- for-loop [6] 31.4% loop [134] 68.6% [146] 954(0.1%) 954(0.1%) curried ...cket/collects/racket/function.rkt:71:18 ----------------------------------------------------------------------------------------- map-enodes [22] 49.4% loop [134] 50.6% [147] 676(0.1%) 334(0.0%) set-precompute! ...ing/src/core/simplify.rkt:193:0 make-sequence [157] 50.6% ----------------------------------------------------------------------------------------- best-and-tied-at-points [136] 100.0% [148] 670(0.1%) 346(0.0%) for-loop ...-testing/src/core/alt-table.rkt:159:16 ??? [177] 48.4% ----------------------------------------------------------------------------------------- adopt-enode! [88] 7.2% loop! [140] 92.8% [149] 37158(4.2%) 12512(1.4%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [163] 56.6% for-loop [168] 9.8% ----------------------------------------------------------------------------------------- errors [141] 100.0% [150] 35806(4.1%) 674(0.1%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [192] 89.0% ??? [195] 4.4% ulp-difference [172] 2.9% ??? [177] 0.8% ----------------------------------------------------------------------------------------- sort-context-on-expr [156] 1.6% point->alt [173] 4.8% make-exacts* [109] 44.2% errors [141] 49.4% [151] 21186(2.4%) 3768(0.4%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f137 [46] 46.7% hash-ref! [196] 30.7% ??? [175] 3.2% ??? [195] 1.6% ----------------------------------------------------------------------------------------- new-enode [84] 9.5% loop! [140] 90.5% [152] 20806(2.4%) 20806(2.4%) set ...collects/racket/private/set-types.rkt:981:0 ----------------------------------------------------------------------------------------- for-loop [143] 100.0% [153] 13854(1.6%) 13854(1.6%) add-list-context ...ontract/private/list.rkt:752:0 ----------------------------------------------------------------------------------------- listof-late-neg-projection [170] 3.4% ??? [167] 14.8% ??? [115] 20.2% for-loop [143] 61.6% [154] 13332(1.5%) 3002(0.3%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [165] 64.6% ??? [167] 17.5% listof-late-neg-projection [170] 3.4% ----------------------------------------------------------------------------------------- option-on-expr [142] 100.0% [155] 12614(1.4%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [164] 100.0% ----------------------------------------------------------------------------------------- option-on-expr [142] 100.0% [156] 8838(1.0%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [166] 96.1% eval-prog [151] 3.9% ----------------------------------------------------------------------------------------- set-precompute! [147] 10.1% for-loop [35] 10.2% ??? [114] 10.6% reduce-to-single! [52] 29.8% update-leader! [70] 39.3% [157] 3382(0.4%) 2660(0.3%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [174] 21.3% ----------------------------------------------------------------------------------------- option-on-expr [142] 100.0% [158] 1430(0.2%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [171] 74.8% point->alt [173] 25.2% ----------------------------------------------------------------------------------------- foldl [144] 100.0% [159] 1024(0.1%) 1024(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 ----------------------------------------------------------------------------------------- option-on-expr [142] 100.0% [160] 1004(0.1%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [176] 66.9% for-loop [178] 33.1% ----------------------------------------------------------------------------------------- for-loop [139] 33.5% loop [145] 66.5% [161] 968(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:302:4 ??? [169] 100.0% ----------------------------------------------------------------------------------------- foldl [144] 100.0% [162] 312(0.0%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:66:9 ??? [195] 100.0% ----------------------------------------------------------------------------------------- custom-set-union [149] 100.0% [163] 21018(2.4%) 5824(0.7%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [179] 72.3% ----------------------------------------------------------------------------------------- sindices->spoints [155] 100.0% [164] 12614(1.4%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 sidx->spoint [180] 100.0% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [154] 100.0% [165] 9972(1.1%) 2338(0.3%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [181] 76.6% ----------------------------------------------------------------------------------------- sort-context-on-expr [156] 100.0% [166] 8490(1.0%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [182] 88.3% loop [191] 11.7% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [154] 100.0% [167] 4760(0.5%) 358(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [154] 92.5% ----------------------------------------------------------------------------------------- custom-set-union [149] 100.0% [168] 3628(0.4%) 3628(0.4%) for-loop ...cts/racket/private/set-types.rkt:152:2 ----------------------------------------------------------------------------------------- loop [134] 24.5% ??? [161] 35.9% for-loop [171] 39.6% [169] 2700(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [192] 86.6% ??? [195] 13.4% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [154] 100.0% [170] 1372(0.2%) 0(0.0%) listof-late-neg-projection ...ivate/list.rkt:162:0 get/build-late-neg-projection [154] 100.0% ----------------------------------------------------------------------------------------- pick-errors [158] 100.0% [171] 1070(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [169] 100.0% ----------------------------------------------------------------------------------------- for-loop [150] 100.0% [172] 1038(0.1%) 704(0.1%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 ??? [249] 32.2% ----------------------------------------------------------------------------------------- pick-errors [158] 35.5% option-on-expr [142] 64.5% [173] 1014(0.1%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [151] 100.0% ----------------------------------------------------------------------------------------- make-sequence [157] 100.0% [174] 722(0.1%) 360(0.0%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [183] 50.1% ----------------------------------------------------------------------------------------- eval-prog [151] 100.0% [175] 688(0.1%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [184] 100.0% ----------------------------------------------------------------------------------------- err-lsts->split-indices [160] 100.0% [176] 672(0.1%) 0(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [185] 100.0% ----------------------------------------------------------------------------------------- for-loop [150] 47.7% for-loop [148] 52.3% [177] 620(0.1%) 620(0.1%) ??? ...ket/collects/racket/private/for.rkt:1151:14 ----------------------------------------------------------------------------------------- err-lsts->split-indices [160] 100.0% [178] 332(0.0%) 332(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:279:4 ----------------------------------------------------------------------------------------- for-loop [163] 100.0% [179] 15194(1.7%) 15194(1.7%) for-loop ...cts/racket/private/set-types.rkt:178:5 ----------------------------------------------------------------------------------------- loop [164] 100.0% [180] 12614(1.4%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [186] 65.3% pred [190] 34.7% ----------------------------------------------------------------------------------------- contract-struct-name [188] 12.7% ??? [165] 87.3% [181] 7634(0.9%) 4270(0.5%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [188] 54.7% ----------------------------------------------------------------------------------------- ??? [166] 100.0% [182] 7494(0.9%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [187] 72.6% loop [191] 27.4% ----------------------------------------------------------------------------------------- setfindf [24] 14.3% ??? [174] 14.7% match-e [44] 71.0% [183] 2468(0.3%) 2468(0.3%) custom-in-set ...acket/private/set-types.rkt:577:0 ----------------------------------------------------------------------------------------- ??? [175] 100.0% [184] 688(0.1%) 688(0.1%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ----------------------------------------------------------------------------------------- add-splitpoint [176] 100.0% [185] 672(0.1%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [189] 100.0% ----------------------------------------------------------------------------------------- sidx->spoint [180] 100.0% [186] 8240(0.9%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [190] 100.0% ----------------------------------------------------------------------------------------- generic-sort/key [182] 48.8% copying-mergesort [187] 51.2% [187] 5440(0.6%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [187] 51.2% loop [191] 41.0% jloop [10] 7.8% ----------------------------------------------------------------------------------------- build-compound-type-name [181] 100.0% [188] 4986(0.6%) 3364(0.4%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [181] 35.8% ----------------------------------------------------------------------------------------- for-loop [185] 100.0% [189] 672(0.1%) 672(0.1%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 ----------------------------------------------------------------------------------------- sidx->spoint [180] 34.7% binary-search-floats [186] 65.3% [190] 12614(1.4%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [86] 64.9% errors [141] 32.5% errors-score [193] 2.6% ----------------------------------------------------------------------------------------- ??? [166] 14.7% generic-sort/key [182] 30.3% copying-mergesort [187] 55.1% [191] 6790(0.8%) 336(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [192] 80.1% ??? [195] 14.9% ----------------------------------------------------------------------------------------- jloop [10] 3.2% ??? [169] 4.3% loop [191] 10.1% loop [134] 23.3% for-loop [150] 59.1% [192] 53908(6.1%) 722(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [194] 80.9% ??? [195] 11.3% ??? [198] 6.5% ----------------------------------------------------------------------------------------- pred [190] 100.0% [193] 328(0.0%) 328(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 ----------------------------------------------------------------------------------------- ??? [192] 100.0% [194] 43600(5.0%) 27710(3.2%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [197] 16.4% ??? [199] 10.8% ??? [200] 7.7% for-loop [202] 1.6% ----------------------------------------------------------------------------------------- for-loop [118] 1.1% ??? [162] 1.1% eval-prog [151] 1.2% ??? [112] 1.3% ??? [169] 1.3% loop [23] 1.7% ??? [209] 3.3% loop [134] 3.6% loop [191] 3.7% atab-pick-alt8 [126] 4.9% for-loop [150] 5.8% ??? [203] 7.0% for-loop [87] 7.0% ??? [192] 22.2% f137 [46] 34.7% [195] 27464(3.1%) 2596(0.3%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [203] 53.4% ??? [254] 8.6% approximate9 [7] 7.0% ??? [198] 5.4% hash-ref! [196] 5.0% best-alt [201] 4.9% ...sting/src/common.rkt:47:2 [116] 2.5% ??? [115] 2.5% ----------------------------------------------------------------------------------------- for-loop [31] 0.3% ??? [13] 0.5% for-loop [38] 0.6% for-loop [27] 1.0% update-leader! [70] 1.5% ??? [11] 1.6% first-nonzero-exp [83] 1.7% for-loop [25] 1.7% ??? [210] 2.9% loop [23] 4.7% ??? [195] 8.1% loop [134] 14.6% eval-prog [151] 16.8% ??? [204] 19.8% compile [75] 20.6% [196] 20706(2.4%) 6722(0.8%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [204] 40.0% bigfloat-hash [205] 15.9% simplify [207] 6.3% ??? [209] 4.7% ??? [8] 3.5% f137 [46] 3.4% parse-loop12 [217] 3.3% ??? [210] 2.9% ??? [12] 1.0% ??? [13] 0.9% ??? [14] 0.6% ----------------------------------------------------------------------------------------- ??? [194] 100.0% [197] 7146(0.8%) 3068(0.3%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [250] 33.6% ??? [249] 23.5% ----------------------------------------------------------------------------------------- ??? [195] 29.8% ??? [192] 70.2% [198] 4986(0.6%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [206] 100.0% ----------------------------------------------------------------------------------------- ??? [194] 100.0% [199] 4718(0.5%) 4718(0.5%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ----------------------------------------------------------------------------------------- ??? [194] 100.0% [200] 3338(0.4%) 322(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfadd [208] 90.4% ----------------------------------------------------------------------------------------- ??? [195] 100.0% [201] 1356(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 loop [211] 76.1% argmins [213] 23.9% ----------------------------------------------------------------------------------------- ??? [194] 100.0% [202] 688(0.1%) 0(0.0%) for-loop ...lt-testing/src/syntax/syntax.rkt:531:2 bf> [212] 100.0% ----------------------------------------------------------------------------------------- simplify-alt [37] 0.0% ??? [195] 1.8% get-sigs [107] 2.8% for-loop [58] 2.9% ??? [203] 6.4% for-loop [214] 40.0% ??? [68] 45.7% [203] 796148(90.7%) 45406(5.2%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [214] 40.0% iterate-egraph!13 [3] 39.9% ??? [203] 6.4% loop [4] 5.8% ??? [215] 4.0% ??? [249] 0.4% return/no-unsupplied [250] 0.3% mk-egraph [218] 0.2% ??? [195] 0.2% *simplify-rules* [222] 0.1% loop [225] 0.1% ??? [226] 0.1% dict? [258] 0.0% ??? [221] 0.0% ----------------------------------------------------------------------------------------- hash-ref! [196] 100.0% [204] 11510(1.3%) 2644(0.3%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 hash-ref! [196] 51.0% loop [134] 38.9% ----------------------------------------------------------------------------------------- hash-ref! [196] 100.0% [205] 5822(0.7%) 350(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [216] 81.2% sig+exp->bigfloat [223] 12.8% ----------------------------------------------------------------------------------------- ??? [198] 100.0% [206] 4986(0.6%) 3674(0.4%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [219] 26.3% ----------------------------------------------------------------------------------------- taylor-quotient [67] 8.4% taylor-log [16] 8.7% taylor-invert [15] 8.7% hash-ref! [196] 74.3% [207] 4130(0.5%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 parse-loop12 [217] 65.4% f137 [46] 34.6% ----------------------------------------------------------------------------------------- ??? [200] 100.0% [208] 3016(0.3%) 2282(0.3%) bfadd ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [219] 24.3% ----------------------------------------------------------------------------------------- hash-ref! [196] 100.0% [209] 2752(0.3%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [195] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [196] 100.0% [210] 2364(0.3%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [196] 100.0% ----------------------------------------------------------------------------------------- best-alt [201] 100.0% [211] 1032(0.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [220] 100.0% ----------------------------------------------------------------------------------------- for-loop [202] 100.0% [212] 688(0.1%) 0(0.0%) bf> ...th/private/bigfloat/bigfloat-mpfr.rkt:127:4 ??? [224] 100.0% ----------------------------------------------------------------------------------------- extract-alt [41] 49.8% best-alt [201] 50.2% [213] 646(0.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [220] 100.0% ----------------------------------------------------------------------------------------- ??? [203] 100.0% [214] 676572(77.1%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [203] 100.0% ----------------------------------------------------------------------------------------- hash-has-key? [120] 26.7% ??? [203] 73.3% [215] 123806(14.1%) 50522(5.8%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [227] 42.8% ??? [233] 13.6% ??? [226] 1.6% arrow-higher-order:lnp [237] 1.0% successfully-got-the-right-kind-of-function [239] 0.3% ----------------------------------------------------------------------------------------- bigfloat-hash [205] 100.0% [216] 4726(0.5%) 4366(0.5%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 bigfloat->sig+exp [231] 7.6% ----------------------------------------------------------------------------------------- map [81] 8.7% type-of-enode-expr [98] 9.0% hash-ref! [196] 16.6% parse-loop12 [217] 18.0% simplify [207] 47.8% [217] 4108(0.5%) 2732(0.3%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 parse-loop12 [217] 18.0% f137 [46] 16.9% loop [134] 16.6% ----------------------------------------------------------------------------------------- ??? [203] 100.0% [218] 3930(0.4%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [229] 91.8% mk-enode! [69] 8.2% ----------------------------------------------------------------------------------------- bfadd [208] 35.9% real->bigfloat [206] 64.1% [219] 2046(0.2%) 2046(0.2%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ----------------------------------------------------------------------------------------- for-loop [6] 16.6% argmins [213] 32.1% loop [211] 51.3% [220] 2012(0.2%) 334(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [141] 83.4% ----------------------------------------------------------------------------------------- ??? [203] 20.0% hash-has-key? [120] 80.0% [221] 1710(0.2%) 1710(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ----------------------------------------------------------------------------------------- ??? [203] 100.0% [222] 976(0.1%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 for-loop [228] 100.0% ----------------------------------------------------------------------------------------- bigfloat-hash [205] 100.0% [223] 746(0.1%) 746(0.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ----------------------------------------------------------------------------------------- bf> [212] 100.0% [224] 688(0.1%) 688(0.1%) ??? ...tract/private/arrow-higher-order.rkt:346:33 ----------------------------------------------------------------------------------------- ??? [203] 100.0% [225] 672(0.1%) 0(0.0%) loop ...ies/herbie/alt-testing/src/points.rkt:66:6 random-exp [230] 100.0% ----------------------------------------------------------------------------------------- ??? [203] 3.5% ??? [215] 3.6% ??? [125] 29.3% for-loop [121] 63.6% [226] 54726(6.2%) 10556(1.2%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [232] 61.8% for-loop [235] 8.5% ??? [125] 8.1% ??? [243] 2.3% ----------------------------------------------------------------------------------------- ??? [215] 100.0% [227] 52928(6.0%) 30324(3.5%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [233] 19.7% for-loop [121] 17.4% ??? [236] 3.8% arrow-higher-order:lnp [237] 0.6% successfully-got-the-right-kind-of-function [239] 0.6% ??? [254] 0.6% ----------------------------------------------------------------------------------------- *simplify-rules* [222] 20.7% merge-egraph-nodes! [56] 35.9% *rules* [9] 43.4% [228] 4718(0.5%) 1666(0.2%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 ormap [238] 29.5% flag-set? [246] 20.4% update-en-expr [234] 7.7% loop [241] 7.1% ----------------------------------------------------------------------------------------- mk-egraph [218] 47.6% mk-enode-rec! [229] 52.4% [229] 3606(0.4%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [229] 52.4% mk-enode! [69] 47.6% ----------------------------------------------------------------------------------------- loop [225] 100.0% [230] 672(0.1%) 672(0.1%) random-exp ...bie/alt-testing/src/common.rkt:253:0 ----------------------------------------------------------------------------------------- bfcanonicalize [216] 100.0% [231] 360(0.0%) 0(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:370:0 size+limbs->integer [240] 100.0% ----------------------------------------------------------------------------------------- ??? [226] 100.0% [232] 33804(3.9%) 3042(0.3%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [254] 86.1% ??? [243] 4.9% ----------------------------------------------------------------------------------------- for-loop [227] 38.3% ??? [215] 61.7% [233] 27202(3.1%) 14364(1.6%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [242] 47.2% ----------------------------------------------------------------------------------------- for-loop [228] 1.4% update-leader! [70] 4.0% for-loop [73] 9.2% loop! [140] 37.1% for-loop [119] 48.2% [234] 25382(2.9%) 22996(2.6%) update-en-expr ...esting/src/core/egraph.rkt:212:0 for-loop [245] 9.4% ----------------------------------------------------------------------------------------- ??? [226] 100.0% [235] 4628(0.5%) 1936(0.2%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [125] 58.2% ----------------------------------------------------------------------------------------- ??? [125] 23.3% ??? [115] 30.8% for-loop [227] 45.9% [236] 4362(0.5%) 990(0.1%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [244] 77.3% ----------------------------------------------------------------------------------------- for-loop [227] 20.9% ??? [215] 79.1% [237] 1620(0.2%) 338(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [247] 79.1% ----------------------------------------------------------------------------------------- for-loop [228] 100.0% [238] 1390(0.2%) 332(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [246] 76.1% ----------------------------------------------------------------------------------------- ??? [215] 48.3% for-loop [227] 51.7% [239] 646(0.1%) 0(0.0%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [248] 100.0% ----------------------------------------------------------------------------------------- bigfloat->sig+exp [231] 100.0% [240] 360(0.0%) 360(0.0%) size+limbs->integer ...vate/bigfloat/gmp.rkt:103:0 ----------------------------------------------------------------------------------------- for-loop [228] 100.0% [241] 336(0.0%) 0(0.0%) loop ...ket/collects/racket/private/map.rkt:112:23 flag-set? [246] 100.0% ----------------------------------------------------------------------------------------- ??? [233] 100.0% [242] 12838(1.5%) 12838(1.5%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ----------------------------------------------------------------------------------------- for-loop [121] 25.7% ??? [226] 32.6% ??? [232] 41.7% [243] 3948(0.4%) 2642(0.3%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [252] 33.1% ----------------------------------------------------------------------------------------- ??? [236] 100.0% [244] 3372(0.4%) 1690(0.2%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [251] 49.9% ----------------------------------------------------------------------------------------- update-en-expr [234] 100.0% [245] 2386(0.3%) 2386(0.3%) for-loop .../alt-testing/src/core/egraph.rkt:214:6 ----------------------------------------------------------------------------------------- loop [241] 14.2% for-loop [228] 40.9% ormap [238] 44.9% [246] 2358(0.3%) 662(0.1%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [250] 56.9% ??? [249] 15.0% ----------------------------------------------------------------------------------------- arrow-higher-order:lnp [237] 100.0% [247] 1282(0.1%) 1282(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 ----------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [239]100.0% [248] 646(0.1%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [253] 100.0% ----------------------------------------------------------------------------------------- ulp-difference [172] 2.4% flag-set? [246] 2.6% ??? [197] 12.2% ??? [203] 31.2% ??? [124] 51.6% [249] 13758(1.6%) 3664(0.4%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [255] 52.3% ??? [254] 21.1% ----------------------------------------------------------------------------------------- simplify* [97] 3.2% flag-set? [246] 12.1% ??? [197] 21.7% ??? [203] 30.3% ??? [124] 32.6% [250] 11060(1.3%) 7708(0.9%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [256] 30.3% ----------------------------------------------------------------------------------------- check-hash/c [244] 100.0% [251] 1682(0.2%) 1682(0.2%) flat-contract? .../contract/private/guts.rkt:111:0 ----------------------------------------------------------------------------------------- ??? [243] 100.0% [252] 1306(0.1%) 330(0.0%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ??? [257] 74.7% ----------------------------------------------------------------------------------------- arity-checking-wrapper [248] 100.0% [253] 646(0.1%) 646(0.1%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ----------------------------------------------------------------------------------------- for-loop [227] 0.7% ??? [65] 2.3% ??? [113] 2.5% ??? [195] 5.8% ??? [249] 7.2% ??? [125] 9.5% ??? [232] 72.0% [254] 40462(4.6%) 31390(3.6%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [113] 8.2% contract? [259] 7.9% dict? [258] 6.4% ----------------------------------------------------------------------------------------- ??? [249] 100.0% [255] 7190(0.8%) 6556(0.7%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [260] 8.8% ----------------------------------------------------------------------------------------- match-e [44] 8.4% for-loop [59] 15.1% return/no-unsupplied [250] 76.5% [256] 4382(0.5%) 4382(0.5%) filter ...t/collects/racket/private/list.rkt:256:2 ----------------------------------------------------------------------------------------- ??? [252] 100.0% [257] 976(0.1%) 976(0.1%) ??? ...ects/racket/contract/private/list.rkt:141:5 ----------------------------------------------------------------------------------------- ??? [203] 21.6% ??? [254] 78.4% [258] 3288(0.4%) 3288(0.4%) dict? ...ollects/racket/private/generic.rkt:146:11 ----------------------------------------------------------------------------------------- ??? [254] 100.0% [259] 3188(0.4%) 3188(0.4%) contract? ...acket/contract/private/guts.rkt:109:0 ----------------------------------------------------------------------------------------- ??? [255] 100.0% [260] 634(0.1%) 634(0.1%) ??? ...ects/racket/contract/private/prop.rkt:256:4 -----------------------------------------------------------------------------------------