Profiling results ----------------- Total cpu time observed: 667768ms (out of 670736ms) Number of samples taken: 1976 (once every 338ms) (Hiding functions with self<1.0% and local<2.0%: 22 of 292 hidden) ========================================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================= ??? [74] 100.0% [1] 586264(87.8%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [20] 100.0% ----------------------------------------------------------------------------------------- ??? [74] 100.0% [2] 548724(82.2%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:234:0 for-loop [21] 95.0% get-final-combination [29] 4.6% loop [92] 0.2% prepare-points [93] 0.1% setup-alt-simplified [36] 0.1% ----------------------------------------------------------------------------------------- ??? [223] 100.0% [3] 449372(67.3%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [22] 98.4% map-enodes [30] 1.5% debug-print [241] 0.1% ----------------------------------------------------------------------------------------- ??? [222] 100.0% [4] 80424(12.0%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [23] 97.2% f6 [143] 2.5% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [5] 74472(11.2%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 ??? [41] 93.6% hash-ref! [224] 4.9% simplify [40] 1.5% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [6] 70382(10.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [24] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [7] 63516(9.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 for-loop [25] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [8] 55878(8.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 for-loop [26] 100.0% ----------------------------------------------------------------------------------------- ??? [223] 100.0% [9] 37856(5.7%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [27] 100.0% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [10] 32162(4.8%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [222] 94.4% hash-ref! [224] 5.6% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [11] 31850(4.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 for-loop [28] 100.0% ----------------------------------------------------------------------------------------- copying-mergesort [216] 100.0% [12] 4038(0.6%) 346(0.1%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [144] 68.3% ??? [222] 23.1% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [13] 2662(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:483:23 for-loop [31] 100.0% ----------------------------------------------------------------------------------------- parse-loop12 [153] 36.8% map [148] 63.2% [14] 2606(0.4%) 310(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 for-loop [32] 88.1% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [15] 2236(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [224] 57.6% for-loop [33] 42.4% ----------------------------------------------------------------------------------------- f6 [143] 100.0% [16] 1990(0.3%) 346(0.1%) taylor-invert ...testing/src/core/taylor.rkt:312:0 first-nonzero-exp [34] 49.6% simplify [40] 33.0% ----------------------------------------------------------------------------------------- f6 [143] 100.0% [17] 1958(0.3%) 994(0.1%) combine-mterms ...esting/src/core/reduce.rkt:191:0 for-loop [35] 49.2% ----------------------------------------------------------------------------------------- for-loop [207] 31.9% loop [161] 68.1% [18] 948(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [144] 100.0% ----------------------------------------------------------------------------------------- rewriter [96] 100.0% [19] 932(0.1%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 for-loop [86] 100.0% ----------------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [20] 586264(87.8%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [74] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [21] 521076(78.0%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:249:10 run-iter! [37] 100.0% ----------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [22] 442080(66.2%) 7312(1.1%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [38] 70.3% for-loop [39] 27.8% ----------------------------------------------------------------------------------------- approximate9 [4] 100.0% [23] 78156(11.7%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 ??? [222] 58.8% hash-ref! [224] 41.2% ----------------------------------------------------------------------------------------- ??? [6] 100.0% [24] 70382(10.5%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 ??? [41] 63.7% hash-ref! [224] 32.9% simplify [40] 3.4% ----------------------------------------------------------------------------------------- ??? [7] 100.0% [25] 63516(9.5%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:298:27 hash-ref! [224] 100.0% ----------------------------------------------------------------------------------------- ??? [8] 100.0% [26] 55878(8.4%) 322(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:324:46 hash-ref! [224] 98.9% simplify [40] 0.6% ----------------------------------------------------------------------------------------- loop [9] 100.0% [27] 37856(5.7%) 642(0.1%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [42] 97.4% ----------------------------------------------------------------------------------------- ??? [11] 100.0% [28] 31850(4.8%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:396:33 for-loop [43] 100.0% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [29] 25444(3.8%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:264:0 split-table [44] 98.7% extract-alt [47] 1.3% ----------------------------------------------------------------------------------------- iterate-egraph!13 [3] 100.0% [30] 6956(1.0%) 0(0.0%) map-enodes ...lt-testing/src/core/egraph.rkt:140:0 loop [161] 90.2% for-loop [173] 9.8% ----------------------------------------------------------------------------------------- ??? [13] 100.0% [31] 2662(0.4%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:487:35 parse-loop12 [153] 100.0% ----------------------------------------------------------------------------------------- ??? [14] 100.0% [32] 2296(0.3%) 314(0.0%) for-loop ...e/alt-testing/src/core/reduce.rkt:62:7 pattern-match [45] 86.3% ----------------------------------------------------------------------------------------- ??? [15] 100.0% [33] 1254(0.2%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [224] 100.0% ----------------------------------------------------------------------------------------- taylor-invert [16] 100.0% [34] 988(0.1%) 0(0.0%) first-nonzero-exp ...ing/src/core/taylor.rkt:260:0 hash-ref! [224] 100.0% ----------------------------------------------------------------------------------------- combine-mterms [17] 100.0% [35] 964(0.1%) 310(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:195:5 hash-ref! [224] 67.8% ----------------------------------------------------------------------------------------- run-improve50 [2] 100.0% [36] 362(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [46] 100.0% ----------------------------------------------------------------------------------------- for-loop [21] 100.0% [37] 521076(78.0%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:215:0 simplify! [48] 78.9% gen-series! [51] 15.4% finalize-iter! [53] 4.2% choose-best-alt! [56] 0.7% gen-rewrites! [57] 0.5% localize-error [59] 0.2% ----------------------------------------------------------------------------------------- one-iter [22] 100.0% [38] 310854(46.6%) 1334(0.2%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [49] 83.2% match-e [50] 9.5% update-leader! [77] 6.4% reduce-to-single! [58] 0.4% ----------------------------------------------------------------------------------------- for-loop [39] 48.5% one-iter [22] 51.5% [39] 122964(18.4%) 31144(4.7%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [39] 48.5% match-e [50] 37.2% ??? [95] 0.1% ----------------------------------------------------------------------------------------- for-loop [26] 0.4% parse-loop12 [153] 0.8% taylor-invert [16] 0.8% for-loop [164] 0.9% ??? [5] 1.4% for-loop [24] 6.3% hash-ref! [224] 87.7% [40] 78128(11.7%) 324(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f6 [143] 60.3% parse-loop12 [153] 31.7% debug-print [241] 3.3% simplify-node [54] 2.5% simplify* [172] 1.3% make-multiplication-node [174] 0.4% ----------------------------------------------------------------------------------------- ??? [5] 37.8% for-loop [24] 62.2% [41] 70724(10.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [224] 100.0% ----------------------------------------------------------------------------------------- pass [27] 100.0% [42] 36858(5.5%) 682(0.1%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [52] 77.0% loop [55] 18.4% for-loop [60] 2.7% ----------------------------------------------------------------------------------------- for-loop [28] 100.0% [43] 31850(4.8%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:398:39 hash-ref! [224] 100.0% ----------------------------------------------------------------------------------------- get-final-combination [29] 100.0% [44] 25110(3.8%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f6 [143] 100.0% ----------------------------------------------------------------------------------------- for-loop [61] 15.6% for-loop [32] 84.4% [45] 1982(0.3%) 1312(0.2%) pattern-match ...testing/src/core/matcher.rkt:48:0 for-loop [61] 33.8% ??? [114] 7.8% ----------------------------------------------------------------------------------------- setup-alt-simplified [36] 100.0% [46] 362(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 ??? [223] 100.0% ----------------------------------------------------------------------------------------- get-final-combination [29] 100.0% [47] 334(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 loop [233] 100.0% ----------------------------------------------------------------------------------------- run-iter! [37] 100.0% [48] 411248(61.6%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:155:0 for-loop [62] 100.0% ----------------------------------------------------------------------------------------- for-loop [38] 100.0% [49] 258584(38.7%) 1772(0.3%) for-loop ...t-testing/src/core/simplify.rkt:148:10 mk-enode! [75] 28.3% merge-egraph-nodes! [64] 27.3% loop! [168] 20.3% substitute-e [66] 17.7% list-member? [228] 5.6% ----------------------------------------------------------------------------------------- for-loop [38] 14.9% for-loop [78] 24.3% for-loop [39] 60.8% [50] 121152(18.1%) 50238(7.5%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [65] 41.8% for-loop [78] 8.2% ??? [114] 7.1% variable? [94] 3.0% list-cartesian-product [80] 1.8% custom-in-set [104] 1.2% loop [161] 1.0% curry* [98] 0.6% ----------------------------------------------------------------------------------------- run-iter! [37] 100.0% [51] 80424(12.0%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:129:0 for-loop [63] 100.0% ----------------------------------------------------------------------------------------- for-loop [42] 100.0% [52] 28378(4.2%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [67] 97.8% expression-cost [71] 2.2% ----------------------------------------------------------------------------------------- run-iter! [37] 100.0% [53] 21968(3.3%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:169:0 ??? [114] 100.0% ----------------------------------------------------------------------------------------- simplify [40] 28.7% map [148] 71.3% [54] 6846(1.0%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 f6 [143] 43.1% append-map [68] 37.3% combine-aterms [70] 19.7% ----------------------------------------------------------------------------------------- for-loop [42] 100.0% [55] 6792(1.0%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [67] 90.7% expression-cost [71] 9.3% ----------------------------------------------------------------------------------------- run-iter! [37] 100.0% [56] 3868(0.6%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:115:0 ??? [114] 100.0% ----------------------------------------------------------------------------------------- run-iter! [37] 100.0% [57] 2546(0.4%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:142:0 for-loop [69] 100.0% ----------------------------------------------------------------------------------------- for-loop [38] 100.0% [58] 1288(0.2%) 332(0.0%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 for-loop [72] 49.1% for-loop [73] 25.2% ----------------------------------------------------------------------------------------- run-iter! [37] 100.0% [59] 1022(0.2%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [224] 69.1% ??? [198] 30.9% ----------------------------------------------------------------------------------------- for-loop [42] 100.0% [60] 1006(0.2%) 1006(0.2%) for-loop ...t-testing/src/core/simplify.rkt:217:13 ----------------------------------------------------------------------------------------- pattern-match [45] 100.0% [61] 980(0.1%) 360(0.1%) for-loop .../alt-testing/src/core/matcher.rkt:66:9 pattern-match [45] 63.3% ----------------------------------------------------------------------------------------- simplify! [48] 100.0% [62] 411248(61.6%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:159:6 ??? [74] 99.9% debug-print [241] 0.1% ----------------------------------------------------------------------------------------- gen-series! [51] 100.0% [63] 80424(12.0%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:135:7 taylor-alt [76] 100.0% ----------------------------------------------------------------------------------------- for-loop [81] 3.6% merge-egraph-nodes! [64] 7.2% for-loop [49] 89.2% [64] 70592(10.6%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [77] 53.0% loop! [168] 15.2% for-loop [79] 14.3% merge-egraph-nodes! [64] 7.2% for-loop [81] 4.5% enode-merge! [82] 4.4% make-sequence [191] 0.9% for-loop [86] 0.4% ----------------------------------------------------------------------------------------- match-e [50] 100.0% [65] 66546(10.0%) 21296(3.2%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [78] 58.1% list-cartesian-product [80] 8.8% loop [161] 4.4% curry* [98] 1.0% curried [221] 0.8% filter [263] 0.3% ----------------------------------------------------------------------------------------- substitute-e [66] 6.7% for-loop [49] 93.3% [66] 45854(6.9%) 1326(0.2%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [75] 86.9% substitute-e [66] 6.7% ??? [114] 2.2% variable? [94] 1.6% ----------------------------------------------------------------------------------------- loop [55] 18.2% argmin [52] 81.8% [67] 33914(5.1%) 1708(0.3%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ??? [223] 74.6% ...sting/src/common.rkt:47:2 [117] 19.4% ??? [116] 0.9% ----------------------------------------------------------------------------------------- parse-loop12 [153] 6.1% simplify-node [54] 15.3% f6 [143] 78.6% [68] 7454(1.1%) 968(0.1%) append-map ...acket/collects/racket/list.rkt:565:2 f6 [143] 52.2% parse-loop12 [153] 29.8% free-variables [83] 11.7% loop [88] 2.2% ----------------------------------------------------------------------------------------- gen-rewrites! [57] 100.0% [69] 2546(0.4%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:147:11 ??? [84] 100.0% ----------------------------------------------------------------------------------------- simplify-node [54] 100.0% [70] 1346(0.2%) 662(0.1%) combine-aterms ...esting/src/core/reduce.rkt:183:0 for-loop [87] 50.8% ----------------------------------------------------------------------------------------- argmin [52] 49.8% loop [55] 50.2% [71] 1256(0.2%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 compile [85] 100.0% ----------------------------------------------------------------------------------------- reduce-to-single! [58] 100.0% [72] 632(0.1%) 632(0.1%) for-loop .../alt-testing/src/core/egraph.rkt:326:8 ----------------------------------------------------------------------------------------- reduce-to-single! [58] 100.0% [73] 324(0.0%) 324(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:329:21 ----------------------------------------------------------------------------------------- for-loop [62] 20.7% run [20] 33.9% [74] 662868(99.3%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 33.9% ??? [223] 31.8% run-improve50 [2] 31.3% loop [92] 1.7% prepare-points [93] 1.4% ----------------------------------------------------------------------------------------- mk-enode-rec! [245] 0.6% substitute-e [66] 35.0% for-loop [49] 64.4% [75] 113776(17.0%) 10646(1.6%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [89] 88.3% hash-has-key? [121] 2.1% ----------------------------------------------------------------------------------------- for-loop [63] 100.0% [76] 80424(12.0%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [90] 100.0% ----------------------------------------------------------------------------------------- for-loop [38] 32.3% merge-egraph-nodes! [64] 67.7% [77] 61908(9.3%) 2236(0.3%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [91] 94.7% hash-ref! [224] 0.6% update-en-expr [181] 0.6% ----------------------------------------------------------------------------------------- match-e [50] 28.4% for-loop [65] 71.6% [78] 57768(8.7%) 2644(0.4%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [50] 92.0% ??? [95] 4.2% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [64] 100.0% [79] 10252(1.5%) 7302(1.1%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [181] 28.8% ----------------------------------------------------------------------------------------- match-e [50] 18.9% list-cartesian-product [80] 21.1% for-loop [65] 60.0% [80] 9726(1.5%) 8680(1.3%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [80] 21.1% for-loop [99] 9.0% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [64] 100.0% [81] 6030(0.9%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [64] 88.7% loop! [168] 11.3% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [64] 100.0% [82] 3436(0.5%) 1372(0.2%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [97] 60.1% ----------------------------------------------------------------------------------------- mterm->expr [217] 33.5% append-map [68] 66.5% [83] 3000(0.4%) 0(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 ??? [114] 67.9% variable? [94] 32.1% ----------------------------------------------------------------------------------------- for-loop [69] 100.0% [84] 2546(0.4%) 0(0.0%) ??? ...herbie/alt-testing/src/alternative.rkt:88:0 rewriter [96] 100.0% ----------------------------------------------------------------------------------------- expression-cost [71] 100.0% [85] 1256(0.2%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [224] 100.0% ----------------------------------------------------------------------------------------- merge-egraph-nodes! [64] 25.0% *rules* [19] 75.0% [86] 1242(0.2%) 310(0.0%) for-loop ...herbie/alt-testing/src/common.rkt:99:9 ormap [234] 26.2% curry* [98] 24.5% flag-set? [246] 24.3% ----------------------------------------------------------------------------------------- combine-aterms [70] 100.0% [87] 684(0.1%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:185:4 hash-ref! [224] 100.0% ----------------------------------------------------------------------------------------- append-map [68] 100.0% [88] 326(0.0%) 326(0.0%) loop ...are/racket/collects/racket/list.rkt:414:34 ----------------------------------------------------------------------------------------- mk-enode! [75] 100.0% [89] 100446(15.0%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [100] 99.6% set [182] 0.4% ----------------------------------------------------------------------------------------- taylor-alt [76] 100.0% [90] 80424(12.0%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [222] 100.0% ----------------------------------------------------------------------------------------- update-leader! [77] 100.0% [91] 58626(8.8%) 1652(0.2%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [101] 97.2% ----------------------------------------------------------------------------------------- run-improve50 [2] 4.7% ??? [74] 95.3% [92] 23262(3.5%) 302(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 loop [102] 36.8% loop [111] 31.5% make-exacts* [110] 24.0% for-loop [105] 6.5% ----------------------------------------------------------------------------------------- run-improve50 [2] 4.0% ??? [74] 96.0% [93] 18996(2.8%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [102] 36.6% loop [111] 30.4% make-exacts* [110] 29.6% for-loop [105] 3.5% ----------------------------------------------------------------------------------------- expression->type [157] 2.5% free-variables [83] 7.6% substitute-e [66] 15.7% match-e [50] 74.2% [94] 12612(1.9%) 328(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [114] 97.4% ----------------------------------------------------------------------------------------- for-loop [39] 10.2% for-loop [78] 89.8% [95] 2908(0.4%) 1334(0.2%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 for-loop [106] 43.9% custom-in-set [104] 10.2% ----------------------------------------------------------------------------------------- ??? [84] 30.5% matcher [112] 69.5% [96] 2546(0.4%) 312(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 for-loop [103] 73.1% *rules* [19] 12.1% expression->type [157] 4.4% f6 [143] 4.3% ----------------------------------------------------------------------------------------- enode-merge! [82] 100.0% [97] 2064(0.3%) 718(0.1%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [180] 65.2% ----------------------------------------------------------------------------------------- for-loop [86] 18.4% for-loop [65] 40.0% match-e [50] 41.5% [98] 1648(0.2%) 642(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [107] 61.0% ----------------------------------------------------------------------------------------- list-cartesian-product [80] 100.0% [99] 1046(0.2%) 1046(0.2%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 ----------------------------------------------------------------------------------------- new-enode [89] 100.0% [100] 100084(15.0%) 1968(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [108] 98.0% ----------------------------------------------------------------------------------------- for-loop [91] 100.0% [101] 56974(8.5%) 0(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [109] 100.0% ----------------------------------------------------------------------------------------- prepare-points [93] 44.8% loop [92] 55.2% [102] 15500(2.3%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [110] 60.3% loop [111] 39.7% ----------------------------------------------------------------------------------------- rewriter [96] 100.0% [103] 2546(0.4%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:134:10 matcher [112] 100.0% ----------------------------------------------------------------------------------------- ??? [95] 13.0% match-e [50] 87.0% [104] 2288(0.3%) 2288(0.3%) custom-in-set ...acket/private/set-types.rkt:577:0 ----------------------------------------------------------------------------------------- prepare-points [93] 30.5% loop [92] 69.5% [105] 2176(0.3%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [113] 100.0% ----------------------------------------------------------------------------------------- ??? [95] 100.0% [106] 1276(0.2%) 930(0.1%) for-loop ...e/alt-testing/src/core/ematch.rkt:51:7 ??? [114] 27.1% ----------------------------------------------------------------------------------------- curry* [98] 100.0% [107] 1006(0.2%) 1006(0.2%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ----------------------------------------------------------------------------------------- type-of-enode-expr [100] 100.0% [108] 98116(14.7%) 348(0.1%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [116] 35.9% ??? [223] 33.6% ...sting/src/common.rkt:47:2 [117] 15.3% ??? [114] 14.8% ----------------------------------------------------------------------------------------- for-loop [101] 100.0% [109] 56974(8.5%) 334(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [115] 99.4% ----------------------------------------------------------------------------------------- loop [92] 27.2% prepare-points [93] 27.3% loop [102] 45.5% [110] 20546(3.1%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [161] 82.9% eval-prog [140] 17.1% ----------------------------------------------------------------------------------------- prepare-points [93] 30.0% loop [102] 32.0% loop [92] 38.0% [111] 19234(2.9%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [161] 100.0% ----------------------------------------------------------------------------------------- matcher [112] 18.1% for-loop [118] 31.4% for-loop [103] 50.6% [112] 2546(0.4%) 360(0.1%) matcher .../alt-testing/src/core/matcher.rkt:167:2 rewriter [96] 48.5% for-loop [118] 31.4% matcher [112] 18.1% ----------------------------------------------------------------------------------------- for-loop [105] 100.0% [113] 2176(0.3%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 for-loop [119] 100.0% ----------------------------------------------------------------------------------------- expression->type [157] 0.4% pattern-match [45] 0.4% debug7 [248] 0.4% for-loop [106] 0.5% f6 [143] 0.5% ??? [260] 0.7% free-variables [83] 2.7% substitute-e [66] 3.6% choose-best-alt! [56] 5.2% variable? [94] 16.5% get-sigs [108] 19.6% match-e [50] 20.6% finalize-iter! [53] 28.9% [114] 74356(11.1%) 24264(3.6%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [121] 32.4% for-loop [122] 28.4% atab-pick-alt8 [127] 5.2% ??? [260] 0.5% ----------------------------------------------------------------------------------------- hash-update! [109] 100.0% [115] 56640(8.5%) 646(0.1%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [120] 98.9% ----------------------------------------------------------------------------------------- ??? [222] 0.9% for-loop [67] 0.9% f6 [143] 1.8% get-sigs [108] 96.5% [116] 36494(5.5%) 1248(0.2%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [123] 50.4% for-loop [124] 35.5% get/build-late-neg-projection [141] 10.7% ----------------------------------------------------------------------------------------- f6 [143] 1.6% ??? [222] 2.8% for-loop [67] 29.0% get-sigs [108] 66.5% [117] 22640(3.4%) 5704(0.9%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [125] 41.5% ??? [126] 33.3% ----------------------------------------------------------------------------------------- matcher [112] 100.0% [118] 2546(0.4%) 0(0.0%) for-loop ...lt-testing/src/core/matcher.rkt:183:21 matcher [112] 100.0% ----------------------------------------------------------------------------------------- ??? [113] 100.0% [119] 2176(0.3%) 320(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:231:9 ??? [222] 85.3% ----------------------------------------------------------------------------------------- ??? [115] 100.0% [120] 55994(8.4%) 47056(7.0%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [181] 16.0% ----------------------------------------------------------------------------------------- mk-enode! [75] 8.7% ??? [114] 91.3% [121] 26932(4.0%) 9598(1.4%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [227] 59.2% ??? [231] 5.1% ----------------------------------------------------------------------------------------- ??? [114] 100.0% [122] 21640(3.2%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:52:2 atab-add-altn [128] 100.0% ----------------------------------------------------------------------------------------- ??? [116] 100.0% [123] 18386(2.8%) 1048(0.2%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [129] 94.3% ----------------------------------------------------------------------------------------- for-loop [237] 24.2% ??? [116] 75.8% [124] 17068(2.6%) 3856(0.6%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [238] 69.9% ??? [255] 7.6% ----------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [117] 100.0% [125] 9388(1.4%) 1910(0.3%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [252] 44.2% assoc-ref [131] 21.5% return/no-unsupplied [253] 14.0% ----------------------------------------------------------------------------------------- for-loop [256] 6.6% ??? [238] 17.1% ...sting/src/common.rkt:47:2 [117] 76.3% [126] 7548(1.1%) 1264(0.2%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [238] 63.8% ??? [260] 17.4% ??? [257] 8.3% ----------------------------------------------------------------------------------------- ??? [114] 100.0% [127] 3868(0.6%) 0(0.0%) atab-pick-alt8 ...ting/src/core/alt-table.rkt:61:0 point-best-alt [130] 63.3% ??? [222] 18.3% for-loop [132] 9.8% for-loop [133] 8.6% ----------------------------------------------------------------------------------------- for-loop [122] 98.5% [128] 21968(3.3%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:243:0 best-and-tied-at-points [134] 94.0% override-at-pnts [136] 6.0% ----------------------------------------------------------------------------------------- ??? [123] 100.0% [129] 17338(2.6%) 634(0.1%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [135] 96.3% ----------------------------------------------------------------------------------------- atab-pick-alt8 [127] 100.0% [130] 2448(0.4%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:55:0 loop [161] 100.0% ----------------------------------------------------------------------------------------- ??? [125] 100.0% [131] 2014(0.3%) 2014(0.3%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ----------------------------------------------------------------------------------------- atab-pick-alt8 [127] 100.0% [132] 378(0.1%) 378(0.1%) for-loop ...lt-testing/src/core/alt-table.rkt:81:2 ----------------------------------------------------------------------------------------- atab-pick-alt8 [127] 100.0% [133] 334(0.1%) 334(0.1%) for-loop ...lt-testing/src/core/alt-table.rkt:88:2 ----------------------------------------------------------------------------------------- atab-add-altn [128] 100.0% [134] 20658(3.1%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:157:0 errors [137] 98.3% ----------------------------------------------------------------------------------------- ??? [129] 100.0% [135] 16704(2.5%) 672(0.1%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [138] 96.0% ----------------------------------------------------------------------------------------- atab-add-altn [128] 100.0% [136] 1310(0.2%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:180:0 errors [137] 100.0% ----------------------------------------------------------------------------------------- override-at-pnts [136] 3.6% composed [240] 3.8% option-on-expr [169] 12.0% loop [161] 24.0% best-and-tied-at-points [134] 56.5% [137] 35936(5.4%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [139] 82.4% eval-prog [140] 17.6% ----------------------------------------------------------------------------------------- ??? [135] 100.0% [138] 16032(2.4%) 3306(0.5%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [142] 42.2% get/build-late-neg-projection [141] 37.2% ----------------------------------------------------------------------------------------- errors [137] 100.0% [139] 29616(4.4%) 728(0.1%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [144] 87.6% ulp-difference [147] 7.8% ??? [222] 2.2% ----------------------------------------------------------------------------------------- option-on-expr [169] 2.7% point->alt [195] 3.0% sindices->spoints [193] 3.2% make-exacts* [110] 32.5% errors [137] 58.6% [140] 10790(1.6%) 4346(0.7%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 hash-ref! [224] 29.5% f6 [143] 27.5% ??? [176] 2.8% ----------------------------------------------------------------------------------------- ??? [146] 14.8% ??? [116] 23.3% for-loop [138] 60.3% [141] 9886(1.5%) 3330(0.5%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [145] 51.2% ??? [146] 18.4% ----------------------------------------------------------------------------------------- for-loop [138] 100.0% [142] 6762(1.0%) 6762(1.0%) add-list-context ...ontract/private/list.rkt:752:0 ----------------------------------------------------------------------------------------- for-loop [165] 0.1% mterm->expr [217] 0.2% rewriter [96] 0.4% composed [240] 0.5% for-loop [162] 0.6% eval-prog [140] 0.8% hash-ref! [224] 0.8% approximate9 [4] 1.0% simplify-node [54] 1.4% loop [161] 1.9% append-map [68] 2.4% parse-loop12 [153] 5.6% f6 [143] 7.1% simplify [40] 21.2% map [148] 27.0% split-table [44] 28.8% [143] 83638(12.5%) 13692(2.1%) f6 ...et/collects/racket/match/compiler.rkt:507:40 map [148] 47.9% loop [161] 25.6% f6 [143] 7.1% append-map [68] 3.3% option-on-expr [169] 3.2% parse-loop12 [153] 1.0% ??? [222] 0.8% ??? [223] 0.7% gather-multiplicative-terms [159] 0.7% taylor-invert [16] 0.6% loop [151] 0.5% composed [240] 0.5% combine-mterms [17] 0.3% parse-app [163] 0.2% ??? [116] 0.2% expression->type [157] 0.1% taylor [232] 0.1% ...sting/src/common.rkt:47:2 [117] 0.1% ??? [114] 0.1% ----------------------------------------------------------------------------------------- ??? [18] 1.4% jloop [12] 4.0% loop [220] 8.6% for-loop [139] 37.2% loop [161] 48.9% [144] 69780(10.4%) 2008(0.3%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [149] 68.4% ??? [222] 10.0% ??? [171] 9.0% loop [161] 8.2% ??? [152] 1.5% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [141] 100.0% [145] 6196(0.9%) 1618(0.2%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [150] 73.9% ----------------------------------------------------------------------------------------- get/build-late-neg-projection [141] 100.0% [146] 3286(0.5%) 360(0.1%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [141] 89.0% ----------------------------------------------------------------------------------------- for-loop [139] 100.0% [147] 2300(0.3%) 678(0.1%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [253] 57.0% ??? [252] 13.6% ----------------------------------------------------------------------------------------- gather-multiplicative-terms [159] 1.4% parse-loop12 [153] 9.2% f6 [143] 89.4% [148] 50776(7.6%) 620(0.1%) map ...acket/collects/racket/private/map.rkt:20:13 f6 [143] 53.2% parse-loop12 [153] 31.5% simplify* [172] 2.9% simplify-node [54] 2.5% loop [161] 2.2% make-multiplication-node [174] 2.1% gather-multiplicative-terms [159] 1.4% ??? [14] 1.2% taylor [232] 0.6% ----------------------------------------------------------------------------------------- ??? [144] 100.0% [149] 47764(7.2%) 19520(2.9%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [170] 20.7% ??? [154] 11.9% bf* [155] 9.9% ??? [175] 7.2% for-loop [158] 5.2% ...higher-order.rkt:346:33 [160] 1.5% ??? [255] 1.4% parse-loop12 [153] 0.7% ----------------------------------------------------------------------------------------- contract-struct-name [156] 10.9% ??? [145] 89.1% [150] 4578(0.7%) 2290(0.3%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [156] 60.8% ----------------------------------------------------------------------------------------- f6 [143] 100.0% [151] 2018(0.3%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 expression->type [157] 100.0% ----------------------------------------------------------------------------------------- ??? [144] 100.0% [152] 1050(0.2%) 654(0.1%) ??? ...tract/private/arrow-higher-order.rkt:145:21 ??? [260] 37.7% ----------------------------------------------------------------------------------------- ??? [149] 0.6% hash-ref! [224] 1.3% f6 [143] 2.4% loop [161] 4.8% for-loop [31] 5.1% append-map [68] 5.5% simplify [40] 19.6% parse-loop12 [153] 28.4% map [148] 32.3% [153] 52302(7.8%) 31378(4.7%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 parse-loop12 [153] 28.4% f6 [143] 12.1% loop [161] 9.9% map [148] 6.7% for-loop [164] 3.9% make-multiplication-node [174] 2.5% simplify* [172] 2.5% for-loop [165] 2.0% parse-app [163] 1.6% simplify [40] 1.2% make-keyword-procedure [262] 0.7% ??? [14] 0.6% append-map [68] 0.3% ----------------------------------------------------------------------------------------- ??? [149] 100.0% [154] 5686(0.9%) 3632(0.5%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ??? [252] 18.1% return/no-unsupplied [253] 18.0% ----------------------------------------------------------------------------------------- ??? [149] 100.0% [155] 4724(0.7%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [170] 100.0% ----------------------------------------------------------------------------------------- build-compound-type-name [150] 100.0% [156] 3282(0.5%) 2288(0.3%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [150] 30.3% ----------------------------------------------------------------------------------------- f6 [143] 5.6% rewriter [96] 10.3% loop [151] 23.5% for-loop [162] 60.5% [157] 2962(0.4%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 for-loop [162] 89.7% variable? [94] 5.3% ??? [114] 5.1% ----------------------------------------------------------------------------------------- ??? [149] 100.0% [158] 2484(0.4%) 708(0.1%) for-loop ...lt-testing/src/syntax/syntax.rkt:531:2 bf< [166] 41.5% ...higher-order.rkt:342:33 [167] 30.0% ----------------------------------------------------------------------------------------- map [148] 44.3% f6 [143] 55.7% [159] 1950(0.3%) 1636(0.2%) gather-multiplicative-terms ...re/reduce.rkt:116:0 map [148] 44.3% compose [212] 8.1% ----------------------------------------------------------------------------------------- ??? [149] 100.0% [160] 728(0.1%) 0(0.0%) ...higher-order.rkt:346:33 (unknown source) ??? [238] 57.7% ??? [260] 42.3% ----------------------------------------------------------------------------------------- make-exacts* [110] 0.6% loop [111] 0.8% map-enodes [30] 0.8% point-best-alt [130] 1.1% map [148] 1.2% match-e [50] 1.3% ??? [144] 1.5% option-on-expr [169] 1.8% ??? [229] 1.9% for-loop [65] 2.4% loop! [168] 7.7% parse-loop12 [153] 7.8% f6 [143] 11.1% loop [161] 60.1% [161] 129570(19.4%) 4676(0.7%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [161] 60.1% option-on-expr [169] 11.1% loop! [168] 7.5% parse-loop12 [153] 6.8% errors [137] 2.9% hash-ref! [224] 1.9% f6 [143] 1.8% ??? [222] 1.4% ??? [144] 1.4% foldl [177] 0.8% for-loop [173] 0.8% curried [221] 0.5% simplify* [172] 0.3% ??? [171] 0.1% ??? [18] 0.0% ??? [170] 0.0% set-precompute! [179] 0.0% ??? [175] 0.0% ----------------------------------------------------------------------------------------- expression->type [157] 100.0% [162] 2962(0.4%) 0(0.0%) for-loop ...ie/alt-testing/src/type-check.rkt:52:5 expression->type [157] 70.9% f6 [143] 29.1% ----------------------------------------------------------------------------------------- parse-loop12 [153] 49.2% f6 [143] 50.8% [163] 2770(0.4%) 2084(0.3%) parse-app .../collects/racket/private/kw.rkt:951:2 loop [178] 24.8% ----------------------------------------------------------------------------------------- parse-loop12 [153] 100.0% [164] 2032(0.3%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:490:59 hash-ref! [224] 66.3% simplify [40] 33.7% ----------------------------------------------------------------------------------------- parse-loop12 [153] 100.0% [165] 1572(0.2%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:99:13 make-multiplication-node [174] 59.7% f6 [143] 40.3% ----------------------------------------------------------------------------------------- for-loop [158] 100.0% [166] 1030(0.2%) 0(0.0%) bf< ...th/private/bigfloat/bigfloat-mpfr.rkt:127:4 ??? [176] 100.0% ----------------------------------------------------------------------------------------- for-loop [158] 100.0% [167] 746(0.1%) 396(0.1%) ...higher-order.rkt:342:33 (unknown source) ??? [260] 46.9% ----------------------------------------------------------------------------------------- for-loop [81] 0.5% merge-egraph-nodes! [64] 14.8% loop [161] 27.4% for-loop [49] 57.2% [168] 66572(10.0%) 17054(2.6%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [180] 40.5% loop [161] 30.0% set [182] 9.2% update-en-expr [181] 5.2% ----------------------------------------------------------------------------------------- f6 [143] 10.8% loop [161] 89.2% [169] 25110(3.8%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [183] 41.4% loop [161] 27.2% errors [137] 17.2% err-lsts->split-indices [188] 9.1% sindices->spoints [193] 1.4% point->alt [195] 1.3% pick-errors [196] 1.2% eval-prog [140] 1.2% ----------------------------------------------------------------------------------------- loop [161] 2.3% bf* [155] 31.6% ??? [149] 66.1% [170] 14946(2.2%) 3440(0.5%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [184] 60.6% bfneg [187] 16.3% ----------------------------------------------------------------------------------------- loop [161] 32.2% ??? [144] 67.8% [171] 9234(1.4%) 408(0.1%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [185] 95.6% ----------------------------------------------------------------------------------------- loop [161] 7.6% simplify [40] 11.4% parse-loop12 [153] 21.3% map [148] 59.7% [172] 9000(1.3%) 3698(0.6%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [224] 21.9% ??? [190] 18.9% return/no-unsupplied [253] 18.1% ----------------------------------------------------------------------------------------- map-enodes [30] 10.3% loop [161] 89.7% [173] 6630(1.0%) 2952(0.4%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [189] 30.6% eval-const-expr [192] 14.6% compose [212] 10.3% ----------------------------------------------------------------------------------------- simplify [40] 6.5% for-loop [165] 17.9% parse-loop12 [153] 25.1% map [148] 50.6% [174] 5236(0.8%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [186] 100.0% ----------------------------------------------------------------------------------------- loop [161] 9.4% ??? [149] 90.6% [175] 3800(0.6%) 3800(0.6%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ----------------------------------------------------------------------------------------- eval-prog [140] 22.8% bf< [166] 77.2% [176] 1334(0.2%) 1030(0.2%) ??? ...tract/private/arrow-higher-order.rkt:346:33 ??? [255] 22.8% ----------------------------------------------------------------------------------------- loop [161] 100.0% [177] 1030(0.2%) 696(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [194] 32.4% ----------------------------------------------------------------------------------------- parse-app [163] 100.0% [178] 686(0.1%) 686(0.1%) loop .../collects/racket/private/stxcase.rkt:112:7 ----------------------------------------------------------------------------------------- loop [161] 100.0% [179] 326(0.0%) 0(0.0%) set-precompute! ...ing/src/core/simplify.rkt:193:0 make-sequence [191] 100.0% ----------------------------------------------------------------------------------------- adopt-enode! [97] 4.5% loop! [168] 95.5% [180] 30178(4.5%) 9782(1.5%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [197] 60.0% for-loop [201] 7.6% ----------------------------------------------------------------------------------------- update-leader! [77] 1.8% for-loop [79] 15.3% loop! [168] 36.6% for-loop [120] 46.3% [181] 19314(2.9%) 18980(2.8%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ----------------------------------------------------------------------------------------- new-enode [89] 3.0% loop! [168] 97.0% [182] 12260(1.8%) 12260(1.8%) set ...collects/racket/private/set-types.rkt:981:0 ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [183] 10400(1.6%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [198] 100.0% ----------------------------------------------------------------------------------------- ??? [170] 100.0% [184] 9064(1.4%) 6638(1.0%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [199] 26.8% ----------------------------------------------------------------------------------------- ??? [171] 100.0% [185] 8826(1.3%) 6664(1.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [199] 24.5% ----------------------------------------------------------------------------------------- make-multiplication-node [174] 100.0% [186] 5236(0.8%) 338(0.1%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [200] 62.8% group-by68 [203] 24.5% compose [212] 6.2% ----------------------------------------------------------------------------------------- ??? [170] 100.0% [187] 2442(0.4%) 2098(0.3%) bfneg ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [199] 14.1% ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [188] 2292(0.3%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 add-splitpoint [202] 100.0% ----------------------------------------------------------------------------------------- for-loop [173] 100.0% [189] 2028(0.3%) 1030(0.2%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 for-loop [204] 49.2% ----------------------------------------------------------------------------------------- simplify* [172] 100.0% [190] 1700(0.3%) 340(0.1%) ??? ...racket/collects/racket/private/kw.rkt:762:9 ??? [261] 59.8% ??? [260] 20.2% ----------------------------------------------------------------------------------------- set-precompute! [179] 32.7% merge-egraph-nodes! [64] 67.3% [191] 996(0.1%) 662(0.1%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [206] 33.5% ----------------------------------------------------------------------------------------- for-loop [173] 100.0% [192] 968(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 ??? [205] 100.0% ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [193] 344(0.1%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 eval-prog [140] 100.0% ----------------------------------------------------------------------------------------- foldl [177] 100.0% [194] 334(0.1%) 334(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [195] 324(0.0%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [140] 100.0% ----------------------------------------------------------------------------------------- option-on-expr [169] 100.0% [196] 302(0.0%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 for-loop [207] 100.0% ----------------------------------------------------------------------------------------- custom-set-union [180] 100.0% [197] 18104(2.7%) 4668(0.7%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [208] 74.2% ----------------------------------------------------------------------------------------- localize-error [59] 2.9% sort-context-on-expr [183] 97.1% [198] 10716(1.6%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [209] 78.3% loop [220] 18.8% errors-score [215] 2.9% ----------------------------------------------------------------------------------------- bfneg [187] 7.0% real->bigfloat [185] 43.8% bfsub [184] 49.2% [199] 4932(0.7%) 4932(0.7%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ----------------------------------------------------------------------------------------- make-multiplication-subnode [186] 100.0% [200] 3288(0.5%) 0(0.0%) for-loop .../alt-testing/src/core/reduce.rkt:242:3 make-multiplication-subsubsubnode [211] 59.6% mterm->expr [217] 21.5% partition [214] 9.7% compose [212] 9.2% ----------------------------------------------------------------------------------------- custom-set-union [180] 100.0% [201] 2292(0.3%) 2292(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 ----------------------------------------------------------------------------------------- err-lsts->split-indices [188] 100.0% [202] 2292(0.3%) 314(0.0%) add-splitpoint ...sting/src/core/regimes.rkt:253:2 for-loop [210] 86.3% ----------------------------------------------------------------------------------------- make-multiplication-subnode [186] 100.0% [203] 1284(0.2%) 1284(0.2%) group-by68 ...acket/collects/racket/list.rkt:749:0 ----------------------------------------------------------------------------------------- setfindf [189] 100.0% [204] 998(0.1%) 998(0.1%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 ----------------------------------------------------------------------------------------- eval-const-expr [192] 100.0% [205] 968(0.1%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [213] 100.0% ----------------------------------------------------------------------------------------- make-sequence [191] 100.0% [206] 334(0.1%) 334(0.1%) ??? ...acket/collects/racket/private/for.rkt:429:7 ----------------------------------------------------------------------------------------- pick-errors [196] 100.0% [207] 302(0.0%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:203:2 ??? [18] 100.0% ----------------------------------------------------------------------------------------- for-loop [197] 100.0% [208] 13436(2.0%) 13436(2.0%) for-loop ...cts/racket/private/set-types.rkt:178:5 ----------------------------------------------------------------------------------------- ??? [198] 100.0% [209] 8386(1.3%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [216] 79.8% loop [220] 20.2% ----------------------------------------------------------------------------------------- add-splitpoint [202] 100.0% [210] 1978(0.3%) 0(0.0%) for-loop ...alt-testing/src/core/regimes.rkt:255:4 for-loop [218] 100.0% ----------------------------------------------------------------------------------------- make-multiplication-subsubsubnode [211] 25.1% for-loop [200] 74.9% [211] 1960(0.3%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [217] 74.9% make-multiplication-subsubsubnode [211] 25.1% ----------------------------------------------------------------------------------------- for-loop [200] 18.6% gather-multiplicative-terms [159] 19.3% make-multiplication-subnode [186] 20.1% for-loop [173] 42.0% [212] 1624(0.2%) 1624(0.2%) compose ...collects/racket/private/list.rkt:385:12 ----------------------------------------------------------------------------------------- ??? [205] 100.0% [213] 968(0.1%) 0(0.0%) unpack245 ...private/arrow-higher-order.rkt:354:44 maybe-cons-kwd [219] 100.0% ----------------------------------------------------------------------------------------- for-loop [200] 100.0% [214] 320(0.0%) 320(0.0%) partition ...racket/collects/racket/list.rkt:547:0 ----------------------------------------------------------------------------------------- ??? [198] 100.0% [215] 316(0.0%) 316(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 ----------------------------------------------------------------------------------------- generic-sort/key [209] 40.7% copying-mergesort [216] 59.3% [216] 6688(1.0%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [216] 59.3% loop [220] 25.6% jloop [12] 15.1% ----------------------------------------------------------------------------------------- for-loop [200] 26.5% make-multiplication-subsubsubnode [211] 73.5% [217] 2666(0.4%) 994(0.1%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 free-variables [83] 37.7% f6 [143] 25.0% ----------------------------------------------------------------------------------------- for-loop [210] 100.0% [218] 1978(0.3%) 1646(0.2%) for-loop ...alt-testing/src/core/regimes.rkt:259:8 curried [221] 16.8% ----------------------------------------------------------------------------------------- unpack245 [213] 100.0% [219] 968(0.1%) 0(0.0%) maybe-cons-kwd ...ate/arrow-higher-order.rkt:498:0 arrow-higher-order:lnp [244] 100.0% ----------------------------------------------------------------------------------------- generic-sort/key [209] 26.7% ??? [198] 31.7% copying-mergesort [216] 41.7% [220] 6362(1.0%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [144] 94.7% ??? [222] 5.3% ----------------------------------------------------------------------------------------- for-loop [218] 20.2% loop [161] 38.7% for-loop [65] 41.1% [221] 1644(0.2%) 1644(0.2%) curried ...cket/collects/racket/function.rkt:71:18 ----------------------------------------------------------------------------------------- loop [220] 0.3% for-loop [139] 0.7% atab-pick-alt8 [127] 0.7% jloop [12] 0.9% for-loop [119] 1.9% f6 [143] 3.0% loop [161] 4.9% ??? [144] 7.0% ??? [10] 10.7% loop [23] 15.3% ??? [223] 27.2% for-loop [90] 27.2% [222] 100090(15.0%) 3016(0.5%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [223] 40.8% approximate9 [4] 27.2% hash-ref! [224] 26.0% best-alt [225] 1.0% ??? [260] 1.0% ...sting/src/common.rkt:47:2 [117] 0.6% ??? [116] 0.3% ----------------------------------------------------------------------------------------- simplify-alt [46] 0.0% f6 [143] 0.1% for-loop [67] 1.4% get-sigs [108] 1.9% ??? [223] 9.0% ??? [222] 14.0% for-loop [226] 33.2% ??? [74] 39.9% [223] 582598(87.2%) 20344(3.0%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [3] 37.7% for-loop [226] 33.2% ??? [222] 11.7% ??? [223] 9.0% loop [9] 2.5% ??? [227] 2.5% ??? [252] 0.6% return/no-unsupplied [253] 0.3% list-member? [228] 0.1% mk-egraph [235] 0.0% ormap [234] 0.0% ??? [231] 0.0% ??? [238] 0.0% ----------------------------------------------------------------------------------------- for-loop [164] 0.1% for-loop [35] 0.1% for-loop [87] 0.2% for-loop [33] 0.2% first-nonzero-exp [34] 0.2% localize-error [59] 0.3% ??? [15] 0.3% update-leader! [77] 0.4% simplify* [172] 0.6% compile [85] 0.7% ??? [229] 0.8% ??? [10] 0.9% ??? [5] 1.1% eval-prog [140] 1.3% loop [161] 2.5% for-loop [43] 3.0% for-loop [26] 6.3% loop [23] 7.1% for-loop [24] 7.7% ??? [222] 12.7% for-loop [25] 18.0% ??? [41] 34.4% [224] 84628(12.7%) 4618(0.7%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [6] 33.9% ??? [7] 18.0% ??? [5] 11.0% simplify [40] 9.7% ??? [10] 8.0% ??? [8] 6.4% ??? [229] 3.3% ??? [11] 3.0% f6 [143] 1.4% bigfloat-hash [230] 1.3% parse-loop12 [153] 0.7% ??? [15] 0.6% ??? [13] 0.2% taylor [232] 0.2% ----------------------------------------------------------------------------------------- ??? [222] 100.0% [225] 1040(0.2%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 loop [233] 66.5% argmins [236] 33.5% ----------------------------------------------------------------------------------------- ??? [223] 100.0% [226] 403812(60.5%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 ??? [223] 100.0% ----------------------------------------------------------------------------------------- hash-has-key? [121] 28.0% ??? [223] 72.0% [227] 56928(8.5%) 23344(3.5%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [237] 42.3% ??? [250] 13.3% arrow-higher-order:lnp [244] 1.7% ??? [238] 1.1% successfully-got-the-right-kind-of-function [247] 0.6% ----------------------------------------------------------------------------------------- ??? [223] 2.4% for-loop [49] 97.6% [228] 14904(2.2%) 362(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [239] 77.2% member [242] 20.3% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [229] 3816(0.6%) 306(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [161] 75.3% hash-ref! [224] 23.4% ----------------------------------------------------------------------------------------- hash-ref! [224] 100.0% [230] 3178(0.5%) 328(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [243] 80.1% sig+exp->bigfloat [249] 9.6% ----------------------------------------------------------------------------------------- ??? [223] 18.9% hash-has-key? [121] 81.1% [231] 1702(0.3%) 1702(0.3%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ----------------------------------------------------------------------------------------- map [148] 23.7% hash-ref! [224] 24.4% f6 [143] 51.9% [232] 1268(0.2%) 328(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 debug-print [241] 48.1% debug7 [248] 26.0% ----------------------------------------------------------------------------------------- extract-alt [47] 32.6% best-alt [225] 67.4% [233] 1026(0.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/common.rkt:153:2 composed [240] 100.0% ----------------------------------------------------------------------------------------- for-loop [86] 49.4% ??? [223] 50.6% [234] 660(0.1%) 334(0.1%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [246] 49.4% ----------------------------------------------------------------------------------------- ??? [223] 100.0% [235] 636(0.1%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [245] 100.0% ----------------------------------------------------------------------------------------- best-alt [225] 100.0% [236] 348(0.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [240] 100.0% ----------------------------------------------------------------------------------------- ??? [227] 100.0% [237] 24088(3.6%) 14394(2.2%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [250] 21.7% for-loop [124] 17.1% ??? [257] 1.4% ----------------------------------------------------------------------------------------- ??? [223] 1.5% ...higher-order.rkt:346:33 [160] 2.1% ??? [227] 3.1% ??? [126] 33.3% for-loop [124] 60.0% [238] 19858(3.0%) 3336(0.5%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [251] 58.4% ??? [126] 13.0% for-loop [256] 10.2% ??? [255] 1.6% ----------------------------------------------------------------------------------------- list-member? [228] 100.0% [239] 11512(1.7%) 11512(1.7%) loop (unknown source) ----------------------------------------------------------------------------------------- argmins [236] 7.0% loop [233] 20.6% f6 [143] 72.4% [240] 4976(0.7%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 f6 [143] 72.4% errors [137] 27.6% ----------------------------------------------------------------------------------------- for-loop [62] 8.5% iterate-egraph!13 [3] 8.6% taylor [232] 15.7% simplify [40] 67.1% [241] 3886(0.6%) 966(0.1%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 for-loop [254] 75.1% ----------------------------------------------------------------------------------------- list-member? [228] 100.0% [242] 3030(0.5%) 3030(0.5%) member (unknown source) ----------------------------------------------------------------------------------------- bigfloat-hash [230] 100.0% [243] 2544(0.4%) 2544(0.4%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ----------------------------------------------------------------------------------------- ??? [227] 49.8% maybe-cons-kwd [219] 50.2% [244] 1930(0.3%) 978(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [258] 49.3% ----------------------------------------------------------------------------------------- mk-egraph [235] 29.3% mk-enode-rec! [245] 70.7% [245] 636(0.1%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 mk-enode-rec! [245] 70.7% mk-enode! [75] 29.3% ----------------------------------------------------------------------------------------- for-loop [86] 48.1% ormap [234] 51.9% [246] 628(0.1%) 0(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [253] 51.9% ??? [252] 48.1% ----------------------------------------------------------------------------------------- ??? [227] 100.0% [247] 346(0.1%) 0(0.0%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [259] 100.0% ----------------------------------------------------------------------------------------- taylor [232] 100.0% [248] 330(0.0%) 0(0.0%) debug7 ...s/herbie/alt-testing/src/debug.rkt:102:0 ??? [114] 100.0% ----------------------------------------------------------------------------------------- bigfloat-hash [230] 100.0% [249] 306(0.0%) 306(0.0%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ----------------------------------------------------------------------------------------- for-loop [237] 40.8% ??? [227] 59.2% [250] 12810(1.9%) 6290(0.9%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [262] 50.9% ----------------------------------------------------------------------------------------- ??? [238] 100.0% [251] 11600(1.7%) 964(0.1%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [260] 91.7% ----------------------------------------------------------------------------------------- flag-set? [246] 3.0% ulp-difference [147] 3.1% ??? [154] 10.1% ??? [125] 40.9% ??? [223] 42.9% [252] 10142(1.5%) 2706(0.4%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [261] 60.1% ??? [260] 13.2% ----------------------------------------------------------------------------------------- flag-set? [246] 4.5% ??? [154] 14.1% ulp-difference [147] 18.0% ??? [125] 18.1% simplify* [172] 22.4% ??? [223] 23.1% [253] 7294(1.1%) 3956(0.6%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [263] 45.8% ----------------------------------------------------------------------------------------- debug-print [241] 100.0% [254] 2920(0.4%) 2920(0.4%) for-loop ...herbie/alt-testing/src/debug.rkt:113:2 ----------------------------------------------------------------------------------------- ??? [176] 11.9% ??? [238] 12.1% ??? [149] 25.5% for-loop [124] 50.5% [255] 2554(0.4%) 1620(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [265] 36.6% ----------------------------------------------------------------------------------------- ??? [238] 100.0% [256] 2034(0.3%) 1038(0.2%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [126] 49.0% ----------------------------------------------------------------------------------------- for-loop [237] 34.5% ??? [126] 65.5% [257] 962(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [264] 100.0% ----------------------------------------------------------------------------------------- arrow-higher-order:lnp [244] 100.0% [258] 952(0.1%) 952(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 ----------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [247]100.0% [259] 346(0.1%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [266] 100.0% ----------------------------------------------------------------------------------------- ...higher-order.rkt:346:33 [160] 1.8% ??? [190] 2.0% ...higher-order.rkt:342:33 [167] 2.0% ??? [114] 2.1% ??? [152] 2.3% ??? [222] 5.8% ??? [252] 7.7% ??? [126] 15.1% ??? [251] 61.3% [260] 17362(2.6%) 13778(2.1%) ??? ...ects/racket/contract/private/guts.rkt:644:8 contract? [267] 11.1% ??? [114] 5.8% dict? [268] 3.7% ----------------------------------------------------------------------------------------- ??? [190] 14.3% ??? [252] 85.7% [261] 7114(1.1%) 6490(1.0%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [270] 8.8% ----------------------------------------------------------------------------------------- parse-loop12 [153] 5.2% ??? [250] 94.8% [262] 6878(1.0%) 6878(1.0%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ----------------------------------------------------------------------------------------- for-loop [65] 9.7% return/no-unsupplied [253] 90.3% [263] 3698(0.6%) 3698(0.6%) filter ...t/collects/racket/private/list.rkt:256:2 ----------------------------------------------------------------------------------------- ??? [257] 100.0% [264] 962(0.1%) 322(0.0%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [269] 66.5% ----------------------------------------------------------------------------------------- ??? [255] 100.0% [265] 934(0.1%) 934(0.1%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ----------------------------------------------------------------------------------------- arity-checking-wrapper [259] 100.0% [266] 346(0.1%) 346(0.1%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ----------------------------------------------------------------------------------------- ??? [260] 100.0% [267] 1926(0.3%) 1926(0.3%) contract? ...acket/contract/private/guts.rkt:109:0 ----------------------------------------------------------------------------------------- ??? [260] 100.0% [268] 650(0.1%) 650(0.1%) dict? ...ollects/racket/private/generic.rkt:146:11 ----------------------------------------------------------------------------------------- check-hash/c [264] 100.0% [269] 640(0.1%) 640(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 ----------------------------------------------------------------------------------------- ??? [261] 100.0% [270] 624(0.1%) 624(0.1%) ??? ...ects/racket/contract/private/prop.rkt:256:4 -----------------------------------------------------------------------------------------