Profiling results ----------------- Total cpu time observed: 67440ms (out of 67484ms) Number of samples taken: 182 (once every 371ms) (Hiding functions with self<1.0% and local<2.0%: 5 of 134 hidden) ======================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ======================================================================== ??? [31] 100.0% [1] 63820(94.6%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [9] 100.0% ------------------------------------------------------------------------ ??? [31] 100.0% [2] 27210(40.3%) 0(0.0%) run-improve50 ...lt-testing/src/mainloop.rkt:225:0 for-loop [10] 96.4% loop [34] 2.4% setup-alt-simplified [17] 1.2% ------------------------------------------------------------------------ ??? [44] 100.0% [3] 3928(5.8%) 0(0.0%) approximate9 ...t-testing/src/core/taylor.rkt:12:0 loop [11] 100.0% ------------------------------------------------------------------------ hash-ref! [47] 100.0% [4] 1934(2.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 for-loop [12] 100.0% ------------------------------------------------------------------------ hash-ref! [47] 100.0% [5] 1674(2.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:483:23 for-loop [13] 100.0% ------------------------------------------------------------------------ sample-multi-bounded [46] 100.0% [6] 1016(1.5%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 pass [14] 100.0% ------------------------------------------------------------------------ hash-ref! [47] 100.0% [7] 336(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 for-loop [16] 100.0% ------------------------------------------------------------------------ hash-ref! [47] 100.0% [8] 336(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 for-loop [15] 100.0% ------------------------------------------------------------------------ profile-thunk16 [1] 99.5% [9] 64132(95.1%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [31] 100.0% ------------------------------------------------------------------------ run-improve50 [2] 100.0% [10] 26236(38.9%) 0(0.0%) for-loop ...ie/alt-testing/src/mainloop.rkt:240:10 run-iter! [18] 100.0% ------------------------------------------------------------------------ approximate9 [3] 100.0% [11] 3928(5.8%) 0(0.0%) loop ...erbie/alt-testing/src/core/taylor.rkt:86:4 ??? [44] 100.0% ------------------------------------------------------------------------ ??? [4] 100.0% [12] 1934(2.9%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:285:52 ??? [19] 67.5% hash-ref! [47] 32.5% ------------------------------------------------------------------------ ??? [5] 100.0% [13] 1674(2.5%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:487:35 parse-loop79 [62] 100.0% ------------------------------------------------------------------------ loop [6] 100.0% [14] 1016(1.5%) 0(0.0%) pass ...ie/alt-testing/src/core/simplify.rkt:227:2 for-loop [20] 100.0% ------------------------------------------------------------------------ ??? [8] 100.0% [15] 336(0.5%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:341:46 hash-ref! [47] 100.0% ------------------------------------------------------------------------ ??? [7] 100.0% [16] 336(0.5%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:324:46 simplify [52] 100.0% ------------------------------------------------------------------------ run-improve50 [2] 100.0% [17] 322(0.5%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [21] 100.0% ------------------------------------------------------------------------ for-loop [10] 100.0% [18] 26236(38.9%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [22] 77.3% gen-series! [23] 15.0% finalize-iter! [24] 6.6% localize-error [26] 1.1% ------------------------------------------------------------------------ for-loop [12] 100.0% [19] 1306(1.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [47] 100.0% ------------------------------------------------------------------------ pass [14] 100.0% [20] 1016(1.5%) 0(0.0%) for-loop ...t-testing/src/core/simplify.rkt:230:29 argmin [25] 100.0% ------------------------------------------------------------------------ setup-alt-simplified [17] 100.0% [21] 322(0.5%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 sample-multi-bounded [46] 100.0% ------------------------------------------------------------------------ run-iter! [18] 100.0% [22] 20282(30.1%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 for-loop [27] 100.0% ------------------------------------------------------------------------ run-iter! [18] 100.0% [23] 3928(5.8%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 for-loop [28] 100.0% ------------------------------------------------------------------------ run-iter! [18] 100.0% [24] 1728(2.6%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [91] 100.0% ------------------------------------------------------------------------ for-loop [20] 100.0% [25] 1016(1.5%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [29] 100.0% ------------------------------------------------------------------------ run-iter! [18] 100.0% [26] 298(0.4%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 for-loop [30] 100.0% ------------------------------------------------------------------------ simplify! [22] 100.0% [27] 20282(30.1%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:150:6 ??? [31] 100.0% ------------------------------------------------------------------------ gen-series! [23] 100.0% [28] 3928(5.8%) 0(0.0%) for-loop ...bie/alt-testing/src/mainloop.rkt:126:7 taylor-alt [32] 100.0% ------------------------------------------------------------------------ argmin [25] 100.0% [29] 1016(1.5%) 358(0.5%) for-loop ...bie/alt-testing/src/programs.rkt:210:2 ...sting/src/common.rkt:47:2 [94] 32.7% sample-multi-bounded [46] 32.1% ------------------------------------------------------------------------ localize-error [26] 100.0% [30] 298(0.4%) 0(0.0%) for-loop ...lt-testing/src/core/localize.rkt:61:10 ormap [33] 100.0% ------------------------------------------------------------------------ for-loop [27] 10.1% run [9] 43.0% [31] 67108(99.5%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 42.5% loop [34] 21.4% run-improve50 [2] 15.2% sample-multi-bounded [46] 14.5% prepare-points [35] 6.3% ------------------------------------------------------------------------ for-loop [28] 100.0% [32] 3928(5.8%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 for-loop [36] 100.0% ------------------------------------------------------------------------ for-loop [30] 100.0% [33] 298(0.4%) 298(0.4%) ormap ...et/collects/racket/private/map.rkt:105:13 ------------------------------------------------------------------------ run-improve50 [2] 2.2% ??? [31] 97.8% [34] 29072(43.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:238:2 make-exacts* [39] 37.3% loop [37] 29.8% loop [40] 28.4% for-loop [38] 4.5% ------------------------------------------------------------------------ ??? [31] 100.0% [35] 8502(12.6%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [40] 55.5% loop [37] 25.8% make-exacts* [39] 18.7% ------------------------------------------------------------------------ taylor-alt [32] 100.0% [36] 3928(5.8%) 0(0.0%) for-loop .../herbie/alt-testing/src/glue.rkt:139:6 ??? [44] 100.0% ------------------------------------------------------------------------ prepare-points [35] 20.2% loop [34] 79.8% [37] 10854(16.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:158:2 make-exacts* [39] 52.7% loop [40] 47.3% ------------------------------------------------------------------------ loop [34] 100.0% [38] 1308(1.9%) 0(0.0%) for-loop ...rbie/alt-testing/src/points.rkt:255:26 ??? [41] 100.0% ------------------------------------------------------------------------ prepare-points [35] 8.7% loop [37] 31.5% loop [34] 59.7% [39] 18140(26.9%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 loop [42] 98.0% eval-prog [43] 2.0% ------------------------------------------------------------------------ prepare-points [35] 26.1% loop [37] 28.3% loop [34] 45.6% [40] 18126(26.9%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [42] 100.0% ------------------------------------------------------------------------ for-loop [38] 100.0% [41] 1308(1.9%) 312(0.5%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [44] 76.1% ------------------------------------------------------------------------ loop! [67] 0.2% loop [40] 1.4% parse-loop79 [62] 1.5% make-exacts* [39] 6.5% loop [42] 90.4% [42] 37880(56.2%) 726(1.1%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [42] 90.4% ??? [115] 7.8% f66 [55] 1.2% parse-loop79 [62] 0.3% loop! [67] 0.2% ??? [44] 0.1% for-loop [45] 0.0% ------------------------------------------------------------------------ make-exacts* [39] 100.0% [43] 354(0.5%) 0(0.0%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f66 [55] 100.0% ------------------------------------------------------------------------ ??? [41] 12.2% loop [11] 16.0% sample-multi-bounded [46] 16.0% for-loop [36] 16.0% loop [42] 39.8% [44] 8174(12.1%) 326(0.5%) ??? ...tract/private/arrow-higher-order.rkt:342:33 sample-multi-bounded [46] 64.0% approximate9 [3] 16.0% hash-ref! [47] 16.0% ------------------------------------------------------------------------ loop [42] 100.0% [45] 328(0.5%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:195:2 setfindf [48] 100.0% ------------------------------------------------------------------------ for-loop [29] 0.3% simplify-alt [21] 0.5% get-sigs [89] 1.7% for-loop [50] 7.6% ??? [44] 21.6% sample-multi-bounded [46] 32.2% ??? [31] 35.6% [46] 31760(47.1%) 3632(5.4%) sample-multi-bounded ...vate/norm-define.rkt:53:83 iterate-egraph!13 [49] 35.2% sample-multi-bounded [46] 32.2% ??? [44] 9.2% for-loop [50] 7.6% ??? [102] 3.8% loop [6] 1.4% return/no-unsupplied [119] 1.1% ??? [103] 0.4% ------------------------------------------------------------------------ for-loop [15] 2.1% for-loop [12] 5.3% for-loop [69] 6.2% ??? [19] 9.7% ??? [51] 38.3% ??? [44] 38.3% [47] 3928(5.8%) 0(0.0%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [51] 38.3% simplify [52] 27.3% ??? [5] 15.1% ??? [4] 15.0% ??? [8] 2.1% ??? [7] 2.1% ------------------------------------------------------------------------ for-loop [45] 100.0% [48] 328(0.5%) 0(0.0%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 for-loop [53] 100.0% ------------------------------------------------------------------------ sample-multi-bounded [46] 100.0% [49] 22896(34.0%) 0(0.0%) iterate-egraph!13 ...g/src/core/simplify.rkt:105:0 one-iter [54] 98.6% ------------------------------------------------------------------------ sample-multi-bounded [46] 100.0% [50] 5046(7.5%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:66:12 sample-multi-bounded [46] 100.0% ------------------------------------------------------------------------ hash-ref! [47] 100.0% [51] 3928(5.8%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [47] 100.0% ------------------------------------------------------------------------ for-loop [16] 8.6% parse-loop79 [62] 17.7% hash-ref! [47] 73.8% [52] 3928(5.8%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f66 [55] 67.6% parse-loop79 [62] 32.4% ------------------------------------------------------------------------ setfindf [48] 100.0% [53] 328(0.5%) 328(0.5%) for-loop ...erbie/alt-testing/src/common.rkt:187:2 ------------------------------------------------------------------------ iterate-egraph!13 [49] 100.0% [54] 22568(33.5%) 0(0.0%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 for-loop [56] 83.7% for-loop [57] 16.3% ------------------------------------------------------------------------ f66 [55] 4.9% eval-prog [43] 4.9% loop [42] 6.1% parse-loop79 [62] 20.4% simplify [52] 31.9% map [58] 31.9% [55] 3638(5.4%) 1686(2.5%) f66 ...t/collects/racket/match/compiler.rkt:507:40 map [58] 51.8% combine-mterms [59] 8.6% f66 [55] 4.9% ------------------------------------------------------------------------ one-iter [54] 100.0% [56] 18886(28.0%) 0(0.0%) for-loop ...lt-testing/src/core/simplify.rkt:166:2 for-loop [60] 82.4% match-e [61] 17.6% ------------------------------------------------------------------------ for-loop [57] 50.0% one-iter [54] 50.0% [57] 3682(5.5%) 692(1.0%) for-loop ...t-testing/src/core/simplify.rkt:126:12 for-loop [57] 50.0% match-e [61] 40.6% ------------------------------------------------------------------------ parse-loop79 [62] 11.4% f66 [55] 88.6% [58] 2618(3.9%) 324(0.5%) map ...acket/collects/racket/private/map.rkt:20:13 f66 [55] 61.0% parse-loop79 [62] 36.9% ------------------------------------------------------------------------ f66 [55] 100.0% [59] 626(0.9%) 326(0.5%) combine-mterms ...esting/src/core/reduce.rkt:191:0 for-loop [63] 47.9% ------------------------------------------------------------------------ for-loop [56] 100.0% [60] 15566(23.1%) 0(0.0%) for-loop ...t-testing/src/core/simplify.rkt:148:10 list-member? [64] 30.1% mk-enode! [72] 23.6% merge-egraph-nodes! [66] 23.1% loop! [67] 14.8% substitute-e [68] 8.4% ------------------------------------------------------------------------ for-loop [74] 27.0% for-loop [56] 30.8% for-loop [57] 42.2% [61] 6310(9.4%) 1368(2.0%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 for-loop [65] 64.1% variable? [70] 5.2% custom-in-set [71] 4.8% for-loop [74] 2.6% ??? [91] 1.6% ------------------------------------------------------------------------ loop [42] 3.3% parse-loop79 [62] 11.3% simplify [52] 20.3% map [58] 25.8% for-loop [13] 39.2% [62] 3304(4.9%) 1646(2.4%) parse-loop79 ...s/racket/match/compiler.rkt:418:15 simplify [52] 21.0% for-loop [69] 18.2% f66 [55] 15.7% loop [42] 11.7% parse-loop79 [62] 11.3% map [58] 2.3% ------------------------------------------------------------------------ combine-mterms [59] 100.0% [63] 300(0.4%) 300(0.4%) for-loop .../alt-testing/src/core/reduce.rkt:195:5 ------------------------------------------------------------------------ for-loop [60] 100.0% [64] 4678(6.9%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [73] 92.8% member [80] 7.2% ------------------------------------------------------------------------ match-e [61] 100.0% [65] 4314(6.4%) 2346(3.5%) for-loop .../alt-testing/src/core/ematch.rkt:59:11 for-loop [74] 45.7% list-cartesian-product [78] 15.5% ------------------------------------------------------------------------ for-loop [79] 3.1% merge-egraph-nodes! [66] 7.8% for-loop [60] 89.0% [66] 3590(5.3%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 for-loop [76] 46.7% update-leader! [75] 42.3% merge-egraph-nodes! [66] 7.8% for-loop [79] 3.1% ------------------------------------------------------------------------ loop [42] 21.1% for-loop [60] 78.9% [67] 2308(3.4%) 332(0.5%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [77] 64.9% loop [42] 21.1% set [81] 6.7% ------------------------------------------------------------------------ substitute-e [68] 17.0% for-loop [60] 83.0% [68] 1312(1.9%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [72] 74.5% substitute-e [68] 17.0% ??? [91] 8.5% ------------------------------------------------------------------------ parse-loop79 [62] 100.0% [69] 980(1.5%) 0(0.0%) for-loop ...alt-testing/src/core/taylor.rkt:490:59 hash-ref! [47] 100.0% ------------------------------------------------------------------------ match-e [61] 100.0% [70] 650(1.0%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [91] 100.0% ------------------------------------------------------------------------ match-e [61] 100.0% [71] 306(0.5%) 306(0.5%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------ substitute-e [68] 21.0% for-loop [60] 79.0% [72] 4656(6.9%) 0(0.0%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [82] 100.0% ------------------------------------------------------------------------ list-member? [64] 100.0% [73] 4342(6.4%) 4342(6.4%) loop (unknown source) ------------------------------------------------------------------------ match-e [61] 9.7% for-loop [65] 90.3% [74] 3306(4.9%) 324(0.5%) for-loop .../alt-testing/src/core/ematch.rkt:65:37 match-e [61] 95.1% ------------------------------------------------------------------------ merge-egraph-nodes! [66] 100.0% [75] 1912(2.8%) 310(0.5%) update-leader! ...esting/src/core/egraph.rkt:218:0 for-loop [83] 83.8% ------------------------------------------------------------------------ merge-egraph-nodes! [66] 100.0% [76] 1678(2.5%) 1368(2.0%) for-loop .../alt-testing/src/core/egraph.rkt:233:6 update-en-expr [104] 18.5% ------------------------------------------------------------------------ loop! [67] 100.0% [77] 1666(2.5%) 334(0.5%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [84] 80.0% ------------------------------------------------------------------------ list-cartesian-product [78] 50.0% for-loop [65] 50.0% [78] 1008(1.5%) 678(1.0%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [78] 50.0% for-loop [85] 16.4% ------------------------------------------------------------------------ merge-egraph-nodes! [66] 100.0% [79] 338(0.5%) 0(0.0%) for-loop ...alt-testing/src/core/egraph.rkt:201:10 merge-egraph-nodes! [66] 100.0% ------------------------------------------------------------------------ list-member? [64] 100.0% [80] 336(0.5%) 336(0.5%) member (unknown source) ------------------------------------------------------------------------ loop! [67] 100.0% [81] 310(0.5%) 310(0.5%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------ mk-enode! [72] 100.0% [82] 4656(6.9%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [86] 100.0% ------------------------------------------------------------------------ update-leader! [75] 100.0% [83] 1602(2.4%) 0(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:223:6 for-loop [87] 100.0% ------------------------------------------------------------------------ custom-set-union [77] 100.0% [84] 1332(2.0%) 348(0.5%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [88] 73.9% ------------------------------------------------------------------------ list-cartesian-product [78] 100.0% [85] 330(0.5%) 330(0.5%) for-loop ...e/alt-testing/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------ new-enode [82] 100.0% [86] 4656(6.9%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [89] 100.0% ------------------------------------------------------------------------ for-loop [83] 100.0% [87] 1602(2.4%) 0(0.0%) for-loop .../alt-testing/src/core/egraph.rkt:224:8 hash-update! [90] 100.0% ------------------------------------------------------------------------ for-loop [84] 100.0% [88] 984(1.5%) 984(1.5%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------ type-of-enode-expr [86] 100.0% [89] 4656(6.9%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 sample-multi-bounded [46] 35.1% ??? [93] 29.5% ...sting/src/common.rkt:47:2 [94] 20.5% ??? [91] 14.9% ------------------------------------------------------------------------ for-loop [87] 100.0% [90] 1602(2.4%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [92] 100.0% ------------------------------------------------------------------------ match-e [61] 8.3% substitute-e [68] 9.0% variable? [70] 17.5% get-sigs [89] 18.7% finalize-iter! [24] 46.5% [91] 3714(5.5%) 984(1.5%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [95] 46.5% hash-has-key? [98] 27.0% ------------------------------------------------------------------------ hash-update! [90] 100.0% [92] 1602(2.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 for-loop [96] 100.0% ------------------------------------------------------------------------ get-sigs [89] 100.0% [93] 1372(2.0%) 0(0.0%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 for-loop [97] 74.6% ??? [100] 25.4% ------------------------------------------------------------------------ for-loop [29] 25.8% get-sigs [89] 74.2% [94] 1288(1.9%) 332(0.5%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [99] 74.2% ------------------------------------------------------------------------ ??? [91] 100.0% [95] 1728(2.6%) 0(0.0%) for-loop ...lt-testing/src/core/alt-table.rkt:53:2 atab-add-altn [101] 100.0% ------------------------------------------------------------------------ ??? [92] 100.0% [96] 1602(2.4%) 936(1.4%) for-loop ...alt-testing/src/core/egraph.rkt:227:26 update-en-expr [104] 41.6% ------------------------------------------------------------------------ ??? [93] 100.0% [97] 1024(1.5%) 354(0.5%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [126] 65.4% ------------------------------------------------------------------------ ??? [91] 100.0% [98] 1002(1.5%) 308(0.5%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [103] 69.3% ------------------------------------------------------------------------ ...sting/src/common.rkt:47:2 [94]100.0% [99] 956(1.4%) 304(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [102] 34.5% return/no-unsupplied [119] 33.7% ------------------------------------------------------------------------ ??? [93] 100.0% [100] 348(0.5%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [105] 100.0% ------------------------------------------------------------------------ for-loop [95] 100.0% [101] 1728(2.6%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [106] 100.0% ------------------------------------------------------------------------ ??? [99] 21.6% sample-multi-bounded [46] 78.4% [102] 1530(2.3%) 0(0.0%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [107] 100.0% ------------------------------------------------------------------------ sample-multi-bounded [46] 34.5% hash-has-key? [98] 65.5% [103] 1060(1.6%) 694(1.0%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [108] 34.5% ------------------------------------------------------------------------ for-loop [76] 31.8% for-loop [96] 68.2% [104] 976(1.4%) 976(1.4%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------ ??? [100] 100.0% [105] 348(0.5%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [109] 100.0% ------------------------------------------------------------------------ atab-add-altn [101] 100.0% [106] 1728(2.6%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [110] 80.2% for-loop [112] 19.8% ------------------------------------------------------------------------ ??? [102] 100.0% [107] 1530(2.3%) 1530(2.3%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ------------------------------------------------------------------------ ??? [103] 100.0% [108] 366(0.5%) 366(0.5%) for-loop ...acket/contract/private/list.rkt:743:12 ------------------------------------------------------------------------ ??? [105] 100.0% [109] 348(0.5%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [111] 100.0% ------------------------------------------------------------------------ best-and-tied-at-points [106] 100.0% [110] 1386(2.1%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 for-loop [113] 100.0% ------------------------------------------------------------------------ ??? [109] 100.0% [111] 348(0.5%) 0(0.0%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [114] 100.0% ------------------------------------------------------------------------ best-and-tied-at-points [106] 100.0% [112] 342(0.5%) 342(0.5%) for-loop ...-testing/src/core/alt-table.rkt:155:16 ------------------------------------------------------------------------ errors [110] 100.0% [113] 1386(2.1%) 0(0.0%) for-loop ...erbie/alt-testing/src/points.rkt:274:4 ??? [115] 75.9% ulp-difference [116] 24.1% ------------------------------------------------------------------------ for-loop [111] 100.0% [114] 348(0.5%) 348(0.5%) add-list-context ...ontract/private/list.rkt:752:0 ------------------------------------------------------------------------ for-loop [113] 3.2% loop [42] 96.8% [115] 32988(48.9%) 386(0.6%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [117] 74.9% ??? [118] 22.9% ------------------------------------------------------------------------ for-loop [113] 100.0% [116] 334(0.5%) 0(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [119] 100.0% ------------------------------------------------------------------------ ??? [115] 100.0% [117] 24704(36.6%) 7470(11.1%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [120] 64.2% ...higher-order.rkt:346:33 [122] 2.9% ------------------------------------------------------------------------ ??? [115] 100.0% [118] 7570(11.2%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [121] 100.0% ------------------------------------------------------------------------ ??? [99] 31.8% ulp-difference [116] 32.9% sample-multi-bounded [46] 35.3% [119] 1014(1.5%) 692(1.0%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [123] 31.8% ------------------------------------------------------------------------ ??? [117] 100.0% [120] 15854(23.5%) 6318(9.4%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bflog [124] 34.8% bfsub [125] 25.3% ------------------------------------------------------------------------ ??? [118] 100.0% [121] 7570(11.2%) 6242(9.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [127] 17.5% ------------------------------------------------------------------------ ??? [117] 100.0% [122] 710(1.1%) 324(0.5%) ...higher-order.rkt:346:33 (unknown source) ??? [126] 54.4% ------------------------------------------------------------------------ return/no-unsupplied [119] 100.0% [123] 322(0.5%) 322(0.5%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------ ??? [120] 100.0% [124] 5518(8.2%) 3820(5.7%) bflog ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [127] 30.8% ------------------------------------------------------------------------ ??? [120] 100.0% [125] 4018(6.0%) 3344(5.0%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [127] 16.8% ------------------------------------------------------------------------ ...higher-order.rkt:346:33 [122] 36.6% for-loop [97] 63.4% [126] 1056(1.6%) 386(0.6%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [128] 63.4% ------------------------------------------------------------------------ bfsub [125] 18.2% real->bigfloat [121] 35.9% bflog [124] 45.9% [127] 3700(5.5%) 3700(5.5%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------ ??? [126] 100.0% [128] 670(1.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [129] 100.0% ------------------------------------------------------------------------ ??? [128] 100.0% [129] 670(1.0%) 670(1.0%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ------------------------------------------------------------------------