Profiling results ----------------- Total cpu time observed: 145320ms (out of 145533ms) Number of samples taken: 521 (once every 279ms) (Hiding functions with self<1.0% and local<2.0%: 7 of 201 hidden) =========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================================== [1] 145320(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [4] 100.0% ------------------------------------------------------------------------------------------- loop [181] 100.0% [2] 91641(63.1%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [5] 65.3% loop [181] 20.8% sort-context-on-expr [6] 7.8% err-lsts->split-indices [7] 4.2% pick-errors [8] 1.2% eval-prog [91] 0.6% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [3] 1380(0.9%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [119] 80.1% hash-ref! [164] 19.9% ------------------------------------------------------------------------------------------- ??? [1] 100.0% [4] 145320(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [9] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [5] 59858(41.2%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [10] 99.5% eval-prog [91] 0.5% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [6] 7152(4.9%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [11] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [7] 3888(2.7%) 1388(1.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [12] 49.9% loop [14] 7.3% check-list [187] 7.1% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [8] 1094(0.8%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [13] 74.5% point->alt [15] 25.5% ------------------------------------------------------------------------------------------- profile-thunk [4] 100.0% [9] 145320(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [16] 100.0% ------------------------------------------------------------------------------------------- loop [10] 30.2% sindices->spoints [5] 69.8% [10] 59588(41.0%) 0(0.0%) loop .../private/map.rkt:54:19 sidx->spoint [17] 69.8% loop [10] 30.2% ------------------------------------------------------------------------------------------- sort-context-on-expr [6] 100.0% [11] 7152(4.9%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [18] 100.0% ------------------------------------------------------------------------------------------- err-lsts->split-indices [7] 100.0% [12] 1941(1.3%) 1941(1.3%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------------- loop [181] 40.8% pick-errors [8] 59.2% [13] 1376(0.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [90] 79.3% ??? [93] 20.7% ------------------------------------------------------------------------------------------- err-lsts->split-indices [7] 0.9% loop [14] 99.1% [14] 282(0.2%) 282(0.2%) loop ...hare/racket/collects/racket/list.rkt:158:2 loop [14] 99.1% ------------------------------------------------------------------------------------------- pick-errors [8] 100.0% [15] 280(0.2%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [91] 100.0% ------------------------------------------------------------------------------------------- ??? [9] 100.0% [16] 145320(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [19] 92.2% prepare-points [26] 7.8% ------------------------------------------------------------------------------------------- loop [10] 100.0% [17] 59588(41.0%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [20] 100.0% ------------------------------------------------------------------------------------------- ??? [11] 100.0% [18] 7152(4.9%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [21] 84.8% ??? [90] 15.2% ------------------------------------------------------------------------------------------- ??? [16] 100.0% [19] 134028(92.2%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 get-final-combination [22] 69.0% run-iter! [24] 30.8% ------------------------------------------------------------------------------------------- sidx->spoint [17] 100.0% [20] 59588(41.0%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [23] 100.0% ------------------------------------------------------------------------------------------- generic-sort/key [18] 41.3% copying-mergesort [21] 58.7% [21] 6067(4.2%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [21] 58.7% ??? [90] 36.9% ??? [93] 4.4% ------------------------------------------------------------------------------------------- run-improve [19] 100.0% [22] 92454(63.6%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [25] 99.4% ??? [93] 0.3% loop [181] 0.3% ------------------------------------------------------------------------------------------- binary-search-floats [20] 100.0% [23] 59588(41.0%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [26] 80.4% errors [88] 19.2% ------------------------------------------------------------------------------------------- run-improve [19] 100.0% [24] 41299(28.4%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [27] 61.8% finalize-iter! [28] 20.7% gen-series! [29] 8.7% choose-best-alt! [30] 8.1% gen-rewrites! [31] 0.7% ------------------------------------------------------------------------------------------- get-final-combination [22] 100.0% [25] 91910(63.2%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f53 [156] 100.0% ------------------------------------------------------------------------------------------- ??? [16] 19.0% pred [23] 80.5% [26] 59448(40.9%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 make-exacts* [38] 48.2% loop [39] 37.6% make-exacts [33] 7.1% ??? [34] 6.2% filter-points [36] 0.5% debug-print [158] 0.5% ------------------------------------------------------------------------------------------- run-iter! [24] 100.0% [27] 25514(17.6%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [32] 100.0% ------------------------------------------------------------------------------------------- run-iter! [24] 100.0% [28] 8544(5.9%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [75] 100.0% ------------------------------------------------------------------------------------------- run-iter! [24] 100.0% [29] 3608(2.5%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [35] 100.0% ------------------------------------------------------------------------------------------- run-iter! [24] 100.0% [30] 3352(2.3%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [75] 100.0% ------------------------------------------------------------------------------------------- run-iter! [24] 100.0% [31] 281(0.2%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [37] 100.0% ------------------------------------------------------------------------------------------- simplify! [27] 100.0% [32] 25514(17.6%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [40] 100.0% ------------------------------------------------------------------------------------------- prepare-points [26] 100.0% [33] 4238(2.9%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [39] 86.8% debug [44] 6.7% make-exacts* [38] 6.6% ------------------------------------------------------------------------------------------- prepare-points [26] 100.0% [34] 3658(2.5%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [93] 84.7% range-table-ref [41] 15.3% ------------------------------------------------------------------------------------------- gen-series! [29] 100.0% [35] 3608(2.5%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [93] 100.0% ------------------------------------------------------------------------------------------- prepare-points [26] 100.0% [36] 292(0.2%) 0(0.0%) filter-points .../alt-testing/src/points.rkt:171:0 make-sequence [117] 100.0% ------------------------------------------------------------------------------------------- gen-rewrites! [31] 100.0% [37] 281(0.2%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [42] 100.0% ------------------------------------------------------------------------------------------- make-exacts [33] 1.0% prepare-points [26] 99.0% [38] 28940(19.9%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [91] 100.0% ------------------------------------------------------------------------------------------- make-exacts [33] 14.1% prepare-points [26] 85.9% [39] 26006(17.9%) 278(0.2%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [181] 93.7% debug [44] 2.1% debug-print [158] 2.1% ------------------------------------------------------------------------------------------- ??? [93] 1.1% ??? [32] 98.9% [40] 25790(17.7%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [43] 97.8% kw-chaperone [100] 1.1% *simplify-rules* [47] 1.1% ------------------------------------------------------------------------------------------- ??? [34] 100.0% [41] 558(0.4%) 558(0.4%) range-table-ref ...ng/src/range-analysis.rkt:182:0 ------------------------------------------------------------------------------------------- matcher [46] 50.0% alt-rewrite-rm [37] 50.0% [42] 281(0.2%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [46] 50.0% *rules* [45] 50.0% ------------------------------------------------------------------------------------------- simplify [40] 100.0% [43] 25226(17.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [48] 92.2% loop [49] 7.8% ------------------------------------------------------------------------------------------- make-exacts [33] 33.7% loop [39] 66.3% [44] 836(0.6%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [50] 66.8% get-setting [55] 33.2% ------------------------------------------------------------------------------------------- rewriter [42] 100.0% [45] 281(0.2%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [51] 100.0% ------------------------------------------------------------------------------------------- matcher [46] 50.0% rewriter [42] 50.0% [46] 281(0.2%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [46] 50.0% rewriter [42] 50.0% ------------------------------------------------------------------------------------------- simplify [40] 100.0% [47] 279(0.2%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 ??? [52] 100.0% ------------------------------------------------------------------------------------------- ??? [43] 100.0% [48] 23254(16.0%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [53] 100.0% ------------------------------------------------------------------------------------------- ??? [43] 100.0% [49] 1972(1.4%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [85] 57.3% loop [54] 42.7% ------------------------------------------------------------------------------------------- debug [44] 100.0% [50] 558(0.4%) 0(0.0%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 get-setting [55] 100.0% ------------------------------------------------------------------------------------------- *rules* [45] 100.0% [51] 281(0.2%) 0(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 dict-ref-contract [128] 100.0% ------------------------------------------------------------------------------------------- *simplify-rules* [47] 100.0% [52] 279(0.2%) 279(0.2%) ??? .../racket/collects/racket/function.rkt:101:10 ------------------------------------------------------------------------------------------- iterate-egraph! [48] 100.0% [53] 23254(16.0%) 556(0.4%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [56] 42.3% mk-enode! [61] 15.6% merge-egraph-nodes! [57] 12.0% custom-set-member? [58] 10.9% substitute-e [59] 7.3% loop! [186] 7.3% filter [129] 1.2% list-member? [123] 1.2% ------------------------------------------------------------------------------------------- f53 [156] 24.2% loop [49] 75.8% [54] 1112(0.8%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [89] 75.8% errors-score [60] 24.2% ------------------------------------------------------------------------------------------- debug [44] 33.2% cur-debug-level [50] 66.8% [55] 836(0.6%) 554(0.4%) get-setting ...rbie/alt-testing/src/debug.rkt:96:0 ??? [75] 33.7% ------------------------------------------------------------------------------------------- match-e [56] 19.5% one-iter [53] 80.5% [56] 9828(6.8%) 2519(1.7%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [56] 19.5% loop [181] 12.9% ??? [65] 8.7% make-sequence [117] 8.6% variable? [63] 6.2% custom-in-set [66] 5.7% list-cartesian-product [64] 5.7% dict-ref [110] 2.8% make-curried [67] 2.8% ??? [75] 1.4% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [57] 4.9% one-iter [53] 95.1% [57] 2786(1.9%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [62] 79.9% loop! [186] 15.2% merge-egraph-nodes! [57] 4.9% ------------------------------------------------------------------------------------------- one-iter [53] 100.0% [58] 2527(1.7%) 2527(1.7%) custom-set-member? ...t/private/set-types.rkt:45:0 ------------------------------------------------------------------------------------------- substitute-e [59] 11.1% one-iter [53] 88.9% [59] 1694(1.2%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [61] 83.4% substitute-e [59] 11.1% variable? [63] 5.5% ------------------------------------------------------------------------------------------- loop [54] 100.0% [60] 270(0.2%) 270(0.2%) errors-score ...e/alt-testing/src/points.rkt:281:0 ------------------------------------------------------------------------------------------- substitute-e [59] 28.1% one-iter [53] 71.9% [61] 5032(3.5%) 0(0.0%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [68] 94.4% hash-has-key? [77] 5.6% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [57] 100.0% [62] 2226(1.5%) 837(0.6%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [69] 62.4% ------------------------------------------------------------------------------------------- f53 [156] 13.8% substitute-e [59] 14.3% match-e [56] 72.0% [63] 1968(1.4%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [75] 100.0% ------------------------------------------------------------------------------------------- list-cartesian-product [64] 37.4% match-e [56] 62.6% [64] 1122(0.8%) 560(0.4%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [117] 37.6% list-cartesian-product [64] 37.4% ------------------------------------------------------------------------------------------- match-e [56] 100.0% [65] 852(0.6%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [70] 100.0% ------------------------------------------------------------------------------------------- match-e [56] 100.0% [66] 562(0.4%) 562(0.4%) custom-in-set ...acket/private/set-types.rkt:580:0 ------------------------------------------------------------------------------------------- match-e [56] 100.0% [67] 277(0.2%) 277(0.2%) make-curried ...collects/racket/function.rkt:130:9 ------------------------------------------------------------------------------------------- mk-enode! [61] 100.0% [68] 4753(3.3%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [71] 100.0% ------------------------------------------------------------------------------------------- update-leader! [62] 100.0% [69] 1388(1.0%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [72] 100.0% ------------------------------------------------------------------------------------------- ??? [65] 100.0% [70] 852(0.6%) 852(0.6%) do-curry ...cket/collects/racket/function.rkt:71:2 ------------------------------------------------------------------------------------------- new-enode [68] 100.0% [71] 4753(3.3%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [73] 94.4% f53 [156] 5.6% ------------------------------------------------------------------------------------------- do-hash-update [69] 100.0% [72] 1388(1.0%) 847(0.6%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [74] 19.9% reverse [131] 19.1% ------------------------------------------------------------------------------------------- type-of-enode-expr [71] 100.0% [73] 4486(3.1%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [114] 37.7% ??? [75] 31.3% ??? [118] 18.6% dict-ref-contract [128] 12.4% ------------------------------------------------------------------------------------------- ??? [72] 100.0% [74] 276(0.2%) 276(0.2%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------------------------- get-setting [55] 1.5% match-e [56] 1.5% get-sigs [73] 7.3% variable? [63] 10.3% ??? [157] 15.9% choose-best-alt! [30] 17.5% finalize-iter! [28] 44.6% [75] 19140(13.2%) 283(0.2%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [76] 44.6% hash-has-key? [77] 29.1% atab-pick-alt [78] 17.5% ??? [157] 5.8% assoc-has-key? [79] 1.5% ------------------------------------------------------------------------------------------- ??? [75] 100.0% [76] 8544(5.9%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [80] 100.0% ------------------------------------------------------------------------------------------- mk-enode! [61] 4.8% ??? [75] 95.2% [77] 5856(4.0%) 2530(1.7%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [126] 56.8% ------------------------------------------------------------------------------------------- ??? [75] 100.0% [78] 3352(2.3%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [81] 58.2% ??? [93] 24.9% write-json* [82] 16.8% ------------------------------------------------------------------------------------------- ??? [75] 100.0% [79] 282(0.2%) 0(0.0%) assoc-has-key? ...ts/racket/private/dict.rkt:257:0 assoc [83] 100.0% ------------------------------------------------------------------------------------------- atab-add-altns [76] 100.0% [80] 8544(5.9%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [84] 90.3% override-at-pnts [86] 9.7% ------------------------------------------------------------------------------------------- atab-pick-alt [78] 100.0% [81] 1952(1.3%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [181] 85.8% mk-min [85] 14.2% ------------------------------------------------------------------------------------------- atab-pick-alt [78] 100.0% [82] 564(0.4%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [87] 100.0% ------------------------------------------------------------------------------------------- assoc-has-key? [79] 100.0% [83] 282(0.2%) 282(0.2%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------------- atab-add-altn [80] 100.0% [84] 7716(5.3%) 555(0.4%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [88] 92.8% ------------------------------------------------------------------------------------------- point-best-alt [81] 19.7% loop [49] 80.3% [85] 1408(1.0%) 278(0.2%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [89] 80.3% ------------------------------------------------------------------------------------------- atab-add-altn [80] 100.0% [86] 827(0.6%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [88] 100.0% ------------------------------------------------------------------------------------------- write-json* [82] 25.0% loop [87] 75.0% [87] 564(0.4%) 564(0.4%) loop .../share/racket/collects/json/main.rkt:132:2 loop [87] 75.0% ------------------------------------------------------------------------------------------- override-at-pnts [86] 2.1% composed [194] 2.7% best-and-tied-at-points [84] 17.8% pred [23] 28.4% loop [181] 48.9% [88] 40182(27.7%) 561(0.4%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [90] 62.6% eval-prog [91] 29.1% ??? [93] 4.2% ulp-difference [92] 2.7% ------------------------------------------------------------------------------------------- loop [54] 42.7% mk-min [85] 57.3% [89] 1972(1.4%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [114] 85.3% compile [97] 14.7% ------------------------------------------------------------------------------------------- generic-sort/key [18] 2.0% ??? [13] 2.0% copying-mergesort [21] 10.6% loop [181] 39.4% errors [88] 46.0% [90] 54660(37.6%) 23515(16.2%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [181] 29.5% ??? [94] 9.1% bf* [95] 6.2% ??? [103] 4.6% ??? [98] 2.5% ??? [166] 2.5% ??? [99] 2.1% ------------------------------------------------------------------------------------------- sindices->spoints [5] 0.6% point->alt [15] 0.7% option-on-expr [2] 1.3% errors [88] 28.0% make-exacts* [38] 69.3% [91] 41736(28.7%) 28067(19.3%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f53 [156] 16.6% ??? [93] 5.3% ??? [96] 3.4% compile [97] 2.7% parse-app [167] 2.0% kw-chaperone [100] 1.3% go [101] 0.7% ------------------------------------------------------------------------------------------- errors [88] 100.0% [92] 1087(0.7%) 809(0.6%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 dict-ref-contract [128] 25.6% ------------------------------------------------------------------------------------------- copying-mergesort [21] 0.7% get-final-combination [22] 0.7% ??? [13] 0.8% atab-pick-alt [78] 2.2% errors [88] 4.4% loop [105] 4.8% taylor-alt [35] 4.8% eval-prog [91] 5.9% ??? [34] 8.2% f53 [156] 17.6% loop [181] 50.0% [93] 37894(26.1%) 1152(0.8%) ??? ...tract/private/arrow-higher-order.rkt:375:33 ->flonum [102] 38.8% real->bigfloat [104] 14.8% table-ref [114] 8.1% ??? [157] 8.0% sample-multi-bounded [107] 7.4% loop [105] 4.8% approximate [106] 4.8% ->bf [108] 3.0% best-alt [111] 2.2% dict-ref-contract [128] 2.2% ??? [118] 1.5% ??? [166] 0.7% simplify [40] 0.7% ------------------------------------------------------------------------------------------- ??? [90] 100.0% [94] 4972(3.4%) 3324(2.3%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [116] 16.4% dict-ref [110] 11.2% dict-ref-contract [128] 5.5% ------------------------------------------------------------------------------------------- ??? [90] 100.0% [95] 3383(2.3%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [103] 100.0% ------------------------------------------------------------------------------------------- eval-prog [91] 100.0% [96] 1411(1.0%) 286(0.2%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [109] 79.7% ------------------------------------------------------------------------------------------- expression-cost [89] 20.5% eval-prog [91] 79.5% [97] 1409(1.0%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- ??? [90] 100.0% [98] 1384(1.0%) 1384(1.0%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------- ??? [90] 100.0% [99] 1122(0.8%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [150] 100.0% ------------------------------------------------------------------------------------------- simplify [40] 33.8% eval-prog [91] 66.2% [100] 840(0.6%) 276(0.2%) kw-chaperone ...ects/racket/private/kw.rkt:2036:33 ??? [112] 67.2% ------------------------------------------------------------------------------------------- eval-prog [91] 100.0% [101] 284(0.2%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 stx-list? [113] 100.0% ------------------------------------------------------------------------------------------- ??? [93] 100.0% [102] 14698(10.1%) 10512(7.2%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 dict-ref-contract [128] 15.2% return/no-unsupplied [116] 9.4% ??? [124] 2.1% list-member? [123] 1.9% ------------------------------------------------------------------------------------------- ??? [90] 42.7% bf* [95] 57.3% [103] 5904(4.1%) 838(0.6%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [115] 66.9% bfsqrt [121] 18.9% ------------------------------------------------------------------------------------------- ??? [93] 100.0% [104] 5610(3.9%) 2236(1.5%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [127] 60.1% ------------------------------------------------------------------------------------------- ??? [93] 14.1% loop [105] 85.9% [105] 3608(2.5%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [105] 85.9% ??? [93] 14.1% ------------------------------------------------------------------------------------------- ??? [93] 100.0% [106] 3608(2.5%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 taylor [120] 38.9% hash-ref! [164] 38.2% ??? [119] 7.8% f53 [156] 7.7% taylor-sqrt [133] 7.4% ------------------------------------------------------------------------------------------- ??? [93] 100.0% [107] 2820(1.9%) 1422(1.0%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [122] 29.9% make-sequence [117] 9.9% flonum->ordinal [125] 9.8% ------------------------------------------------------------------------------------------- loop [181] 20.1% ??? [93] 79.9% [108] 1402(1.0%) 282(0.2%) ->bf ...s/herbie/alt-testing/src/programs.rkt:53:0 table-ref [114] 60.4% ??? [118] 19.5% ------------------------------------------------------------------------------------------- ??? [96] 100.0% [109] 1124(0.8%) 1124(0.8%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------------------- match-e [56] 33.4% ??? [94] 66.6% [110] 836(0.6%) 836(0.6%) dict-ref ...lects/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------------- ??? [93] 100.0% [111] 836(0.6%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [192] 100.0% ------------------------------------------------------------------------------------------- kw-chaperone [100] 100.0% [112] 564(0.4%) 280(0.2%) ??? ...tract/private/arrow-higher-order.rkt:387:44 ??? [150] 50.4% ------------------------------------------------------------------------------------------- go [101] 100.0% [113] 284(0.2%) 284(0.2%) stx-list? .../collects/racket/private/stx.rkt:49:4 ------------------------------------------------------------------------------------------- ->bf [108] 11.6% expression-cost [89] 23.1% get-sigs [73] 23.3% ??? [93] 42.0% [114] 7280(5.0%) 1963(1.4%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [126] 69.1% dict-ref-contract [128] 3.9% ------------------------------------------------------------------------------------------- ??? [103] 100.0% [115] 3949(2.7%) 1434(1.0%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [127] 56.6% ??? [135] 7.1% ------------------------------------------------------------------------------------------- ??? [94] 37.2% ->flonum [102] 62.8% [116] 2195(1.5%) 276(0.2%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [129] 62.4% reverse [131] 25.0% ------------------------------------------------------------------------------------------- sample-multi-bounded [107] 14.1% filter-points [36] 14.8% list-cartesian-product [64] 28.4% match-e [56] 42.7% [117] 1976(1.4%) 1976(1.4%) make-sequence ...ects/racket/private/for.rkt:557:2 ------------------------------------------------------------------------------------------- ->bf [108] 16.3% ??? [93] 33.8% get-sigs [73] 49.9% [118] 1671(1.1%) 280(0.2%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [132] 33.1% ??? [134] 17.0% handle-the-hash [140] 16.8% arrow-higher-order:lnp [137] 16.3% ------------------------------------------------------------------------------------------- approximate [106] 16.9% ??? [3] 83.1% [119] 1660(1.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- f53 [156] 14.1% taylor [120] 22.0% approximate [106] 63.9% [120] 1403(1.0%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [120] 22.0% taylor-sqrt [133] 20.1% taylor-invert [130] 20.1% taylor-quotient [136] 19.7% f53 [156] 14.1% debug-print [158] 4.0% ------------------------------------------------------------------------------------------- ??? [103] 100.0% [121] 1118(0.8%) 556(0.4%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [127] 50.3% ------------------------------------------------------------------------------------------- random-exp [122] 33.1% sample-multi-bounded [107] 66.9% [122] 844(0.6%) 844(0.6%) random-exp ...bie/alt-testing/src/common.rkt:253:0 random-exp [122] 33.1% ------------------------------------------------------------------------------------------- one-iter [53] 49.2% ->flonum [102] 50.8% [123] 549(0.4%) 279(0.2%) list-member? ...llects/racket/private/set.rkt:24:0 member [138] 49.2% ------------------------------------------------------------------------------------------- ->flonum [102] 100.0% [124] 302(0.2%) 302(0.2%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 ------------------------------------------------------------------------------------------- sample-multi-bounded [107] 100.0% [125] 275(0.2%) 275(0.2%) flonum->ordinal ...ate/flonum/flonum-bits.rkt:68:0 ------------------------------------------------------------------------------------------- hash-has-key? [77] 39.8% table-ref [114] 60.2% [126] 8360(5.8%) 3914(2.7%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [139] 19.7% handle-the-hash [140] 13.4% successfully-got-the-right-kind-of-function [142] 6.8% do-chaperone-procedure [143] 6.7% ??? [151] 6.7% ------------------------------------------------------------------------------------------- bfsqrt [121] 9.1% bfmul [115] 36.2% real->bigfloat [104] 54.7% [127] 6170(4.2%) 6170(4.2%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------------- ??? [94] 5.8% ulp-difference [92] 5.9% flag-set? [51] 5.9% table-ref [114] 6.0% get-sigs [73] 11.8% ??? [93] 17.6% ->flonum [102] 47.1% [128] 4736(3.3%) 1952(1.3%) dict-ref-contract ...ract/private/arr-i.rkt:976:19 ??? [141] 29.4% ??? [157] 23.3% dict-key-contract [146] 6.1% ------------------------------------------------------------------------------------------- one-iter [53] 17.2% return/no-unsupplied [116] 82.8% [129] 1656(1.1%) 1656(1.1%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------------- f53 [156] 33.1% taylor [120] 66.9% [130] 842(0.6%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [149] 66.9% normalize-series [144] 33.1% ------------------------------------------------------------------------------------------- ??? [72] 32.6% return/no-unsupplied [116] 67.4% [131] 813(0.6%) 813(0.6%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------------- ??? [118] 100.0% [132] 553(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [145] 100.0% ------------------------------------------------------------------------------------------- approximate [106] 48.5% taylor [120] 51.5% [133] 548(0.4%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 simplify [149] 100.0% ------------------------------------------------------------------------------------------- ??? [118] 100.0% [134] 284(0.2%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:69:2 get-blame-party-info [147] 100.0% ------------------------------------------------------------------------------------------- bfmul [115] 100.0% [135] 281(0.2%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [148] 100.0% ------------------------------------------------------------------------------------------- taylor [120] 100.0% [136] 276(0.2%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 normalize-series [144] 100.0% ------------------------------------------------------------------------------------------- ??? [118] 100.0% [137] 273(0.2%) 273(0.2%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ------------------------------------------------------------------------------------------- list-member? [123] 100.0% [138] 270(0.2%) 270(0.2%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------------- ??? [126] 100.0% [139] 1646(1.1%) 832(0.6%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [152] 33.0% make-keyword-procedure [155] 16.4% ------------------------------------------------------------------------------------------- ??? [118] 20.1% ??? [126] 79.9% [140] 1398(1.0%) 558(0.4%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [150] 60.1% ------------------------------------------------------------------------------------------- ??? [150] 30.0% dict-ref-contract [128] 70.0% [141] 1392(1.0%) 559(0.4%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [150] 30.0% ??? [157] 20.0% ??? [151] 19.8% ------------------------------------------------------------------------------------------- ??? [126] 100.0% [142] 568(0.4%) 292(0.2%) successfully-got-the-right-kind-of-function ...5:4 arity-checking-wrapper [153] 48.5% ------------------------------------------------------------------------------------------- ??? [126] 100.0% [143] 558(0.4%) 558(0.4%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 ------------------------------------------------------------------------------------------- taylor-quotient [136] 49.7% taylor-invert [130] 50.3% [144] 555(0.4%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 simplify [149] 50.3% hash-ref! [164] 49.7% ------------------------------------------------------------------------------------------- ??? [132] 100.0% [145] 553(0.4%) 280(0.2%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [154] 49.4% ------------------------------------------------------------------------------------------- dict-ref-contract [128] 100.0% [146] 288(0.2%) 288(0.2%) dict-key-contract ...collects/racket/dict.rkt:71:0 ------------------------------------------------------------------------------------------- ??? [134] 100.0% [147] 284(0.2%) 284(0.2%) get-blame-party-info ...ate/arrow-common.rkt:136:0 ------------------------------------------------------------------------------------------- ??? [135] 100.0% [148] 281(0.2%) 281(0.2%) assq ...et/collects/racket/private/list.rkt:187:13 ------------------------------------------------------------------------------------------- normalize-series [144] 8.4% ??? [171] 8.4% taylor-sqrt [133] 16.5% taylor-invert [130] 16.9% hash-ref! [164] 49.8% [149] 3327(2.3%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f53 [156] 75.2% debug-print [158] 16.3% simplify* [161] 8.5% ------------------------------------------------------------------------------------------- ??? [112] 9.2% ??? [141] 27.1% handle-the-hash [140] 27.2% ??? [99] 36.4% [150] 3081(2.1%) 848(0.6%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [141] 27.1% ??? [160] 18.2% ??? [157] 18.1% check-list [187] 9.1% ------------------------------------------------------------------------------------------- ??? [141] 33.1% ??? [126] 66.9% [151] 832(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [159] 100.0% ------------------------------------------------------------------------------------------- ??? [139] 29.2% loop [152] 70.8% [152] 544(0.4%) 544(0.4%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [152] 70.8% ------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [142]100.0% [153] 276(0.2%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:443:0 procedure-keywords [162] 100.0% ------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [145] 100.0% [154] 273(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [163] 100.0% ------------------------------------------------------------------------------------------- ??? [139] 100.0% [155] 270(0.2%) 270(0.2%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------------- approximate [106] 0.1% type-of-enode-expr [71] 0.3% taylor [120] 0.6% simplify [149] 1.4% eval-prog [91] 2.3% loop [181] 3.8% split-table [25] 91.5% [156] 95243(65.5%) 2485(1.7%) f53 ...t/collects/racket/match/compiler.rkt:548:40 loop [181] 95.0% ??? [93] 2.2% taylor [120] 0.6% loop [54] 0.3% parse-app [167] 0.1% taylor-invert [130] 0.1% variable? [63] 0.1% ------------------------------------------------------------------------------------------- ??? [141] 8.8% ??? [150] 8.8% ??? [75] 17.3% dict-ref-contract [128] 17.4% ??? [93] 47.8% [157] 6362(4.4%) 0(0.0%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ??? [75] 47.8% dict? [165] 34.7% ^TYPE? [182] 8.8% contract? [168] 8.8% ------------------------------------------------------------------------------------------- prepare-points [26] 16.5% taylor [120] 17.1% simplify [149] 33.1% loop [39] 33.3% [158] 1639(1.1%) 1639(1.1%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ------------------------------------------------------------------------------------------- ??? [151] 100.0% [159] 832(0.6%) 276(0.2%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [169] 66.9% ------------------------------------------------------------------------------------------- ??? [150] 100.0% [160] 560(0.4%) 274(0.2%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [166] 51.2% ------------------------------------------------------------------------------------------- simplify [149] 100.0% [161] 284(0.2%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- arity-checking-wrapper [153] 100.0% [162] 276(0.2%) 276(0.2%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------------- ??? [154] 100.0% [163] 273(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [170] 100.0% ------------------------------------------------------------------------------------------- ??? [3] 3.4% ??? [177] 3.6% ??? [172] 6.1% normalize-series [144] 7.6% simplify* [161] 7.8% ??? [171] 8.0% approximate [106] 8.0% ??? [119] 15.7% loop [181] 17.9% compile [97] 20.9% [164] 3629(2.5%) 1134(0.8%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [173] 17.9% ??? [171] 15.7% simplify [149] 15.6% ??? [3] 11.4% ??? [172] 6.1% bigfloat-hash [176] 3.9% ??? [177] 3.6% ------------------------------------------------------------------------------------------- ??? [157] 100.0% [165] 2207(1.5%) 2207(1.5%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------------------- ??? [93] 14.4% ??? [160] 14.8% ??? [90] 70.9% [166] 1942(1.3%) 827(0.6%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [174] 43.0% ??? [178] 14.4% ------------------------------------------------------------------------------------------- f53 [156] 25.0% eval-prog [91] 75.0% [167] 1131(0.8%) 1131(0.8%) parse-app ...collects/racket/private/kw.rkt:1207:2 ------------------------------------------------------------------------------------------- ??? [157] 100.0% [168] 557(0.4%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [175] 50.0% coerce-contract/f [179] 50.0% ------------------------------------------------------------------------------------------- check-hash/c [159] 100.0% [169] 556(0.4%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [175] 100.0% ------------------------------------------------------------------------------------------- ??? [163] 100.0% [170] 273(0.2%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [180] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [171] 1660(1.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [164] 83.1% simplify [149] 16.9% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [172] 1108(0.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [173] 849(0.6%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [181] 100.0% ------------------------------------------------------------------------------------------- ??? [166] 100.0% [174] 836(0.6%) 274(0.2%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [184] 34.3% ^TYPE? [182] 33.0% ------------------------------------------------------------------------------------------- contract? [168] 33.4% flat-contract? [169] 66.6% [175] 834(0.6%) 834(0.6%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [176] 560(0.4%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [183] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [164] 100.0% [177] 543(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [164] 100.0% ------------------------------------------------------------------------------------------- ??? [166] 100.0% [178] 279(0.2%) 279(0.2%) ??? ...lects/racket/contract/private/orc.rkt:117:8 ------------------------------------------------------------------------------------------- contract? [168] 100.0% [179] 278(0.2%) 278(0.2%) coerce-contract/f ...ntract/private/guts.rkt:372:0 ------------------------------------------------------------------------------------------- get/build-late-neg-projection [170] 100.0% [180] 273(0.2%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [185] 100.0% ------------------------------------------------------------------------------------------- loop! [186] 0.0% get-final-combination [22] 0.1% point-best-alt [81] 0.2% ??? [173] 0.3% loop [39] 0.7% option-on-expr [2] 0.7% match-e [56] 1.1% ??? [90] 1.8% f53 [156] 7.2% loop [181] 87.9% [181] 109272(75.2%) 1120(0.8%) loop .../private/map.rkt:40:19 loop [181] 87.9% option-on-expr [2] 5.7% ??? [93] 1.8% f53 [156] 1.5% errors [88] 0.9% ??? [90] 0.6% step [189] 0.3% hash-ref! [164] 0.3% extract-alt [190] 0.1% loop! [186] 0.0% ->bf [108] 0.0% ??? [13] 0.0% ------------------------------------------------------------------------------------------- ??? [174] 33.1% ??? [157] 66.9% [182] 832(0.6%) 832(0.6%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------------- bigfloat-hash [176] 100.0% [183] 560(0.4%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [188] 100.0% ------------------------------------------------------------------------------------------- ??? [174] 100.0% [184] 287(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [187] 100.0% ------------------------------------------------------------------------------------------- ??? [180] 100.0% [185] 273(0.2%) 273(0.2%) build-compound-type-name ...private/guts.rkt:543:0 ------------------------------------------------------------------------------------------- loop [181] 12.4% merge-egraph-nodes! [57] 18.8% one-iter [53] 68.8% [186] 2248(1.5%) 283(0.2%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [191] 81.3% loop [181] 12.4% ------------------------------------------------------------------------------------------- err-lsts->split-indices [7] 32.8% ??? [150] 33.2% ??? [184] 34.0% [187] 844(0.6%) 844(0.6%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------------- bfcanonicalize [183] 100.0% [188] 560(0.4%) 560(0.4%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------------- loop [181] 100.0% [189] 558(0.4%) 282(0.2%) step .../racket/collects/racket/function.rkt:145:9 sort [193] 49.5% ------------------------------------------------------------------------------------------- loop [181] 100.0% [190] 268(0.2%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [192] 100.0% ------------------------------------------------------------------------------------------- loop! [186] 100.0% [191] 1965(1.4%) 1965(1.4%) custom-set-union ...et/private/set-types.rkt:168:0 ------------------------------------------------------------------------------------------- extract-alt [190] 24.2% best-alt [111] 75.8% [192] 1104(0.8%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [194] 100.0% ------------------------------------------------------------------------------------------- step [189] 100.0% [193] 276(0.2%) 276(0.2%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------------------- argmins [192] 100.0% [194] 1104(0.8%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [88] 100.0% -------------------------------------------------------------------------------------------