Profiling results ----------------- Total cpu time observed: 660972ms (out of 662123ms) Number of samples taken: 2268 (once every 291ms) (Hiding functions with self<1.0% and local<2.0%: 26 of 276 hidden) ========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================== [1] 660972(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [9] 100.0% ------------------------------------------------------------------------------------------ loop [185] 100.0% [2] 126988(19.2%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [10] 55.1% loop [185] 23.6% sort-context-on-expr [11] 15.9% err-lsts->split-indices [12] 2.7% pick-errors [13] 1.6% eval-prog [130] 0.2% ------------------------------------------------------------------------------------------ hash-ref! [157] 100.0% [3] 13686(2.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 hash-ref! [157] 74.7% ??? [150] 22.2% get-coeffs [14] 3.1% ------------------------------------------------------------------------------------------ hash-ref! [157] 100.0% [4] 5797(0.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [157] 75.1% ??? [174] 24.9% ------------------------------------------------------------------------------------------ hash-ref! [157] 100.0% [5] 3196(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 simplify [19] 72.3% hash-ref! [157] 27.7% ------------------------------------------------------------------------------------------ loop [185] 100.0% [6] 2344(0.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 taylor [151] 50.5% hash-ref! [157] 49.5% ------------------------------------------------------------------------------------------ loop [21] 8.3% loop [7] 41.7% loop [185] 50.0% [7] 876(0.1%) 292(0.0%) loop ...cket/collects/racket/private/map.rkt:40:19 ...row-higher-order.rkt:375:33 [129] 50.0% loop [7] 41.7% ------------------------------------------------------------------------------------------ taylor [151] 100.0% [8] 589(0.1%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 normalize-series [15] 51.1% simplify [19] 48.9% ------------------------------------------------------------------------------------------ ??? [1] 100.0% [9] 660972(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [16] 100.0% ------------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [10] 69930(10.6%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [17] 98.4% eval-prog [130] 0.8% f8 [136] 0.4% ------------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [11] 20180(3.1%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [18] 98.6% eval-prog [130] 1.4% ------------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [12] 3455(0.5%) 2012(0.3%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [198] 33.5% check-list [250] 8.3% ------------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [13] 2025(0.3%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [182] 85.6% loop [21] 14.4% ------------------------------------------------------------------------------------------ ??? [3] 100.0% [14] 868(0.1%) 0(0.0%) get-coeffs ...alt-testing/src/core/taylor.rkt:64:2 build-unary-very-simple--> [20] 100.0% ------------------------------------------------------------------------------------------ taylor-invert [8] 100.0% [15] 301(0.0%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 simplify [19] 100.0% ------------------------------------------------------------------------------------------ profile-thunk [9] 100.0% [16] 660972(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [22] 100.0% ------------------------------------------------------------------------------------------ f8 [136] 0.0% loop [17] 23.0% sindices->spoints [10] 77.0% [17] 69066(10.4%) 0(0.0%) loop .../private/map.rkt:54:19 sidx->spoint [23] 77.0% loop [17] 23.0% ulp-difference [133] 0.0% ------------------------------------------------------------------------------------------ sort-context-on-expr [11] 100.0% [18] 19894(3.0%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [24] 98.6% ------------------------------------------------------------------------------------------ taylor-invert [8] 2.5% ??? [166] 2.5% normalize-series [15] 2.6% loop [185] 5.0% ??? [5] 19.8% hash-ref! [157] 67.6% [19] 11666(1.8%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [136] 62.4% debug-print [160] 17.5% simplify* [25] 12.6% debug [51] 5.0% simplify-node [199] 2.5% ------------------------------------------------------------------------------------------ get-coeffs [14] 100.0% [20] 868(0.1%) 0(0.0%) build-unary-very-simple--> ...val-first.rkt:1153:0 coerce-contract [26] 67.0% chaperone-contract? [27] 33.0% ------------------------------------------------------------------------------------------ pick-errors [13] 0.6% loop [21] 99.4% [21] 292(0.0%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:259:4 loop [21] 99.4% loop [7] 0.6% ------------------------------------------------------------------------------------------ ??? [16] 100.0% [22] 660972(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [28] 94.2% prepare-points [38] 5.8% ------------------------------------------------------------------------------------------ loop [17] 100.0% [23] 68783(10.4%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [29] 100.0% ------------------------------------------------------------------------------------------ ??? [18] 100.0% [24] 19613(3.0%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [30] 91.1% ??? [184] 8.9% ------------------------------------------------------------------------------------------ loop [185] 16.7% simplify [19] 83.3% [25] 1760(0.3%) 586(0.1%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [157] 66.7% ------------------------------------------------------------------------------------------ build-unary-very-simple--> [20] 100.0% [26] 582(0.1%) 0(0.0%) coerce-contract ...contract/private/guts.rkt:307:0 coerce-contract/f [238] 100.0% ------------------------------------------------------------------------------------------ build-unary-very-simple--> [20] 100.0% [27] 287(0.0%) 0(0.0%) chaperone-contract? ...ract/private/guts.rkt:135:0 simple-flat-contract? [236] 100.0% ------------------------------------------------------------------------------------------ ??? [22] 100.0% [28] 622324(94.2%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [31] 78.8% get-final-combination [32] 20.6% setup-prog! [34] 0.4% setup-alt-simplified [35] 0.2% ??? [97] 0.0% ------------------------------------------------------------------------------------------ sidx->spoint [23] 100.0% [29] 68783(10.4%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [33] 100.0% ------------------------------------------------------------------------------------------ generic-sort/key [24] 42.6% copying-mergesort [30] 57.4% [30] 17866(2.7%) 287(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [30] 57.4% ??? [184] 38.5% ...row-higher-order.rkt:375:33 [129] 3.6% ------------------------------------------------------------------------------------------ run-improve [28] 100.0% [31] 490090(74.1%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [36] 80.8% gen-series! [39] 12.0% finalize-iter! [40] 4.5% choose-best-alt! [41] 1.8% gen-rewrites! [42] 0.7% localize! [44] 0.2% ------------------------------------------------------------------------------------------ run-improve [28] 100.0% [32] 128418(19.4%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [37] 99.6% loop [185] 0.4% ------------------------------------------------------------------------------------------ binary-search-floats [29] 100.0% [33] 68783(10.4%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [38] 83.6% errors [120] 16.4% ------------------------------------------------------------------------------------------ run-improve [28] 100.0% [34] 2352(0.4%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [38] 87.8% setup-prog [45] 12.2% ------------------------------------------------------------------------------------------ run-improve [28] 100.0% [35] 1176(0.2%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [43] 100.0% ------------------------------------------------------------------------------------------ run-iter! [31] 100.0% [36] 395890(59.9%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [46] 99.9% debug-print [160] 0.1% ------------------------------------------------------------------------------------------ get-final-combination [32] 100.0% [37] 127850(19.3%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [136] 99.3% ??? [97] 0.7% ------------------------------------------------------------------------------------------ setup-prog! [34] 2.1% ??? [22] 39.4% pred [33] 58.5% [38] 98209(14.9%) 288(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 make-exacts* [56] 42.3% loop [55] 38.3% make-exacts [48] 14.3% ??? [49] 4.1% filter-points [53] 0.3% debug [51] 0.3% ------------------------------------------------------------------------------------------ run-iter! [31] 100.0% [39] 58763(8.9%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [47] 100.0% ------------------------------------------------------------------------------------------ run-iter! [31] 100.0% [40] 22130(3.3%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [97] 100.0% ------------------------------------------------------------------------------------------ run-iter! [31] 100.0% [41] 8655(1.3%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [97] 100.0% ------------------------------------------------------------------------------------------ run-iter! [31] 100.0% [42] 3490(0.5%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [50] 100.0% ------------------------------------------------------------------------------------------ setup-alt-simplified [35] 100.0% [43] 1176(0.2%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [54] 100.0% ------------------------------------------------------------------------------------------ run-iter! [31] 100.0% [44] 1161(0.2%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [52] 100.0% ------------------------------------------------------------------------------------------ setup-prog! [34] 100.0% [45] 288(0.0%) 0(0.0%) setup-prog ...herbie/alt-testing/src/glue.rkt:40:0 ??? [97] 100.0% ------------------------------------------------------------------------------------------ simplify! [36] 100.0% [46] 395312(59.8%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [54] 100.0% ------------------------------------------------------------------------------------------ gen-series! [39] 100.0% [47] 58763(8.9%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [129] 100.0% ------------------------------------------------------------------------------------------ prepare-points [38] 100.0% [48] 14016(2.1%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [55] 96.0% make-exacts* [56] 2.0% debug-print [160] 2.0% ------------------------------------------------------------------------------------------ prepare-points [38] 100.0% [49] 4073(0.6%) 584(0.1%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ...row-higher-order.rkt:375:33 [129] 85.7% ------------------------------------------------------------------------------------------ gen-rewrites! [42] 100.0% [50] 3490(0.5%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [57] 100.0% ------------------------------------------------------------------------------------------ prepare-points [38] 24.9% taylor [151] 25.0% simplify [19] 50.1% [51] 1172(0.2%) 294(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [58] 50.1% dict-ref-contract [149] 24.9% ------------------------------------------------------------------------------------------ localize! [44] 100.0% [52] 1161(0.2%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [157] 100.0% ------------------------------------------------------------------------------------------ prepare-points [38] 100.0% [53] 334(0.1%) 0(0.0%) filter-points .../alt-testing/src/points.rkt:171:0 ordinary-value? [59] 100.0% ------------------------------------------------------------------------------------------ simplify-alt [43] 0.3% ??? [46] 99.7% [54] 396487(60.0%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [60] 100.0% ------------------------------------------------------------------------------------------ make-exacts [48] 26.3% prepare-points [38] 73.7% [55] 51108(7.7%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [185] 98.9% debug-print [160] 0.6% gen-andmap [65] 0.6% ------------------------------------------------------------------------------------------ make-exacts [48] 0.7% prepare-points [38] 99.3% [56] 41838(6.3%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [130] 100.0% ------------------------------------------------------------------------------------------ alt-rewrite-rm [50] 29.5% matcher [61] 70.5% [57] 3490(0.5%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [61] 72.6% *rules* [62] 22.5% expression->type [64] 2.8% make-sequence [233] 2.1% ------------------------------------------------------------------------------------------ debug [51] 100.0% [58] 587(0.1%) 0(0.0%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 hash-ref! [157] 50.1% get-setting [63] 49.9% ------------------------------------------------------------------------------------------ filter-points [53] 100.0% [59] 334(0.1%) 334(0.1%) ordinary-value? ...lt-testing/src/common.rkt:108:0 ------------------------------------------------------------------------------------------ simplify [54] 100.0% [60] 396487(60.0%) 293(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [66] 84.4% loop [67] 15.4% mk-egraph [69] 0.1% ------------------------------------------------------------------------------------------ matcher [61] 50.0% rewriter [57] 50.0% [61] 3490(0.5%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [61] 50.0% rewriter [57] 49.0% pattern-match [70] 1.0% ------------------------------------------------------------------------------------------ rewriter [57] 100.0% [62] 2615(0.4%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [68] 66.7% list-member? [193] 11.2% ??? [198] 11.1% ??? [207] 10.9% ------------------------------------------------------------------------------------------ cur-debug-level [58] 100.0% [63] 293(0.0%) 0(0.0%) get-setting ...rbie/alt-testing/src/debug.rkt:96:0 ??? [97] 100.0% ------------------------------------------------------------------------------------------ expression->type [64] 50.0% rewriter [57] 50.0% [64] 292(0.0%) 292(0.0%) expression->type ...esting/src/type-check.rkt:45:0 expression->type [64] 50.0% ------------------------------------------------------------------------------------------ loop [55] 100.0% [65] 290(0.0%) 0(0.0%) gen-andmap ...ollects/racket/private/map.rkt:275:2 check-args [71] 100.0% ------------------------------------------------------------------------------------------ ??? [60] 100.0% [66] 334672(50.6%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [72] 98.5% loop [185] 1.5% ------------------------------------------------------------------------------------------ ??? [60] 100.0% [67] 61229(9.3%) 2907(0.4%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 loop [73] 59.7% mk-min [74] 32.7% reverse [221] 1.0% make-sequence [233] 0.9% filter [173] 0.5% pack-leader [239] 0.5% ------------------------------------------------------------------------------------------ *rules* [62] 100.0% [68] 1745(0.3%) 1166(0.2%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [167] 16.8% dict-ref-contract [149] 16.4% ------------------------------------------------------------------------------------------ ??? [60] 100.0% [69] 293(0.0%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [75] 100.0% ------------------------------------------------------------------------------------------ pattern-match [70] 50.0% matcher [61] 50.0% [70] 290(0.0%) 0(0.0%) pattern-match ...testing/src/core/matcher.rkt:48:0 pattern-match [70] 50.0% variable? [85] 50.0% ------------------------------------------------------------------------------------------ gen-andmap [65] 100.0% [71] 290(0.0%) 290(0.0%) check-args ...ollects/racket/private/map.rkt:180:2 ------------------------------------------------------------------------------------------ iterate-egraph! [66] 100.0% [72] 329738(49.9%) 7837(1.2%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [76] 41.2% mk-enode! [83] 12.2% loop! [190] 11.8% merge-egraph-nodes! [78] 11.1% substitute-e [79] 9.8% custom-set-member? [80] 6.9% list-member? [193] 2.0% filter [173] 0.9% reverse [221] 0.5% pack-leader [239] 0.4% reduce-to-single! [81] 0.4% in-set [209] 0.3% loop [82] 0.1% ------------------------------------------------------------------------------------------ point-best-alt [109] 0.8% loop [67] 99.2% [73] 36838(5.6%) 288(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [77] 99.2% ------------------------------------------------------------------------------------------ loop [67] 100.0% [74] 20034(3.0%) 282(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [77] 98.6% ------------------------------------------------------------------------------------------ loop [185] 50.0% mk-egraph [69] 50.0% [75] 293(0.0%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [185] 100.0% ------------------------------------------------------------------------------------------ match-e [76] 29.5% one-iter [72] 70.5% [76] 135978(20.6%) 38603(5.8%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [76] 29.5% loop [185] 9.2% ??? [97] 6.9% ??? [207] 6.5% variable? [85] 5.3% make-sequence [233] 3.9% reverse [221] 3.8% list-cartesian-product [86] 3.6% do-procedure-reduce-keyword-arity [223] 3.4% in-set [209] 1.8% make-curried [88] 1.1% pack-leader [239] 0.5% ??? [89] 0.4% filter [173] 0.2% check-list [250] 0.2% ------------------------------------------------------------------------------------------ mk-min [74] 35.1% loop [73] 64.9% [77] 56302(8.5%) 292(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [98] 61.9% dict-ref-contract [149] 20.6% compile [139] 14.9% ??? [99] 1.5% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [78] 4.8% one-iter [72] 95.2% [78] 36632(5.5%) 286(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [84] 62.0% loop! [190] 25.0% enode-merge! [87] 6.3% merge-egraph-nodes! [78] 4.8% make-sequence [233] 1.6% ------------------------------------------------------------------------------------------ substitute-e [79] 14.0% one-iter [72] 86.0% [79] 32254(4.9%) 290(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [83] 77.5% substitute-e [79] 14.0% variable? [85] 4.5% ??? [97] 3.6% ------------------------------------------------------------------------------------------ one-iter [72] 100.0% [80] 22906(3.5%) 22618(3.4%) custom-set-member? ...t/private/set-types.rkt:45:0 ------------------------------------------------------------------------------------------ one-iter [72] 100.0% [81] 1159(0.2%) 873(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 make-sequence [233] 24.7% ------------------------------------------------------------------------------------------ one-iter [72] 0.1% loop [82] 99.9% [82] 290(0.0%) 290(0.0%) loop ...cket/collects/racket/private/hash.rkt:25:8 loop [82] 99.9% ------------------------------------------------------------------------------------------ loop [185] 0.4% substitute-e [79] 38.1% one-iter [72] 61.5% [83] 65614(9.9%) 5492(0.8%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [90] 89.0% hash-has-key? [100] 2.6% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [78] 100.0% [84] 23570(3.6%) 7860(1.2%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [91] 55.6% reverse [221] 4.9% make-sequence [233] 2.5% update-en-expr [226] 2.4% ------------------------------------------------------------------------------------------ pattern-match [70] 1.3% substitute-e [79] 18.4% match-e [76] 79.0% [85] 22008(3.3%) 292(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [97] 98.7% ------------------------------------------------------------------------------------------ list-cartesian-product [86] 19.7% match-e [76] 80.3% [86] 6661(1.0%) 4349(0.7%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [233] 26.1% list-cartesian-product [86] 19.7% reverse [221] 4.3% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [78] 100.0% [87] 2324(0.4%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [92] 62.1% adopt-enode! [93] 37.9% ------------------------------------------------------------------------------------------ match-e [76] 100.0% [88] 2031(0.3%) 1161(0.2%) make-curried ...collects/racket/function.rkt:130:9 make-keyword-procedure [241] 42.8% ------------------------------------------------------------------------------------------ match-e [76] 100.0% [89] 588(0.1%) 292(0.0%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 make-sequence [233] 50.3% ------------------------------------------------------------------------------------------ mk-enode! [83] 100.0% [90] 58386(8.8%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [94] 98.5% make-immutable-set [205] 0.5% ------------------------------------------------------------------------------------------ update-leader! [84] 100.0% [91] 13110(2.0%) 292(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [95] 97.8% ------------------------------------------------------------------------------------------ enode-merge! [87] 100.0% [92] 1444(0.2%) 862(0.1%) custom-set-intersect! ...ivate/set-types.rkt:269:0 reverse [221] 20.2% set-check-compatible [242] 20.1% ------------------------------------------------------------------------------------------ enode-merge! [87] 100.0% [93] 880(0.1%) 289(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 in-set [209] 33.7% custom-set-union [204] 33.4% ------------------------------------------------------------------------------------------ new-enode [90] 100.0% [94] 57520(8.7%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [96] 99.5% f8 [136] 0.5% ------------------------------------------------------------------------------------------ do-hash-update [91] 100.0% [95] 12818(1.9%) 8756(1.3%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [226] 15.9% reverse [221] 11.3% make-sequence [233] 4.5% ------------------------------------------------------------------------------------------ type-of-enode-expr [94] 100.0% [96] 57235(8.7%) 1456(0.2%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [98] 38.5% ??? [99] 25.3% ??? [97] 17.8% dict-ref-contract [149] 14.8% hash-has-key? [100] 1.0% ------------------------------------------------------------------------------------------ setup-prog [45] 0.3% run-improve [28] 0.3% get-setting [63] 0.3% split-table [37] 1.0% substitute-e [79] 3.3% ??? [203] 3.5% choose-best-alt! [41] 9.6% get-sigs [96] 11.3% match-e [76] 20.9% variable? [85] 24.1% finalize-iter! [40] 24.6% [97] 89938(13.6%) 2934(0.4%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [100] 59.0% atab-add-altns [101] 24.9% atab-pick-alt [103] 9.6% ??? [203] 1.6% split-atab [104] 1.0% assoc-has-key? [105] 0.3% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [129] 2.5% get-sigs [96] 37.8% expression-cost [77] 59.7% [98] 58360(8.8%) 10156(1.5%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [106] 67.7% in-set [209] 5.0% return/no-unsupplied [167] 4.0% reverse [221] 2.5% dict-ref-contract [149] 1.5% dict? [227] 0.5% ------------------------------------------------------------------------------------------ expression-cost [77] 5.2% ...row-higher-order.rkt:375:33 [129] 8.7% get-sigs [96] 86.1% [99] 16837(2.5%) 2041(0.3%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [102] 53.5% handle-the-hash [113] 24.1% get/build-late-neg-projection [131] 8.6% ??? [169] 1.7% ------------------------------------------------------------------------------------------ get-sigs [96] 1.0% mk-enode! [83] 3.1% ??? [97] 95.8% [100] 55346(8.4%) 39692(6.0%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [106] 27.2% reverse [221] 1.1% ------------------------------------------------------------------------------------------ ??? [97] 100.0% [101] 22419(3.4%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [107] 100.0% ------------------------------------------------------------------------------------------ ??? [99] 100.0% [102] 9002(1.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [108] 100.0% ------------------------------------------------------------------------------------------ ??? [97] 100.0% [103] 8655(1.3%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [109] 53.3% ...row-higher-order.rkt:375:33 [129] 26.6% write-json* [110] 20.0% ------------------------------------------------------------------------------------------ ??? [97] 100.0% [104] 862(0.1%) 0(0.0%) split-atab ...testing/src/core/alt-table.rkt:105:0 filter [173] 100.0% ------------------------------------------------------------------------------------------ ??? [97] 100.0% [105] 293(0.0%) 0(0.0%) assoc-has-key? ...ts/racket/private/dict.rkt:257:0 assoc [229] 100.0% ------------------------------------------------------------------------------------------ hash-has-key? [100] 27.6% table-ref [98] 72.4% [106] 54576(8.3%) 22098(3.3%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [112] 29.8% handle-the-hash [113] 20.2% successfully-got-the-right-kind-of-function [115] 3.7% ??? [191] 3.2% do-chaperone-procedure [117] 2.1% ??? [169] 0.5% ------------------------------------------------------------------------------------------ atab-add-altns [101] 100.0% [107] 22419(3.4%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [111] 93.6% override-at-pnts [118] 5.2% ------------------------------------------------------------------------------------------ ??? [102] 100.0% [108] 9002(1.4%) 4368(0.7%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [114] 45.1% ??? [119] 6.4% ------------------------------------------------------------------------------------------ atab-pick-alt [103] 100.0% [109] 4616(0.7%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [185] 93.8% loop [73] 6.2% ------------------------------------------------------------------------------------------ atab-pick-alt [103] 100.0% [110] 1733(0.3%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [116] 100.0% ------------------------------------------------------------------------------------------ atab-add-altn [107] 100.0% [111] 20980(3.2%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [120] 100.0% ------------------------------------------------------------------------------------------ ??? [106] 100.0% [112] 16256(2.5%) 9014(1.4%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [122] 16.0% blame-add-missing-party [123] 16.0% ??? [124] 9.0% make-keyword-procedure [241] 1.8% ------------------------------------------------------------------------------------------ ??? [99] 26.9% ??? [106] 73.1% [113] 15077(2.3%) 4082(0.6%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [191] 67.2% ??? [224] 5.7% ------------------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [108] 100.0% [114] 4060(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [121] 92.9% do-blame-add-context [132] 7.1% ------------------------------------------------------------------------------------------ ??? [106] 100.0% [115] 2006(0.3%) 1424(0.2%) successfully-got-the-right-kind-of-function ...5:4 val-has-arrow-collapsible-support? [125] 14.6% arity-checking-wrapper [126] 14.4% ------------------------------------------------------------------------------------------ write-json* [110] 25.0% loop [116] 75.0% [116] 1733(0.3%) 1733(0.3%) loop .../share/racket/collects/json/main.rkt:132:2 loop [116] 75.0% ------------------------------------------------------------------------------------------ ??? [106] 100.0% [117] 1158(0.2%) 876(0.1%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [128] 24.4% ------------------------------------------------------------------------------------------ atab-add-altn [107] 100.0% [118] 1156(0.2%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [120] 100.0% ------------------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [108] 100.0% [119] 574(0.1%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:34 blame-add-context [127] 50.2% do-blame-add-context [132] 49.8% ------------------------------------------------------------------------------------------ override-at-pnts [118] 1.7% composed [231] 4.1% pred [33] 16.2% best-and-tied-at-points [111] 30.1% loop [185] 47.5% [120] 69718(10.5%) 282(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [184] 61.1% eval-prog [130] 36.0% ulp-difference [133] 1.2% ...row-higher-order.rkt:375:33 [129] 0.4% flonums-between [135] 0.4% ------------------------------------------------------------------------------------------ ??? [114] 100.0% [121] 3773(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [131] 69.2% do-blame-add-context [132] 23.0% reverse [221] 7.8% ------------------------------------------------------------------------------------------ ??? [112] 33.2% loop [122] 66.8% [122] 2604(0.4%) 2604(0.4%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [122] 66.8% ------------------------------------------------------------------------------------------ ??? [112] 100.0% [123] 2599(0.4%) 2599(0.4%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------------ ??? [112] 100.0% [124] 1460(0.2%) 1460(0.2%) ??? ...rivate/unconstrained-domain-arrow.rkt:19:10 ------------------------------------------------------------------------------------------ successfully-got-the-right-kind-of-function [115]100.0% [125] 292(0.0%) 292(0.0%) val-has-arrow-collapsible-support? ...le.rkt:116:0 ------------------------------------------------------------------------------------------ successfully-got-the-right-kind-of-function [115]100.0% [126] 290(0.0%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:443:0 matches-arity-exactly? [134] 100.0% ------------------------------------------------------------------------------------------ ??? [119] 100.0% [127] 288(0.0%) 288(0.0%) blame-add-context ...tract/private/blame.rkt:170:0 ------------------------------------------------------------------------------------------ do-chaperone-procedure [117] 100.0% [128] 282(0.0%) 282(0.0%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 ------------------------------------------------------------------------------------------ errors [120] 0.3% loop [7] 0.5% copying-mergesort [30] 0.8% atab-pick-alt [103] 2.0% ??? [49] 3.1% f8 [136] 7.1% loop [137] 26.5% taylor-alt [47] 26.5% loop [185] 33.2% [129] 110828(16.8%) 2317(0.4%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 loop [137] 26.5% approximate [138] 26.5% ->flonum [140] 22.0% real->bigfloat [141] 10.4% ??? [203] 3.7% sample-multi-bounded [143] 2.6% best-alt [144] 2.0% ??? [99] 1.3% table-ref [98] 1.3% dict-ref-contract [149] 1.0% ??? [224] 0.3% ------------------------------------------------------------------------------------------ sort-context-on-expr [11] 0.4% option-on-expr [2] 0.4% sindices->spoints [10] 0.8% errors [120] 36.3% make-exacts* [56] 60.4% [130] 69264(10.5%) 37494(5.7%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [139] 32.5% f8 [136] 11.3% ??? [145] 1.7% ------------------------------------------------------------------------------------------ loop [185] 7.2% ??? [146] 10.7% ??? [99] 17.9% ??? [121] 64.2% [131] 4064(0.6%) 574(0.1%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [142] 64.5% ??? [146] 10.7% unconstrained-domain->-projection [147] 7.2% contract-struct-late-neg-projection [148] 3.5% ------------------------------------------------------------------------------------------ ??? [119] 19.9% ??? [114] 19.9% ??? [121] 60.2% [132] 1440(0.2%) 1440(0.2%) do-blame-add-context ...ct/private/blame.rkt:192:0 ------------------------------------------------------------------------------------------ loop [17] 24.7% errors [120] 75.3% [133] 1148(0.2%) 0(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [167] 50.4% dict-ref-contract [149] 49.6% ------------------------------------------------------------------------------------------ arity-checking-wrapper [126] 100.0% [134] 290(0.0%) 290(0.0%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ------------------------------------------------------------------------------------------ errors [120] 100.0% [135] 289(0.0%) 0(0.0%) flonums-between ...te/flonum/flonum-bits.rkt:103:2 flonum->ordinal [154] 100.0% ------------------------------------------------------------------------------------------ sindices->spoints [10] 0.0% type-of-enode-expr [94] 0.2% hash-ref! [157] 0.9% eval-prog [130] 1.2% simplify [19] 4.0% loop [185] 5.0% split-table [37] 88.6% [136] 136002(20.6%) 6128(0.9%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [185] 94.8% ...row-higher-order.rkt:375:33 [129] 1.2% loop [17] 0.1% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [129] 31.6% loop [137] 68.4% [137] 58763(8.9%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [137] 68.4% ...row-higher-order.rkt:375:33 [129] 31.6% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [129] 100.0% [138] 58763(8.9%) 40722(6.2%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [157] 26.2% taylor [151] 3.5% ??? [150] 1.0% ------------------------------------------------------------------------------------------ expression-cost [77] 27.2% eval-prog [130] 72.8% [139] 30882(4.7%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [157] 100.0% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [129] 100.0% [140] 24490(3.7%) 14134(2.1%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [167] 16.4% dict-ref-contract [149] 14.1% list-member? [193] 5.9% in-set [209] 4.7% ??? [156] 1.2% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [129] 100.0% [141] 11570(1.8%) 3416(0.5%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [234] 65.5% ??? [240] 5.0% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [131] 100.0% [142] 3208(0.5%) 876(0.1%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [152] 54.3% reverse [221] 18.4% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [129] 100.0% [143] 2908(0.4%) 1446(0.2%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [155] 20.0% flonum->ordinal [154] 10.4% make-sequence [233] 10.0% reverse [221] 9.9% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [129] 100.0% [144] 2306(0.3%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [212] 100.0% ------------------------------------------------------------------------------------------ eval-prog [130] 100.0% [145] 1151(0.2%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [153] 100.0% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [131] 100.0% [146] 866(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [131] 100.0% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [131] 100.0% [147] 588(0.1%) 0(0.0%) unconstrained-domain->-projection ...rrow.rkt:60:0 loop [185] 100.0% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [131] 100.0% [148] 282(0.0%) 282(0.0%) contract-struct-late-neg-projection ...p.rkt:121:0 ------------------------------------------------------------------------------------------ flag-set? [68] 1.1% debug [51] 1.1% ulp-difference [133] 2.1% ??? [159] 2.7% table-ref [98] 3.2% ...row-higher-order.rkt:375:33 [129] 4.3% ->flonum [140] 12.9% get-sigs [96] 30.6% expression-cost [77] 41.9% [149] 26692(4.0%) 4615(0.7%) dict-ref-contract ...ract/private/arr-i.rkt:976:19 ??? [158] 61.0% ??? [159] 15.8% ??? [203] 7.5% ------------------------------------------------------------------------------------------ approximate [138] 5.2% ??? [3] 94.8% [150] 11376(1.7%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [157] 100.0% ------------------------------------------------------------------------------------------ composed [6] 10.3% hash-ref! [157] 14.8% loop [185] 20.5% approximate [138] 24.1% taylor [151] 30.3% [151] 2640(0.4%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 loop [185] 30.8% taylor [151] 30.3% debug-print [160] 18.4% taylor-exact [162] 13.3% taylor-invert [8] 5.6% debug [51] 1.6% ------------------------------------------------------------------------------------------ contract-struct-name [161] 24.8% ??? [142] 75.2% [152] 1743(0.3%) 578(0.1%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [161] 58.3% check-list [250] 25.1% ------------------------------------------------------------------------------------------ ??? [145] 100.0% [153] 1151(0.2%) 1151(0.2%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------------------ flonums-between [135] 48.9% sample-multi-bounded [143] 51.1% [154] 590(0.1%) 590(0.1%) flonum->ordinal ...ate/flonum/flonum-bits.rkt:68:0 ------------------------------------------------------------------------------------------ random-exp [155] 50.0% sample-multi-bounded [143] 50.0% [155] 582(0.1%) 582(0.1%) random-exp ...bie/alt-testing/src/common.rkt:253:0 random-exp [155] 50.0% ------------------------------------------------------------------------------------------ ->flonum [140] 100.0% [156] 293(0.0%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 bigfloat->flonum [163] 100.0% ------------------------------------------------------------------------------------------ ??? [5] 0.1% ??? [174] 0.5% simplify* [25] 0.6% cur-debug-level [58] 0.6% localize-error [52] 0.8% ??? [4] 1.4% composed [6] 1.6% ??? [168] 2.3% ??? [166] 2.6% ??? [150] 3.4% approximate [138] 8.7% ??? [3] 13.3% compile [139] 21.8% loop [185] 42.1% [157] 48327(7.3%) 14146(2.1%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [164] 42.7% ??? [3] 17.0% bigfloat-hash [165] 14.0% ??? [166] 2.8% simplify [19] 2.4% f8 [136] 2.4% ??? [168] 2.3% ??? [4] 1.8% ??? [5] 0.6% taylor [151] 0.3% ------------------------------------------------------------------------------------------ ??? [191] 26.8% dict-ref-contract [149] 73.2% [158] 16294(2.5%) 2628(0.4%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [191] 50.0% ??? [203] 26.8% ??? [169] 7.1% ------------------------------------------------------------------------------------------ dict-ref-contract [149] 100.0% [159] 4930(0.7%) 2024(0.3%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 dict-ref-contract [149] 29.4% assoc-ref [170] 17.8% return/no-unsupplied [167] 11.8% ------------------------------------------------------------------------------------------ make-exacts [48] 6.3% loop [55] 6.7% simplify! [36] 13.3% taylor [151] 26.9% simplify [19] 46.8% [160] 4355(0.7%) 3776(0.6%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 write-proc [171] 13.3% ------------------------------------------------------------------------------------------ build-compound-type-name [152] 100.0% [161] 1449(0.2%) 286(0.0%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [152] 59.7% reverse [221] 20.6% ------------------------------------------------------------------------------------------ taylor [151] 100.0% [162] 586(0.1%) 0(0.0%) taylor-exact ...-testing/src/core/taylor.rkt:252:0 loop [185] 100.0% ------------------------------------------------------------------------------------------ ??? [156] 100.0% [163] 293(0.0%) 293(0.0%) bigfloat->flonum ...rivate/bigfloat/mpfr.rkt:480:0 ------------------------------------------------------------------------------------------ hash-ref! [157] 100.0% [164] 27704(4.2%) 585(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [185] 99.4% ------------------------------------------------------------------------------------------ hash-ref! [157] 100.0% [165] 21369(3.2%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [172] 95.9% sig+exp->bigfloat [176] 2.7% bigfloat->sig+exp [180] 1.4% ------------------------------------------------------------------------------------------ hash-ref! [157] 100.0% [166] 10496(1.6%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [157] 94.4% simplify [19] 2.8% ??? [174] 2.8% ------------------------------------------------------------------------------------------ flag-set? [68] 3.6% ??? [189] 3.7% ulp-difference [133] 7.2% ??? [159] 7.2% table-ref [98] 28.7% ->flonum [140] 49.7% [167] 8073(1.2%) 2909(0.4%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [173] 49.7% reverse [221] 14.3% ------------------------------------------------------------------------------------------ hash-ref! [157] 100.0% [168] 6696(1.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [157] 100.0% ------------------------------------------------------------------------------------------ ??? [99] 16.6% ??? [106] 16.7% ??? [158] 66.7% [169] 1734(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [175] 100.0% ------------------------------------------------------------------------------------------ ??? [159] 100.0% [170] 876(0.1%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [229] 100.0% ------------------------------------------------------------------------------------------ debug-print [160] 100.0% [171] 578(0.1%) 578(0.1%) write-proc ...alt-testing/src/alternative.rkt:22:9 ------------------------------------------------------------------------------------------ bigfloat-hash [165] 100.0% [172] 20498(3.1%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [177] 97.2% bfnan? [181] 1.4% bigfloat->sig+exp [180] 1.4% ------------------------------------------------------------------------------------------ loop [67] 3.3% match-e [76] 6.8% split-atab [104] 10.0% one-iter [72] 33.6% return/no-unsupplied [167] 46.3% [173] 8657(1.3%) 7796(1.2%) filter ...t/collects/racket/private/list.rkt:275:2 ??? [179] 10.0% ------------------------------------------------------------------------------------------ ??? [166] 9.2% ??? [4] 90.8% [174] 3182(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [157] 100.0% ------------------------------------------------------------------------------------------ ??? [169] 100.0% [175] 1734(0.3%) 872(0.1%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [178] 49.7% ------------------------------------------------------------------------------------------ bigfloat-hash [165] 100.0% [176] 576(0.1%) 576(0.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:404:0 ------------------------------------------------------------------------------------------ bfcanonicalize [172] 100.0% [177] 19916(3.0%) 19916(3.0%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------------ check-hash/c [175] 100.0% [178] 862(0.1%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [236] 100.0% ------------------------------------------------------------------------------------------ filter [173] 100.0% [179] 862(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:302:4 ??? [182] 100.0% ------------------------------------------------------------------------------------------ bfcanonicalize [172] 49.5% bigfloat-hash [165] 50.5% [180] 585(0.1%) 0(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:389:0 new-mpz [183] 100.0% ------------------------------------------------------------------------------------------ bfcanonicalize [172] 100.0% [181] 292(0.0%) 0(0.0%) bfnan? ...lib/math/private/bigfloat/mpfr.rkt:797:4 ??? [240] 100.0% ------------------------------------------------------------------------------------------ loop [185] 18.0% ??? [179] 27.2% pick-errors [13] 54.8% [182] 3164(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [184] 100.0% ------------------------------------------------------------------------------------------ bigfloat->sig+exp [180] 100.0% [183] 585(0.1%) 585(0.1%) new-mpz ...-lib/math/private/bigfloat/gmp.rkt:73:0 ------------------------------------------------------------------------------------------ generic-sort/key [24] 1.5% ??? [182] 2.8% copying-mergesort [30] 14.6% errors [120] 37.1% loop [185] 43.8% [184] 114694(17.4%) 49764(7.5%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [185] 33.5% bf* [192] 10.2% ??? [224] 4.1% ??? [186] 2.1% ??? [206] 2.1% ??? [187] 2.0% ??? [188] 1.6% ??? [189] 1.0% ------------------------------------------------------------------------------------------ unconstrained-domain->-projection [147] 0.0% set-precompute! [195] 0.0% iterate-egraph! [66] 0.1% get-final-combination [32] 0.1% mk-enode-rec! [75] 0.1% taylor-exact [162] 0.2% loop [55] 0.4% point-best-alt [109] 0.6% option-on-expr [2] 0.7% taylor [151] 0.7% ??? [184] 1.2% loop! [190] 1.7% ??? [164] 3.4% match-e [76] 4.2% f8 [136] 5.6% loop [185] 80.9% [185] 241608(36.6%) 6114(0.9%) loop .../private/map.rkt:40:19 loop [185] 80.9% option-on-expr [2] 3.9% hash-ref! [157] 3.4% step [194] 1.6% loop! [190] 1.6% f8 [136] 1.5% errors [120] 1.3% ...row-higher-order.rkt:375:33 [129] 1.1% foldl [196] 1.1% taylor [151] 0.5% keyword-apply [197] 0.5% ??? [184] 0.4% composed [6] 0.3% simplify [19] 0.2% extract-alt [200] 0.1% mk-enode-rec! [75] 0.1% mk-enode! [83] 0.1% simplify-node [199] 0.1% set-precompute! [195] 0.1% simplify* [25] 0.0% get/build-late-neg-projection [131] 0.0% make-multiplication-node [202] 0.0% loop [7] 0.0% loop [201] 0.0% ??? [198] 0.0% ??? [182] 0.0% bf* [192] 0.0% ------------------------------------------------------------------------------------------ ??? [184] 100.0% [186] 2390(0.4%) 290(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [191] 63.0% ??? [203] 24.9% ------------------------------------------------------------------------------------------ ??? [184] 100.0% [187] 2306(0.3%) 2306(0.3%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------ ??? [184] 100.0% [188] 1812(0.3%) 630(0.1%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [246] 65.2% ------------------------------------------------------------------------------------------ ??? [184] 100.0% [189] 1164(0.2%) 580(0.1%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [167] 25.3% list-member? [193] 24.8% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [78] 15.2% loop [185] 31.2% one-iter [72] 53.6% [190] 48757(7.4%) 8430(1.3%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [204] 33.8% loop [185] 31.8% make-immutable-set [205] 16.8% ??? [211] 6.8% in-set [209] 0.3% ------------------------------------------------------------------------------------------ ??? [186] 5.8% ??? [106] 6.7% handle-the-hash [113] 39.1% ??? [158] 48.3% [191] 25898(3.9%) 7291(1.1%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [158] 33.7% ??? [208] 33.5% ??? [203] 2.4% check-list [250] 1.1% ??? [224] 1.1% ------------------------------------------------------------------------------------------ loop [185] 2.4% ??? [184] 97.6% [192] 12020(1.8%) 681(0.1%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [206] 94.3% ------------------------------------------------------------------------------------------ ??? [189] 3.4% *rules* [62] 3.4% ->flonum [140] 16.9% one-iter [72] 76.3% [193] 8522(1.3%) 582(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 member [210] 93.2% ------------------------------------------------------------------------------------------ loop [185] 100.0% [194] 6084(0.9%) 4652(0.7%) step .../racket/collects/racket/function.rkt:145:9 sort [215] 23.6% ------------------------------------------------------------------------------------------ loop [185] 100.0% [195] 4646(0.7%) 870(0.1%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [185] 56.2% procedure-reduce-arity [218] 12.5% ??? [207] 6.3% compose [219] 6.3% ------------------------------------------------------------------------------------------ loop [185] 100.0% [196] 4324(0.7%) 294(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [213] 59.7% check-fold [214] 33.4% ------------------------------------------------------------------------------------------ loop [185] 100.0% [197] 1755(0.3%) 1168(0.2%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [217] 33.5% ------------------------------------------------------------------------------------------ loop [185] 16.3% *rules* [62] 16.8% err-lsts->split-indices [12] 66.8% [198] 1732(0.3%) 1732(0.3%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------------ loop [185] 49.5% simplify [19] 50.5% [199] 588(0.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 combine-aterms [216] 100.0% ------------------------------------------------------------------------------------------ loop [185] 100.0% [200] 568(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [212] 100.0% ------------------------------------------------------------------------------------------ loop [185] 0.8% loop [201] 99.2% [201] 293(0.0%) 293(0.0%) loop ...bie/alt-testing/src/core/regimes.rkt:176:2 loop [201] 99.2% ------------------------------------------------------------------------------------------ loop [185] 100.0% [202] 286(0.0%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [220] 100.0% ------------------------------------------------------------------------------------------ ??? [186] 3.3% ??? [191] 3.4% ??? [97] 8.2% dict-ref-contract [149] 12.9% ...row-higher-order.rkt:375:33 [129] 23.0% ??? [158] 49.1% [203] 17802(2.7%) 2690(0.4%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [225] 40.9% dict? [227] 21.1% ??? [97] 17.8% ^TYPE? [246] 5.0% ------------------------------------------------------------------------------------------ adopt-enode! [93] 1.7% loop! [190] 98.3% [204] 17369(2.6%) 13904(2.1%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [230] 18.3% check-list [250] 1.7% ------------------------------------------------------------------------------------------ new-enode [90] 1.8% loop! [190] 98.2% [205] 16288(2.5%) 15994(2.4%) make-immutable-set .../private/set-types.rkt:948:0 ------------------------------------------------------------------------------------------ ??? [184] 17.3% bf* [192] 82.7% [206] 13708(2.1%) 290(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [222] 97.9% ------------------------------------------------------------------------------------------ *rules* [62] 2.4% set-precompute! [195] 2.5% match-e [76] 95.1% [207] 11844(1.8%) 579(0.1%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [223] 61.5% do-curry [228] 33.6% ------------------------------------------------------------------------------------------ ??? [191] 100.0% [208] 8678(1.3%) 5215(0.8%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [224] 36.6% check-list [250] 3.3% ------------------------------------------------------------------------------------------ adopt-enode! [93] 3.5% loop! [190] 3.5% one-iter [72] 10.4% ->flonum [140] 13.7% match-e [76] 34.4% table-ref [98] 34.4% [209] 8414(1.3%) 8414(1.3%) in-set ...ollects/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------------ list-member? [193] 100.0% [210] 7941(1.2%) 7941(1.2%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------------ loop! [190] 100.0% [211] 6380(1.0%) 590(0.1%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [226] 59.0% reverse [221] 31.8% ------------------------------------------------------------------------------------------ extract-alt [200] 19.8% best-alt [144] 80.2% [212] 2874(0.4%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [231] 100.0% ------------------------------------------------------------------------------------------ foldl [196] 100.0% [213] 2583(0.4%) 566(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [229] 78.1% ------------------------------------------------------------------------------------------ foldl [196] 100.0% [214] 1446(0.2%) 1446(0.2%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------------ step [194] 100.0% [215] 1433(0.2%) 1433(0.2%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------------------ simplify-node [199] 100.0% [216] 588(0.1%) 588(0.1%) combine-aterms ...esting/src/core/reduce.rkt:183:0 ------------------------------------------------------------------------------------------ keyword-apply [197] 100.0% [217] 588(0.1%) 588(0.1%) loop ...cket/collects/racket/private/kw.rkt:518:13 ------------------------------------------------------------------------------------------ set-precompute! [195] 100.0% [218] 578(0.1%) 288(0.0%) procedure-reduce-arity ...t/private/kw.rkt:1823:11 procedure-keywords [237] 50.3% ------------------------------------------------------------------------------------------ set-precompute! [195] 100.0% [219] 291(0.0%) 291(0.0%) compose ...collects/racket/private/list.rkt:404:12 ------------------------------------------------------------------------------------------ make-multiplication-node [202] 100.0% [220] 286(0.0%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubnode [232] 100.0% ------------------------------------------------------------------------------------------ list-cartesian-product [86] 1.5% sample-multi-bounded [143] 1.6% custom-set-intersect! [92] 1.6% ??? [121] 1.6% contract-struct-name [161] 1.6% hash-has-key? [100] 3.1% loop [67] 3.2% ??? [142] 3.2% update-leader! [84] 6.2% return/no-unsupplied [167] 6.2% ??? [95] 7.8% table-ref [98] 7.9% one-iter [72] 9.4% ??? [211] 10.9% match-e [76] 34.3% [221] 18589(2.8%) 18589(2.8%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------------ ??? [206] 100.0% [222] 13418(2.0%) 6258(0.9%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [234] 44.0% ??? [240] 9.4% ------------------------------------------------------------------------------------------ match-e [76] 44.4% ??? [207] 55.6% [223] 13094(2.0%) 9880(1.5%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [237] 24.5% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [129] 3.1% ??? [191] 3.1% handle-the-hash [113] 9.2% ??? [208] 34.0% ??? [184] 50.7% [224] 9351(1.4%) 2902(0.4%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [235] 59.8% ??? [243] 9.2% ------------------------------------------------------------------------------------------ ??? [203] 100.0% [225] 7286(1.1%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [236] 52.0% coerce-contract/f [238] 48.0% ------------------------------------------------------------------------------------------ update-leader! [84] 9.0% ??? [95] 32.0% ??? [211] 59.1% [226] 6370(1.0%) 3184(0.5%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [233] 36.3% pack-leader [239] 13.7% ------------------------------------------------------------------------------------------ table-ref [98] 7.2% ??? [203] 92.8% [227] 4053(0.6%) 3475(0.5%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [244] 14.3% ------------------------------------------------------------------------------------------ ??? [207] 100.0% [228] 3984(0.6%) 2264(0.3%) do-curry ...cket/collects/racket/function.rkt:71:2 procedure-keywords [237] 29.1% make-keyword-procedure [241] 14.1% ------------------------------------------------------------------------------------------ assoc-has-key? [105] 9.2% assoc-ref [170] 27.5% merge2 [213] 63.3% [229] 3186(0.5%) 3186(0.5%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------------ custom-set-union [204] 100.0% [230] 3176(0.5%) 1728(0.3%) choose-immutable ...et/private/set-types.rkt:151:0 check-list [250] 27.3% set-check-compatible [242] 18.3% ------------------------------------------------------------------------------------------ argmins [212] 100.0% [231] 2874(0.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [120] 100.0% ------------------------------------------------------------------------------------------ make-multiplication-subnode [220] 100.0% [232] 286(0.0%) 0(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 simple-compose [245] 100.0% ------------------------------------------------------------------------------------------ reduce-to-single! [81] 2.0% sample-multi-bounded [143] 2.0% rewriter [57] 2.1% ??? [89] 2.1% merge-egraph-nodes! [78] 4.0% loop [67] 4.0% ??? [95] 4.1% update-leader! [84] 4.1% list-cartesian-product [86] 14.3% update-en-expr [226] 16.3% match-e [76] 44.9% [233] 14178(2.1%) 12150(1.8%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [248] 14.3% ------------------------------------------------------------------------------------------ bfmul [222] 43.8% real->bigfloat [141] 56.2% [234] 13483(2.0%) 13483(2.0%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------------ ??? [224] 100.0% [235] 5589(0.8%) 2090(0.3%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [247] 41.4% ^TYPE? [246] 21.2% ------------------------------------------------------------------------------------------ chaperone-contract? [27] 5.8% flat-contract? [178] 17.5% contract? [225] 76.7% [236] 4936(0.7%) 4936(0.7%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------------ procedure-reduce-arity [218] 6.2% do-curry [228] 24.8% do-procedure-reduce-keyword-arity [223] 68.9% [237] 4664(0.7%) 4664(0.7%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------------ coerce-contract [26] 14.3% contract? [225] 85.7% [238] 4080(0.6%) 2328(0.4%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [249] 42.9% ------------------------------------------------------------------------------------------ loop [67] 8.3% update-en-expr [226] 25.1% match-e [76] 25.1% one-iter [72] 41.5% [239] 3487(0.5%) 3487(0.5%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ------------------------------------------------------------------------------------------ bfnan? [181] 13.8% real->bigfloat [141] 27.1% bfmul [222] 59.1% [240] 2124(0.3%) 2124(0.3%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ------------------------------------------------------------------------------------------ ??? [112] 16.9% do-curry [228] 32.6% make-curried [88] 50.5% [241] 1723(0.3%) 1723(0.3%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------------ custom-set-intersect! [92] 33.3% choose-immutable [230] 66.7% [242] 871(0.1%) 871(0.1%) set-check-compatible ...rivate/set-types.rkt:531:0 ------------------------------------------------------------------------------------------ ??? [224] 100.0% [243] 860(0.1%) 860(0.1%) ??? ...lects/racket/contract/private/orc.rkt:117:8 ------------------------------------------------------------------------------------------ dict? [227] 100.0% [244] 578(0.1%) 578(0.1%) assoc? ...et/collects/racket/private/dict.rkt:13:0 ------------------------------------------------------------------------------------------ make-multiplication-subsubnode [232] 100.0% [245] 286(0.0%) 286(0.0%) simple-compose ...s/racket/private/list.rkt:426:10 ------------------------------------------------------------------------------------------ ??? [203] 27.3% ??? [188] 36.3% ??? [235] 36.4% [246] 3258(0.5%) 3258(0.5%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------------ ??? [235] 100.0% [247] 2314(0.4%) 1448(0.2%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [250] 37.4% ------------------------------------------------------------------------------------------ make-sequence [233] 100.0% [248] 2029(0.3%) 2029(0.3%) :hash-gen ...collects/racket/private/for.rkt:781:4 ------------------------------------------------------------------------------------------ coerce-contract/f [238] 100.0% [249] 1751(0.3%) 1751(0.3%) coerce-simple-value ...ract/private/guts.rkt:385:0 ------------------------------------------------------------------------------------------ err-lsts->split-indices [12] 7.6% ??? [208] 7.7% match-e [76] 7.7% custom-set-union [204] 7.7% ??? [191] 7.8% build-compound-type-name [152] 15.4% ??? [247] 23.1% choose-immutable [230] 23.1% [250] 3758(0.6%) 3758(0.6%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------------