Profiling results ----------------- Total cpu time observed: 581766ms (out of 586093ms) Number of samples taken: 695 (once every 837ms) (Hiding functions with self<1.0% and local<2.0%: 6 of 174 hidden) ============================================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================================ [1] 581766(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [4] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [95] 100.0% [2] 2502(0.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [39] 100.0% -------------------------------------------------------------------------------------------- loop [80] 100.0% [3] 276(0.0%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- ??? [1] 100.0% [4] 581766(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [5] 100.0% -------------------------------------------------------------------------------------------- profile-thunk [4] 100.0% [5] 581766(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [6] 100.0% -------------------------------------------------------------------------------------------- ??? [5] 100.0% [6] 581766(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 prepare-points [11] 92.7% run-improve [7] 7.3% -------------------------------------------------------------------------------------------- ??? [6] 100.0% [7] 42512(7.3%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [8] 88.2% get-final-combination [9] 9.6% setup-prog! [10] 2.1% -------------------------------------------------------------------------------------------- run-improve [7] 100.0% [8] 37514(6.4%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [12] 56.9% finalize-iter! [13] 27.0% gen-series! [15] 10.3% gen-rewrites! [16] 2.9% choose-best-alt! [17] 2.2% localize! [18] 0.7% -------------------------------------------------------------------------------------------- run-improve [7] 100.0% [9] 4085(0.7%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [14] 100.0% -------------------------------------------------------------------------------------------- run-improve [7] 100.0% [10] 913(0.2%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [11] 100.0% -------------------------------------------------------------------------------------------- setup-prog! [10] 0.2% ??? [6] 99.8% [11] 540166(92.8%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [24] 99.4% make-exacts [21] 0.6% -------------------------------------------------------------------------------------------- run-iter! [8] 100.0% [12] 21362(3.7%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [19] 100.0% -------------------------------------------------------------------------------------------- run-iter! [8] 100.0% [13] 10122(1.7%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [67] 100.0% -------------------------------------------------------------------------------------------- get-final-combination [9] 100.0% [14] 4085(0.7%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f138 [132] 100.0% -------------------------------------------------------------------------------------------- run-iter! [8] 100.0% [15] 3849(0.7%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [20] 100.0% -------------------------------------------------------------------------------------------- run-iter! [8] 100.0% [16] 1094(0.2%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [22] 100.0% -------------------------------------------------------------------------------------------- run-iter! [8] 100.0% [17] 810(0.1%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [67] 100.0% -------------------------------------------------------------------------------------------- run-iter! [8] 100.0% [18] 276(0.0%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [23] 100.0% -------------------------------------------------------------------------------------------- simplify! [12] 100.0% [19] 21362(3.7%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [26] 100.0% -------------------------------------------------------------------------------------------- gen-series! [15] 100.0% [20] 3849(0.7%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [25] 100.0% -------------------------------------------------------------------------------------------- prepare-points [11] 100.0% [21] 2996(0.5%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [24] 74.2% make-exacts* [28] 25.8% -------------------------------------------------------------------------------------------- gen-rewrites! [16] 100.0% [22] 1094(0.2%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [27] 100.0% -------------------------------------------------------------------------------------------- localize! [18] 100.0% [23] 276(0.0%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- make-exacts [21] 0.4% prepare-points [11] 99.6% [24] 539394(92.7%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [80] 100.0% -------------------------------------------------------------------------------------------- atab-pick-alt [74] 0.3% eval-prog [96] 0.3% copying-mergesort [133] 0.6% errors [86] 0.6% f138 [132] 1.6% loop [32] 2.2% taylor-alt [20] 2.2% loop [80] 92.0% [25] 85900(14.8%) 3815(0.7%) ??? ...tract/private/arrow-higher-order.rkt:375:33 ->flonum [29] 48.9% real->bigfloat [30] 37.8% loop [32] 2.2% approximate [33] 2.2% ??? [156] 1.8% table-ref [82] 0.9% ...sting/src/common.rkt:47:2 [144] 0.3% best-alt [36] 0.3% -------------------------------------------------------------------------------------------- ??? [19] 100.0% [26] 21362(3.7%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [31] 100.0% -------------------------------------------------------------------------------------------- alt-rewrite-rm [22] 37.3% matcher [34] 62.7% [27] 1094(0.2%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [34] 62.7% f138 [132] 28.9% *rules* [35] 8.4% -------------------------------------------------------------------------------------------- make-exacts [21] 100.0% [28] 772(0.1%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [96] 100.0% -------------------------------------------------------------------------------------------- ??? [25] 100.0% [29] 41996(7.2%) 26833(4.6%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [145] 12.2% ??? [38] 12.0% ...sting/src/common.rkt:47:2 [144] 9.1% in-set [89] 2.1% list-member? [116] 0.7% -------------------------------------------------------------------------------------------- ??? [25] 100.0% [30] 32480(5.6%) 7328(1.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [147] 71.6% ??? [148] 3.2% ??? [146] 2.6% -------------------------------------------------------------------------------------------- simplify [26] 100.0% [31] 21362(3.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [37] 89.5% loop [40] 10.5% -------------------------------------------------------------------------------------------- ??? [25] 26.3% loop [32] 73.7% [32] 3849(0.7%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [32] 73.7% ??? [25] 26.3% -------------------------------------------------------------------------------------------- ??? [25] 100.0% [33] 3849(0.7%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [95] 65.0% ??? [39] 20.5% taylor [41] 14.5% -------------------------------------------------------------------------------------------- matcher [34] 50.0% rewriter [27] 50.0% [34] 1094(0.2%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [34] 50.0% rewriter [27] 50.0% -------------------------------------------------------------------------------------------- rewriter [27] 100.0% [35] 275(0.0%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [42] 100.0% -------------------------------------------------------------------------------------------- ??? [25] 100.0% [36] 273(0.0%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [43] 100.0% -------------------------------------------------------------------------------------------- ??? [31] 100.0% [37] 19111(3.3%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [44] 100.0% -------------------------------------------------------------------------------------------- ->flonum [29] 100.0% [38] 5022(0.9%) 3282(0.6%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 bigfloat->flonum [45] 34.7% -------------------------------------------------------------------------------------------- approximate [33] 24.0% ??? [2] 76.0% [39] 3292(0.6%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- ??? [31] 100.0% [40] 2252(0.4%) 283(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [46] 49.9% loop [47] 37.5% -------------------------------------------------------------------------------------------- hash-ref! [95] 8.5% approximate [33] 13.8% taylor [41] 77.7% [41] 841(0.1%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [41] 77.7% normalize-series [48] 8.5% debug-print [129] 8.5% taylor-sqrt [50] 5.4% -------------------------------------------------------------------------------------------- *rules* [35] 100.0% [42] 275(0.0%) 275(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 -------------------------------------------------------------------------------------------- best-alt [36] 100.0% [43] 273(0.0%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [49] 100.0% -------------------------------------------------------------------------------------------- iterate-egraph! [37] 100.0% [44] 19111(3.3%) 836(0.1%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [51] 50.4% mk-enode! [58] 11.7% loop! [90] 10.2% custom-set-member? [53] 8.8% substitute-e [54] 4.4% merge-egraph-nodes! [55] 4.4% reverse [150] 1.5% in-set [89] 1.4% list-member? [116] 1.4% loop [56] 1.4% -------------------------------------------------------------------------------------------- ??? [38] 100.0% [45] 1740(0.3%) 1740(0.3%) bigfloat->flonum ...rivate/bigfloat/mpfr.rkt:480:0 -------------------------------------------------------------------------------------------- loop [40] 100.0% [46] 1124(0.2%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [52] 100.0% -------------------------------------------------------------------------------------------- f138 [132] 24.5% loop [40] 75.5% [47] 1118(0.2%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [52] 75.5% errors-score [57] 24.5% -------------------------------------------------------------------------------------------- taylor [41] 100.0% [48] 284(0.0%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- argmins [43] 100.0% [49] 273(0.0%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [86] 100.0% -------------------------------------------------------------------------------------------- taylor [41] 100.0% [50] 272(0.0%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 simplify [111] 100.0% -------------------------------------------------------------------------------------------- match-e [51] 23.2% one-iter [44] 76.8% [51] 9636(1.7%) 3312(0.6%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [51] 23.2% reverse [150] 8.6% loop [80] 7.1% pack-leader [62] 5.7% ??? [67] 5.7% in-set [89] 5.3% make-sequence [128] 3.0% ??? [64] 3.0% list-cartesian-product [61] 2.9% variable? [60] 2.9% ??? [63] 1.5% -------------------------------------------------------------------------------------------- loop [47] 42.9% mk-min [46] 57.1% [52] 1968(0.3%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [82] 57.0% ...sting/src/common.rkt:47:2 [144] 28.7% compile [65] 14.3% -------------------------------------------------------------------------------------------- one-iter [44] 100.0% [53] 1676(0.3%) 1676(0.3%) custom-set-member? ...t/private/set-types.rkt:45:0 -------------------------------------------------------------------------------------------- one-iter [44] 100.0% [54] 841(0.1%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [58] 100.0% -------------------------------------------------------------------------------------------- one-iter [44] 100.0% [55] 840(0.1%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [59] 100.0% -------------------------------------------------------------------------------------------- one-iter [44] 1.9% loop [56] 98.1% [56] 274(0.0%) 274(0.0%) loop ...cket/collects/racket/private/hash.rkt:25:8 loop [56] 98.1% -------------------------------------------------------------------------------------------- loop [47] 100.0% [57] 274(0.0%) 0(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 partition [66] 100.0% -------------------------------------------------------------------------------------------- substitute-e [54] 27.4% one-iter [44] 72.6% [58] 3071(0.5%) 0(0.0%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [68] 100.0% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [55] 100.0% [59] 840(0.1%) 281(0.0%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [69] 66.5% -------------------------------------------------------------------------------------------- match-e [51] 100.0% [60] 831(0.1%) 277(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [67] 66.7% -------------------------------------------------------------------------------------------- match-e [51] 100.0% [61] 556(0.1%) 556(0.1%) list-cartesian-product ...src/core/ematch.rkt:20:0 -------------------------------------------------------------------------------------------- match-e [51] 100.0% [62] 553(0.1%) 553(0.1%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 -------------------------------------------------------------------------------------------- match-e [51] 100.0% [63] 284(0.0%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [70] 100.0% -------------------------------------------------------------------------------------------- match-e [51] 100.0% [64] 284(0.0%) 0(0.0%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 ??? [67] 100.0% -------------------------------------------------------------------------------------------- expression-cost [52] 100.0% [65] 281(0.0%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- errors-score [57] 100.0% [66] 274(0.0%) 0(0.0%) partition ...racket/collects/racket/list.rkt:556:0 reverse [150] 100.0% -------------------------------------------------------------------------------------------- simplify* [91] 1.8% ??? [156] 1.9% get-sigs [77] 1.9% f138 [132] 2.0% ??? [64] 2.0% variable? [60] 3.9% choose-best-alt! [17] 5.7% match-e [51] 7.6% finalize-iter! [13] 71.2% [67] 14209(2.4%) 284(0.0%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [71] 71.2% hash-has-key? [73] 19.1% atab-pick-alt [74] 5.7% ??? [156] 2.0% -------------------------------------------------------------------------------------------- mk-enode! [58] 100.0% [68] 3071(0.5%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [72] 100.0% -------------------------------------------------------------------------------------------- update-leader! [59] 100.0% [69] 559(0.1%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [75] 100.0% -------------------------------------------------------------------------------------------- ??? [63] 100.0% [70] 284(0.0%) 284(0.0%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 -------------------------------------------------------------------------------------------- ??? [67] 100.0% [71] 10122(1.7%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [76] 100.0% -------------------------------------------------------------------------------------------- new-enode [68] 100.0% [72] 3071(0.5%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [77] 100.0% -------------------------------------------------------------------------------------------- ??? [67] 100.0% [73] 2715(0.5%) 1369(0.2%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [87] 49.6% -------------------------------------------------------------------------------------------- ??? [67] 100.0% [74] 810(0.1%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 write-json* [78] 33.7% ??? [25] 33.7% point-best-alt [79] 32.6% -------------------------------------------------------------------------------------------- do-hash-update [69] 100.0% [75] 559(0.1%) 559(0.1%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 -------------------------------------------------------------------------------------------- atab-add-altns [71] 100.0% [76] 10122(1.7%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [81] 97.3% override-at-pnts [85] 2.7% -------------------------------------------------------------------------------------------- f138 [132] 26.5% type-of-enode-expr [72] 73.5% [77] 4176(0.7%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [82] 40.0% ...sting/src/common.rkt:47:2 [144] 26.9% ??? [83] 26.5% ??? [67] 6.6% -------------------------------------------------------------------------------------------- atab-pick-alt [74] 100.0% [78] 274(0.0%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [84] 100.0% -------------------------------------------------------------------------------------------- atab-pick-alt [74] 100.0% [79] 264(0.0%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [80] 100.0% -------------------------------------------------------------------------------------------- option-on-expr [88] 0.0% loop! [90] 0.0% point-best-alt [79] 0.0% ??? [120] 0.1% match-e [51] 0.1% loop [24] 0.1% ??? [135] 0.2% f138 [132] 0.7% loop [80] 98.9% [80] 551155(94.7%) 1407(0.2%) loop .../private/map.rkt:40:19 loop [80] 98.9% f138 [132] 0.5% ??? [25] 0.2% option-on-expr [88] 0.1% ??? [135] 0.1% simplify* [91] 0.1% errors [86] 0.1% hash-ref! [95] 0.1% foldl [93] 0.0% loop! [90] 0.0% loop [94] 0.0% composed [3] 0.0% ??? [138] 0.0% -------------------------------------------------------------------------------------------- atab-add-altn [76] 100.0% [81] 9848(1.7%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [86] 100.0% -------------------------------------------------------------------------------------------- ??? [25] 22.6% expression-cost [52] 31.1% get-sigs [77] 46.3% [82] 3610(0.6%) 283(0.0%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [87] 68.9% return/no-unsupplied [145] 7.8% ...sting/src/common.rkt:47:2 [144] 7.8% in-set [89] 7.6% -------------------------------------------------------------------------------------------- get-sigs [77] 100.0% [83] 1108(0.2%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [92] 74.3% handle-the-hash [98] 25.7% -------------------------------------------------------------------------------------------- write-json* [78] 25.0% loop [84] 75.0% [84] 274(0.0%) 274(0.0%) loop .../share/racket/collects/json/main.rkt:132:2 loop [84] 75.0% -------------------------------------------------------------------------------------------- atab-add-altn [76] 100.0% [85] 273(0.0%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [86] 100.0% -------------------------------------------------------------------------------------------- override-at-pnts [85] 2.5% composed [49] 2.5% loop [80] 4.9% best-and-tied-at-points [81] 90.1% [86] 10936(1.9%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [135] 67.5% eval-prog [96] 22.5% ulp-difference [103] 5.0% ??? [25] 5.0% -------------------------------------------------------------------------------------------- hash-has-key? [73] 35.1% table-ref [82] 64.9% [87] 3834(0.7%) 1102(0.2%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [99] 29.3% handle-the-hash [98] 28.4% do-chaperone-procedure [108] 7.2% successfully-got-the-right-kind-of-function [110] 6.5% -------------------------------------------------------------------------------------------- loop [80] 100.0% [88] 3811(0.7%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [97] 64.1% loop [80] 21.5% pick-errors [106] 7.2% err-lsts->split-indices [109] 7.2% -------------------------------------------------------------------------------------------- one-iter [44] 14.1% table-ref [82] 14.1% match-e [51] 26.0% ->flonum [29] 45.9% [89] 1956(0.3%) 1956(0.3%) in-set ...ollects/racket/private/generic.rkt:472:9 -------------------------------------------------------------------------------------------- loop [80] 35.8% one-iter [44] 64.2% [90] 1950(0.3%) 276(0.0%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 loop [80] 35.8% custom-set-union [101] 21.5% ??? [102] 14.2% update-custom-set-table [104] 7.3% make-immutable-set [105] 7.1% -------------------------------------------------------------------------------------------- loop [80] 100.0% [91] 1328(0.2%) 554(0.1%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 ...sting/src/common.rkt:47:2 [144] 21.2% ??? [67] 19.4% hash-ref! [95] 17.7% -------------------------------------------------------------------------------------------- ??? [83] 100.0% [92] 822(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [100] 100.0% -------------------------------------------------------------------------------------------- loop [80] 100.0% [93] 276(0.0%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 check-fold [107] 100.0% -------------------------------------------------------------------------------------------- loop [80] 6.7% loop [94] 93.3% [94] 274(0.0%) 274(0.0%) loop ...bie/alt-testing/src/core/regimes.rkt:176:2 loop [94] 93.3% -------------------------------------------------------------------------------------------- compile [65] 1.5% normalize-series [48] 1.5% simplify* [91] 1.5% ??? [119] 2.2% localize-error [23] 2.4% ??? [117] 2.9% composed [3] 4.8% loop [80] 5.8% ??? [114] 9.1% ??? [115] 9.1% approximate [33] 14.4% ??? [112] 21.7% ??? [39] 23.1% [95] 3850(0.7%) 516(0.1%) hash-ref! .../racket/private/more-scheme.rkt:377:2 simplify [111] 23.1% ??? [112] 21.7% ??? [2] 14.4% ??? [115] 9.1% ??? [114] 9.1% f138 [132] 7.2% ??? [120] 5.8% ??? [117] 2.9% ??? [119] 2.2% taylor [41] 1.5% -------------------------------------------------------------------------------------------- make-exacts* [28] 23.9% errors [86] 76.1% [96] 3229(0.6%) 1599(0.3%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f138 [132] 42.0% ??? [25] 8.5% -------------------------------------------------------------------------------------------- option-on-expr [88] 100.0% [97] 2444(0.4%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [113] 100.0% -------------------------------------------------------------------------------------------- ??? [83] 20.8% ??? [87] 79.2% [98] 1373(0.2%) 0(0.0%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [154] 79.2% ??? [159] 20.8% -------------------------------------------------------------------------------------------- ??? [87] 100.0% [99] 1122(0.2%) 280(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [118] 50.0% make-keyword-procedure [121] 25.0% -------------------------------------------------------------------------------------------- ??? [92] 100.0% [100] 822(0.1%) 560(0.1%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [125] 31.9% -------------------------------------------------------------------------------------------- loop! [90] 100.0% [101] 561(0.1%) 561(0.1%) custom-set-union ...et/private/set-types.rkt:168:0 -------------------------------------------------------------------------------------------- loop! [90] 100.0% [102] 554(0.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 reverse [150] 50.0% update-en-expr [122] 50.0% -------------------------------------------------------------------------------------------- errors [86] 100.0% [103] 552(0.1%) 280(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 list-member? [116] 49.3% -------------------------------------------------------------------------------------------- loop! [90] 100.0% [104] 283(0.0%) 283(0.0%) update-custom-set-table ...ate/set-types.rkt:339:0 -------------------------------------------------------------------------------------------- loop! [90] 100.0% [105] 278(0.0%) 278(0.0%) make-immutable-set .../private/set-types.rkt:948:0 -------------------------------------------------------------------------------------------- option-on-expr [88] 100.0% [106] 276(0.0%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [123] 100.0% -------------------------------------------------------------------------------------------- foldl [93] 100.0% [107] 276(0.0%) 276(0.0%) check-fold ...llects/racket/private/list.rkt:223:2 -------------------------------------------------------------------------------------------- ??? [87] 100.0% [108] 275(0.0%) 0(0.0%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 chaperone-arity-match-checking [124] 100.0% -------------------------------------------------------------------------------------------- option-on-expr [88] 100.0% [109] 274(0.0%) 274(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 -------------------------------------------------------------------------------------------- ??? [87] 100.0% [110] 248(0.0%) 248(0.0%) successfully-got-the-right-kind-of-function ...5:4 -------------------------------------------------------------------------------------------- taylor-sqrt [50] 7.6% hash-ref! [95] 92.4% [111] 3564(0.6%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f138 [132] 76.5% loop [127] 15.9% debug-print [129] 7.6% -------------------------------------------------------------------------------------------- hash-ref! [95] 100.0% [112] 3008(0.5%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- sort-context-on-expr [97] 100.0% [113] 2444(0.4%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [126] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [95] 100.0% [114] 1610(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [95] 100.0% [115] 1396(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- ulp-difference [103] 32.9% one-iter [44] 33.2% ->flonum [29] 33.8% [116] 826(0.1%) 272(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [130] 67.1% -------------------------------------------------------------------------------------------- hash-ref! [95] 100.0% [117] 563(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- ??? [99] 22.5% loop [118] 77.5% [118] 562(0.1%) 562(0.1%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [118] 77.5% -------------------------------------------------------------------------------------------- hash-ref! [95] 100.0% [119] 548(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:408:23 hash-ref! [95] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [95] 100.0% [120] 281(0.0%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [80] 100.0% -------------------------------------------------------------------------------------------- ??? [99] 100.0% [121] 280(0.0%) 280(0.0%) make-keyword-procedure ...ket/private/kw.rkt:448:4 -------------------------------------------------------------------------------------------- ??? [102] 100.0% [122] 276(0.0%) 0(0.0%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [128] 100.0% -------------------------------------------------------------------------------------------- pick-errors [106] 100.0% [123] 276(0.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [135] 100.0% -------------------------------------------------------------------------------------------- do-chaperone-procedure [108] 100.0% [124] 275(0.0%) 275(0.0%) chaperone-arity-match-checking ...te/kw.rkt:2186:2 -------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [100] 100.0% [125] 262(0.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [131] 100.0% -------------------------------------------------------------------------------------------- ??? [113] 100.0% [126] 2444(0.4%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [133] 100.0% -------------------------------------------------------------------------------------------- simplify [111] 25.0% loop [127] 75.0% [127] 568(0.1%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 loop [127] 75.0% f138 [132] 25.0% -------------------------------------------------------------------------------------------- update-en-expr [122] 49.2% match-e [51] 50.8% [128] 562(0.1%) 562(0.1%) make-sequence ...ects/racket/private/for.rkt:557:2 -------------------------------------------------------------------------------------------- simplify [111] 48.6% taylor [41] 51.4% [129] 554(0.1%) 554(0.1%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 -------------------------------------------------------------------------------------------- list-member? [116] 100.0% [130] 554(0.1%) 554(0.1%) member ...collects/racket/private/member.rkt:13:21 -------------------------------------------------------------------------------------------- ??? [125] 100.0% [131] 262(0.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [134] 100.0% -------------------------------------------------------------------------------------------- expression->type [136] 0.7% hash-ref! [95] 2.8% eval-prog [96] 2.9% loop [127] 3.6% f138 [132] 4.6% rewriter [27] 5.1% simplify [111] 10.1% loop [80] 28.6% split-table [14] 41.6% [132] 9831(1.7%) 1399(0.2%) f138 .../collects/racket/match/compiler.rkt:548:40 loop [80] 74.5% get-sigs [77] 8.0% f138 [132] 4.6% ??? [25] 2.9% loop [47] 2.8% expression->type [136] 0.7% ??? [67] 0.7% -------------------------------------------------------------------------------------------- generic-sort/key [126] 41.3% copying-mergesort [133] 58.7% [133] 2444(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [133] 58.7% ??? [135] 36.8% ??? [25] 4.4% -------------------------------------------------------------------------------------------- ??? [131] 100.0% [134] 262(0.0%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [137] 100.0% -------------------------------------------------------------------------------------------- ??? [123] 0.1% copying-mergesort [133] 0.4% errors [86] 1.4% loop [80] 98.1% [135] 509004(87.5%) 230342(39.6%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [138] 39.6% loop [80] 8.8% ??? [159] 3.3% ??? [139] 0.9% ??? [140] 0.5% ??? [141] 0.4% -------------------------------------------------------------------------------------------- expression->type [136] 50.0% f138 [132] 50.0% [136] 282(0.0%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 expression->type [136] 50.0% f138 [132] 50.0% -------------------------------------------------------------------------------------------- get/build-late-neg-projection [134] 100.0% [137] 262(0.0%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 reverse [150] 100.0% -------------------------------------------------------------------------------------------- loop [80] 0.1% ??? [135] 99.9% [138] 201857(34.7%) 2480(0.4%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfexpt [142] 75.3% bfsqrt [143] 23.5% -------------------------------------------------------------------------------------------- ??? [135] 100.0% [139] 4564(0.8%) 3830(0.7%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [165] 16.1% -------------------------------------------------------------------------------------------- ??? [135] 100.0% [140] 2754(0.5%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [154] 100.0% -------------------------------------------------------------------------------------------- ??? [135] 100.0% [141] 2185(0.4%) 1369(0.2%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [145] 24.9% ...sting/src/common.rkt:47:2 [144] 12.4% -------------------------------------------------------------------------------------------- ??? [138] 100.0% [142] 151964(26.1%) 19846(3.4%) bfexpt ...lib/math/private/bigfloat/mpfr.rkt:846:4 ??? [146] 62.8% new-mpfr [147] 21.4% ??? [148] 2.7% -------------------------------------------------------------------------------------------- ??? [138] 100.0% [143] 47413(8.1%) 16778(2.9%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [147] 41.0% ??? [148] 20.7% ??? [146] 2.9% -------------------------------------------------------------------------------------------- ??? [152] 2.1% ??? [141] 4.1% ??? [25] 4.1% table-ref [82] 4.2% simplify* [91] 4.2% expression-cost [52] 6.4% get-sigs [77] 17.0% ->flonum [29] 57.8% [144] 6615(1.1%) 4308(0.7%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [151] 25.4% ??? [156] 9.5% ??? [152] 2.1% -------------------------------------------------------------------------------------------- table-ref [82] 4.7% ??? [141] 9.1% ->flonum [29] 86.1% [145] 5968(1.0%) 1723(0.3%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [149] 55.9% reverse [150] 15.2% -------------------------------------------------------------------------------------------- real->bigfloat [30] 0.9% bfsqrt [143] 1.4% bfexpt [142] 97.7% [146] 97702(16.8%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [153] 100.0% -------------------------------------------------------------------------------------------- bfsqrt [143] 25.9% real->bigfloat [30] 30.9% bfexpt [142] 43.2% [147] 75185(12.9%) 75185(12.9%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 -------------------------------------------------------------------------------------------- real->bigfloat [30] 7.0% bfexpt [142] 27.5% bfsqrt [143] 65.5% [148] 15016(2.6%) 15016(2.6%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 -------------------------------------------------------------------------------------------- return/no-unsupplied [145] 100.0% [149] 3335(0.6%) 3335(0.6%) filter ...t/collects/racket/private/list.rkt:275:2 -------------------------------------------------------------------------------------------- ??? [137] 9.2% partition [66] 9.7% ??? [102] 9.8% one-iter [44] 9.8% match-e [51] 29.4% return/no-unsupplied [145] 32.1% [150] 2834(0.5%) 2834(0.5%) reverse ...collects/racket/private/reverse.rkt:6:4 -------------------------------------------------------------------------------------------- ??? [154] 16.3% ...sting/src/common.rkt:47:2 [144] 83.7% [151] 1680(0.3%) 274(0.0%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [154] 66.7% ??? [155] 16.9% ??? [156] 8.2% -------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [144] 100.0% [152] 280(0.0%) 0(0.0%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 ...sting/src/common.rkt:47:2 [144] 100.0% -------------------------------------------------------------------------------------------- ??? [146] 100.0% [153] 97702(16.8%) 97702(16.8%) assq ...et/collects/racket/private/list.rkt:187:13 -------------------------------------------------------------------------------------------- handle-the-hash [98] 20.8% ??? [151] 26.6% ??? [140] 52.6% [154] 5238(0.9%) 2434(0.4%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [156] 18.3% ??? [157] 15.5% ??? [151] 10.5% check-list [168] 9.3% -------------------------------------------------------------------------------------------- ??? [151] 100.0% [155] 284(0.0%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [158] 100.0% -------------------------------------------------------------------------------------------- ??? [151] 7.5% ??? [67] 7.5% ...sting/src/common.rkt:47:2 [144] 17.0% ??? [154] 25.9% ??? [25] 42.2% [156] 3696(0.6%) 1849(0.3%) ??? ...ects/racket/contract/private/guts.rkt:794:8 dict? [160] 24.5% ^TYPE? [165] 10.8% contract? [161] 7.5% ??? [67] 7.2% -------------------------------------------------------------------------------------------- ??? [154] 100.0% [157] 812(0.1%) 274(0.0%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [159] 66.3% -------------------------------------------------------------------------------------------- ??? [155] 100.0% [158] 284(0.0%) 284(0.0%) check-hash/c ...ket/contract/private/hash.rkt:86:0 -------------------------------------------------------------------------------------------- handle-the-hash [98] 1.6% ??? [157] 3.1% ??? [135] 95.3% [159] 17542(3.0%) 2399(0.4%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [162] 84.7% ??? [163] 1.6% -------------------------------------------------------------------------------------------- ??? [156] 100.0% [160] 906(0.2%) 906(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 -------------------------------------------------------------------------------------------- ??? [156] 100.0% [161] 276(0.0%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [164] 100.0% -------------------------------------------------------------------------------------------- ??? [159] 100.0% [162] 14858(2.6%) 9316(1.6%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ^TYPE? [165] 33.7% ??? [166] 3.6% -------------------------------------------------------------------------------------------- ??? [159] 100.0% [163] 285(0.0%) 0(0.0%) ??? ...lects/racket/contract/private/orc.rkt:117:8 eqables-pred [167] 100.0% -------------------------------------------------------------------------------------------- contract? [161] 100.0% [164] 276(0.0%) 276(0.0%) simple-flat-contract? ...ct/private/guts.rkt:141:0 -------------------------------------------------------------------------------------------- ??? [156] 6.5% ??? [139] 12.0% ??? [162] 81.5% [165] 6137(1.1%) 6137(1.1%) ^TYPE? .../ffi/unsafe.rkt:1621:20 -------------------------------------------------------------------------------------------- ??? [162] 100.0% [166] 538(0.1%) 271(0.0%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [168] 49.6% -------------------------------------------------------------------------------------------- ??? [163] 100.0% [167] 285(0.0%) 285(0.0%) eqables-pred ...et/contract/private/orc.rkt:100:10 -------------------------------------------------------------------------------------------- ??? [166] 35.4% ??? [154] 64.6% [168] 754(0.1%) 754(0.1%) check-list ...ollects/racket/private/for.rkt:690:2 --------------------------------------------------------------------------------------------