Profiling results ----------------- Total cpu time observed: 737885ms (out of 754083ms) Number of samples taken: 1014 (once every 728ms) (Hiding functions with self<1.0% and local<2.0%: 6 of 162 hidden) ============================================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================================ [1] 737885(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [2] 100.0% -------------------------------------------------------------------------------------------- ??? [1] 100.0% [2] 737885(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [3] 100.0% -------------------------------------------------------------------------------------------- profile-thunk [2] 100.0% [3] 737885(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [4] 100.0% -------------------------------------------------------------------------------------------- ??? [3] 100.0% [4] 737885(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 prepare-points [9] 93.3% run-improve [5] 6.7% -------------------------------------------------------------------------------------------- ??? [4] 100.0% [5] 49302(6.7%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [6] 62.2% get-final-combination [7] 27.4% setup-prog! [8] 10.4% -------------------------------------------------------------------------------------------- run-improve [5] 100.0% [6] 30666(4.2%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [11] 37.6% finalize-iter! [12] 24.1% gen-series! [13] 23.8% choose-best-alt! [14] 7.2% localize! [15] 6.4% gen-rewrites! [16] 0.9% -------------------------------------------------------------------------------------------- run-improve [5] 100.0% [7] 13486(1.8%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [10] 97.9% extract-alt [17] 2.1% -------------------------------------------------------------------------------------------- run-improve [5] 100.0% [8] 5150(0.7%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [9] 100.0% -------------------------------------------------------------------------------------------- setup-prog! [8] 0.7% ??? [4] 99.3% [9] 693732(94.0%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [23] 97.3% make-exacts [18] 2.6% make-exacts* [25] 0.0% -------------------------------------------------------------------------------------------- get-final-combination [7] 100.0% [10] 13206(1.8%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f138 [105] 100.0% -------------------------------------------------------------------------------------------- run-iter! [6] 100.0% [11] 11530(1.6%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [19] 100.0% -------------------------------------------------------------------------------------------- run-iter! [6] 100.0% [12] 7396(1.0%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [67] 100.0% -------------------------------------------------------------------------------------------- run-iter! [6] 100.0% [13] 7288(1.0%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [20] 100.0% -------------------------------------------------------------------------------------------- run-iter! [6] 100.0% [14] 2194(0.3%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [67] 100.0% -------------------------------------------------------------------------------------------- run-iter! [6] 100.0% [15] 1972(0.3%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [21] 100.0% -------------------------------------------------------------------------------------------- run-iter! [6] 100.0% [16] 286(0.0%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [22] 100.0% -------------------------------------------------------------------------------------------- get-final-combination [7] 100.0% [17] 280(0.0%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [86] 100.0% -------------------------------------------------------------------------------------------- prepare-points [9] 100.0% [18] 17832(2.4%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [23] 94.2% make-exacts* [25] 5.8% -------------------------------------------------------------------------------------------- simplify! [11] 100.0% [19] 11530(1.6%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [24] 100.0% -------------------------------------------------------------------------------------------- gen-series! [13] 100.0% [20] 7288(1.0%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [72] 100.0% -------------------------------------------------------------------------------------------- localize! [15] 100.0% [21] 1972(0.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [90] 100.0% -------------------------------------------------------------------------------------------- gen-rewrites! [16] 100.0% [22] 286(0.0%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [26] 100.0% -------------------------------------------------------------------------------------------- make-exacts [18] 2.4% prepare-points [9] 97.6% [23] 692137(93.8%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [34] 100.0% -------------------------------------------------------------------------------------------- ??? [19] 100.0% [24] 11530(1.6%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [27] 97.5% *simplify-rules* [29] 2.5% -------------------------------------------------------------------------------------------- prepare-points [9] 21.6% make-exacts [18] 78.4% [25] 1308(0.2%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [101] 100.0% -------------------------------------------------------------------------------------------- alt-rewrite-rm [22] 33.3% matcher [28] 66.7% [26] 286(0.0%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [28] 66.7% f138 [105] 33.3% -------------------------------------------------------------------------------------------- simplify [24] 100.0% [27] 11246(1.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [30] 92.5% mk-egraph [31] 5.0% loop [33] 2.5% -------------------------------------------------------------------------------------------- matcher [28] 50.0% rewriter [26] 50.0% [28] 286(0.0%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [28] 50.0% rewriter [26] 50.0% -------------------------------------------------------------------------------------------- simplify [24] 100.0% [29] 284(0.0%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [32] 100.0% -------------------------------------------------------------------------------------------- ??? [27] 100.0% [30] 10401(1.4%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [35] 97.3% loop [34] 2.7% -------------------------------------------------------------------------------------------- ??? [27] 100.0% [31] 562(0.1%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [44] 100.0% -------------------------------------------------------------------------------------------- *simplify-rules* [29] 100.0% [32] 284(0.0%) 284(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 -------------------------------------------------------------------------------------------- ??? [27] 100.0% [33] 284(0.0%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [36] 100.0% -------------------------------------------------------------------------------------------- iterate-egraph! [30] 0.0% taylor-exact [89] 0.0% point-best-alt [74] 0.1% mk-enode-rec! [44] 0.1% option-on-expr [37] 0.1% ??? [100] 0.1% loop [23] 0.1% f138 [105] 0.8% loop [34] 98.8% [34] 717056(97.2%) 1916(0.3%) loop .../private/map.rkt:40:19 loop [34] 98.8% f138 [105] 0.5% option-on-expr [37] 0.2% errors [93] 0.1% ??? [100] 0.1% ...row-higher-order.rkt:375:33 [72] 0.1% mk-enode! [41] 0.1% composed [40] 0.0% free-variables [61] 0.0% simplify [94] 0.0% make-multiplication-node [43] 0.0% mk-enode-rec! [44] 0.0% simplify* [42] 0.0% bf* [109] 0.0% ??? [108] 0.0% -------------------------------------------------------------------------------------------- iterate-egraph! [30] 100.0% [35] 10124(1.4%) 534(0.1%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [38] 43.4% custom-set-member? [39] 32.1% filter [131] 8.3% mk-enode! [41] 5.5% set-member? [85] 2.8% ??? [46] 2.7% -------------------------------------------------------------------------------------------- loop [33] 100.0% [36] 284(0.0%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [45] 100.0% -------------------------------------------------------------------------------------------- loop [34] 100.0% [37] 13206(1.8%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [34] 50.0% sort-context-on-expr [47] 39.7% pick-errors [50] 4.2% sindices->spoints [52] 4.1% point->alt [55] 2.1% -------------------------------------------------------------------------------------------- match-e [38] 2.7% one-iter [35] 97.3% [38] 4392(0.6%) 2483(0.3%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 ??? [67] 12.9% make-sequence [51] 12.5% ??? [54] 6.4% custom-in-set [56] 6.3% match-e [38] 2.7% variable? [66] 2.7% -------------------------------------------------------------------------------------------- one-iter [35] 100.0% [39] 3246(0.4%) 2962(0.4%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [53] 8.7% -------------------------------------------------------------------------------------------- loop [34] 100.0% [40] 1681(0.2%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [90] 100.0% -------------------------------------------------------------------------------------------- one-iter [35] 49.8% loop [34] 50.2% [41] 1120(0.2%) 0(0.0%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [48] 100.0% -------------------------------------------------------------------------------------------- simplify [94] 21.9% loop [34] 78.1% [42] 1042(0.1%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [90] 72.5% dict-ref-contract [124] 27.5% -------------------------------------------------------------------------------------------- loop [34] 100.0% [43] 566(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [49] 100.0% -------------------------------------------------------------------------------------------- loop [34] 24.9% mk-egraph [31] 75.1% [44] 562(0.1%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [34] 100.0% -------------------------------------------------------------------------------------------- mk-min [36] 100.0% [45] 284(0.0%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [117] 100.0% -------------------------------------------------------------------------------------------- one-iter [35] 100.0% [46] 274(0.0%) 274(0.0%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 -------------------------------------------------------------------------------------------- option-on-expr [37] 100.0% [47] 5238(0.7%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [57] 94.6% eval-prog [101] 5.4% -------------------------------------------------------------------------------------------- mk-enode! [41] 100.0% [48] 1120(0.2%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [58] 100.0% -------------------------------------------------------------------------------------------- make-multiplication-node [43] 100.0% [49] 566(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubnode [59] 100.0% -------------------------------------------------------------------------------------------- option-on-expr [37] 100.0% [50] 550(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [60] 100.0% -------------------------------------------------------------------------------------------- match-e [38] 100.0% [51] 548(0.1%) 273(0.0%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [63] 50.2% -------------------------------------------------------------------------------------------- option-on-expr [37] 100.0% [52] 541(0.1%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 eval-prog [101] 50.3% free-variables [61] 49.7% -------------------------------------------------------------------------------------------- custom-set-member? [39] 100.0% [53] 284(0.0%) 284(0.0%) set-check-elem ...cket/private/set-types.rkt:329:0 -------------------------------------------------------------------------------------------- match-e [38] 100.0% [54] 280(0.0%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [62] 100.0% -------------------------------------------------------------------------------------------- option-on-expr [37] 100.0% [55] 276(0.0%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [101] 100.0% -------------------------------------------------------------------------------------------- match-e [38] 100.0% [56] 274(0.0%) 274(0.0%) custom-in-set ...acket/private/set-types.rkt:580:0 -------------------------------------------------------------------------------------------- sort-context-on-expr [47] 100.0% [57] 4958(0.7%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [64] 100.0% -------------------------------------------------------------------------------------------- new-enode [48] 100.0% [58] 1120(0.2%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [112] 100.0% -------------------------------------------------------------------------------------------- make-multiplication-subnode [49] 100.0% [59] 566(0.1%) 0(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 mterm->expr [65] 100.0% -------------------------------------------------------------------------------------------- pick-errors [50] 100.0% [60] 550(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ...row-higher-order.rkt:375:33 [72] 50.1% ??? [100] 49.9% -------------------------------------------------------------------------------------------- sindices->spoints [52] 27.0% loop [34] 73.0% [61] 498(0.1%) 0(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 variable? [66] 45.9% f138 [105] 27.0% ??? [67] 27.0% -------------------------------------------------------------------------------------------- ??? [54] 100.0% [62] 280(0.0%) 280(0.0%) do-curry ...cket/collects/racket/function.rkt:71:2 -------------------------------------------------------------------------------------------- make-sequence [51] 100.0% [63] 275(0.0%) 275(0.0%) :hash-gen ...collects/racket/private/for.rkt:781:4 -------------------------------------------------------------------------------------------- ??? [57] 100.0% [64] 4958(0.7%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [68] 88.8% ??? [100] 11.2% -------------------------------------------------------------------------------------------- make-multiplication-subsubnode [59] 100.0% [65] 566(0.1%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 f138 [105] 100.0% -------------------------------------------------------------------------------------------- free-variables [61] 48.7% match-e [38] 51.3% [66] 470(0.1%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [67] 100.0% -------------------------------------------------------------------------------------------- free-variables [61] 2.3% get-sigs [112] 2.4% f138 [105] 2.5% variable? [66] 4.1% match-e [38] 4.9% choose-best-alt! [14] 19.2% finalize-iter! [12] 64.6% [67] 11456(1.6%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [69] 64.6% atab-pick-alt [70] 19.2% hash-has-key? [71] 16.3% -------------------------------------------------------------------------------------------- generic-sort/key [64] 41.6% copying-mergesort [68] 58.4% [68] 4403(0.6%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [68] 58.4% ??? [100] 36.4% ...row-higher-order.rkt:375:33 [72] 5.2% -------------------------------------------------------------------------------------------- ??? [67] 100.0% [69] 7396(1.0%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [73] 100.0% -------------------------------------------------------------------------------------------- ??? [67] 100.0% [70] 2194(0.3%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [74] 61.4% ...row-higher-order.rkt:375:33 [72] 26.1% errors [93] 12.5% -------------------------------------------------------------------------------------------- ??? [67] 100.0% [71] 1866(0.3%) 470(0.1%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [126] 74.8% -------------------------------------------------------------------------------------------- ??? [60] 0.4% copying-mergesort [68] 0.8% atab-pick-alt [70] 0.9% f138 [105] 1.2% loop [77] 5.5% taylor-alt [20] 5.5% loop [34] 84.8% [72] 65970(8.9%) 3006(0.4%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 ->flonum [75] 47.6% real->bigfloat [76] 31.6% loop [77] 5.5% approximate [78] 5.5% ??? [146] 2.7% table-ref [117] 1.2% best-alt [80] 0.9% sample-multi-bounded [81] 0.4% -------------------------------------------------------------------------------------------- atab-add-altns [69] 100.0% [73] 7396(1.0%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [79] 96.3% override-at-pnts [82] 3.7% -------------------------------------------------------------------------------------------- atab-pick-alt [70] 100.0% [74] 1348(0.2%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [34] 100.0% -------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [72] 100.0% [75] 31406(4.3%) 8878(1.2%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 dict-ref-contract [124] 30.7% ??? [83] 23.6% return/no-unsupplied [125] 10.0% set-member? [85] 4.2% ^TYPE? [150] 3.2% -------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [72] 100.0% [76] 20862(2.8%) 10733(1.5%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [128] 48.6% -------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [72] 19.1% loop [77] 80.9% [77] 7288(1.0%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [77] 80.9% ...row-higher-order.rkt:375:33 [72] 19.1% -------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [72] 100.0% [78] 7288(1.0%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [84] 96.9% taylor-exact [89] 3.1% -------------------------------------------------------------------------------------------- atab-add-altn [73] 100.0% [79] 7118(1.0%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [93] 96.2% ??? [88] 3.8% -------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [72] 100.0% [80] 572(0.1%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [86] 100.0% -------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [72] 100.0% [81] 288(0.0%) 0(0.0%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [87] 100.0% -------------------------------------------------------------------------------------------- atab-add-altn [73] 100.0% [82] 277(0.0%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [93] 100.0% -------------------------------------------------------------------------------------------- ->flonum [75] 100.0% [83] 7404(1.0%) 3738(0.5%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 bigfloat->flonum [91] 49.5% -------------------------------------------------------------------------------------------- approximate [78] 100.0% [84] 7060(1.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [90] 100.0% -------------------------------------------------------------------------------------------- one-iter [35] 17.4% ->flonum [75] 82.6% [85] 1614(0.2%) 1614(0.2%) set-member? ...ts/racket/private/generic.rkt:472:9 -------------------------------------------------------------------------------------------- extract-alt [17] 32.9% best-alt [80] 67.1% [86] 853(0.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [92] 100.0% -------------------------------------------------------------------------------------------- sample-multi-bounded [81] 100.0% [87] 288(0.0%) 288(0.0%) random-exp ...bie/alt-testing/src/common.rkt:253:0 -------------------------------------------------------------------------------------------- best-and-tied-at-points [79] 100.0% [88] 272(0.0%) 272(0.0%) ??? ...ket/collects/racket/private/for.rkt:1280:14 -------------------------------------------------------------------------------------------- approximate [78] 100.0% [89] 228(0.0%) 0(0.0%) taylor-exact ...-testing/src/core/taylor.rkt:252:0 loop [34] 100.0% -------------------------------------------------------------------------------------------- simplify* [42] 3.6% ??? [96] 8.3% ??? [97] 8.3% localize-error [21] 10.1% ??? [98] 10.2% composed [40] 11.2% ??? [95] 24.1% ??? [84] 24.1% [90] 9260(1.3%) 526(0.1%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [95] 24.1% simplify [94] 24.1% f138 [105] 21.3% ??? [98] 10.2% ??? [97] 8.3% ??? [96] 8.3% make-evaluator [99] 2.5% -------------------------------------------------------------------------------------------- ??? [83] 100.0% [91] 3666(0.5%) 3666(0.5%) bigfloat->flonum ...rivate/bigfloat/mpfr.rkt:480:0 -------------------------------------------------------------------------------------------- argmins [86] 100.0% [92] 853(0.1%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [93] 100.0% -------------------------------------------------------------------------------------------- atab-pick-alt [70] 1.8% override-at-pnts [82] 1.8% composed [92] 5.5% best-and-tied-at-points [79] 43.8% loop [34] 47.3% [93] 15648(2.1%) 294(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [100] 77.3% eval-prog [101] 15.6% ulp-difference [118] 5.2% -------------------------------------------------------------------------------------------- loop [34] 3.1% hash-ref! [90] 96.9% [94] 7288(1.0%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f138 [105] 89.1% loop [102] 7.8% simplify* [42] 3.1% -------------------------------------------------------------------------------------------- hash-ref! [90] 100.0% [95] 7060(1.0%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [90] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [90] 100.0% [96] 3678(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [90] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [90] 100.0% [97] 3678(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [90] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [90] 100.0% [98] 3068(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:483:23 hash-ref! [90] 100.0% -------------------------------------------------------------------------------------------- hash-ref! [90] 100.0% [99] 228(0.0%) 0(0.0%) make-evaluator ...rc/function-definitions.rkt:51:0 f138 [105] 100.0% -------------------------------------------------------------------------------------------- ??? [60] 0.0% generic-sort/key [64] 0.1% copying-mergesort [68] 0.6% errors [93] 1.8% loop [34] 97.5% [100] 677519(91.8%) 259643(35.2%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [116] 31.5% bffmod [103] 12.8% ??? [104] 5.6% loop [34] 3.9% bf* [109] 3.0% ??? [106] 2.1% ??? [111] 1.0% ??? [107] 0.9% ??? [108] 0.8% -------------------------------------------------------------------------------------------- sindices->spoints [52] 5.9% point->alt [55] 6.0% sort-context-on-expr [47] 6.1% make-exacts* [25] 28.5% errors [93] 53.4% [101] 4582(0.6%) 2757(0.4%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 parse-app [113] 22.4% f138 [105] 17.4% -------------------------------------------------------------------------------------------- simplify [94] 20.0% loop [102] 80.0% [102] 565(0.1%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 loop [102] 80.0% f138 [105] 20.0% -------------------------------------------------------------------------------------------- ??? [100] 100.0% [103] 86793(11.8%) 2935(0.4%) bffmod .../alt-testing/src/syntax/syntax.rkt:332:0 ??? [116] 65.5% bf* [109] 22.4% ??? [111] 8.5% -------------------------------------------------------------------------------------------- ??? [100] 100.0% [104] 38189(5.2%) 2515(0.3%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [110] 93.4% -------------------------------------------------------------------------------------------- free-variables [61] 0.4% mterm->expr [65] 0.5% make-evaluator [99] 1.0% f138 [105] 1.1% rewriter [26] 1.2% eval-prog [101] 1.3% loop [102] 1.6% simplify [94] 7.0% hash-ref! [90] 8.5% loop [34] 22.1% split-table [10] 55.4% [105] 23278(3.2%) 4856(0.7%) f138 .../collects/racket/match/compiler.rkt:548:40 loop [34] 87.9% get-sigs [112] 3.1% ...row-higher-order.rkt:375:33 [72] 1.3% f138 [105] 1.1% loop [114] 0.6% parse-app [113] 0.3% ??? [67] 0.2% -------------------------------------------------------------------------------------------- ??? [100] 100.0% [106] 13988(1.9%) 13988(1.9%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 -------------------------------------------------------------------------------------------- ??? [100] 100.0% [107] 6315(0.9%) 3570(0.5%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [150] 43.5% -------------------------------------------------------------------------------------------- loop [34] 5.3% ??? [100] 94.7% [108] 5515(0.7%) 3860(0.5%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 dict-ref-contract [124] 20.1% return/no-unsupplied [125] 5.0% list-member? [115] 5.0% -------------------------------------------------------------------------------------------- loop [34] 0.7% bffmod [103] 48.6% ??? [100] 50.7% [109] 39980(5.4%) 845(0.1%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [116] 97.9% -------------------------------------------------------------------------------------------- ??? [104] 100.0% [110] 35674(4.8%) 21907(3.0%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ^TYPE? [150] 38.6% -------------------------------------------------------------------------------------------- ??? [100] 48.8% bffmod [103] 51.2% [111] 14382(1.9%) 1424(0.2%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [140] 71.0% ??? [146] 19.1% -------------------------------------------------------------------------------------------- type-of-enode-expr [58] 49.7% f138 [105] 50.3% [112] 2254(0.3%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [117] 50.0% ??? [119] 25.1% ??? [67] 12.4% dict-ref-contract [124] 12.4% -------------------------------------------------------------------------------------------- f138 [105] 20.2% eval-prog [101] 79.8% [113] 1286(0.2%) 1286(0.2%) parse-app ...collects/racket/private/kw.rkt:1207:2 -------------------------------------------------------------------------------------------- f138 [105] 0.4% loop [114] 99.6% [114] 280(0.0%) 0(0.0%) loop .../private/map.rkt:54:19 loop [114] 99.6% ulp-difference [118] 0.4% -------------------------------------------------------------------------------------------- ??? [108] 100.0% [115] 274(0.0%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [120] 100.0% -------------------------------------------------------------------------------------------- bf* [109] 12.6% bffmod [103] 18.4% ??? [100] 69.0% [116] 309505(41.9%) 15626(2.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [121] 67.2% bfcosh [122] 16.6% bffloor [123] 9.5% ^TYPE? [150] 1.6% -------------------------------------------------------------------------------------------- expression-cost [45] 12.8% ...row-higher-order.rkt:375:33 [72] 36.1% get-sigs [112] 51.0% [117] 2210(0.3%) 527(0.1%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [126] 76.2% -------------------------------------------------------------------------------------------- loop [114] 25.6% errors [93] 74.4% [118] 1097(0.1%) 0(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 dict-ref-contract [124] 50.5% return/no-unsupplied [125] 49.5% -------------------------------------------------------------------------------------------- get-sigs [112] 100.0% [119] 566(0.1%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [127] 100.0% -------------------------------------------------------------------------------------------- list-member? [115] 100.0% [120] 274(0.0%) 274(0.0%) member ...collects/racket/private/member.rkt:13:21 -------------------------------------------------------------------------------------------- ??? [116] 100.0% [121] 208132(28.2%) 149706(20.3%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [128] 24.0% ??? [129] 3.0% ??? [130] 1.0% -------------------------------------------------------------------------------------------- ??? [116] 100.0% [122] 51310(7.0%) 18696(2.5%) bfcosh ...lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [128] 61.6% ??? [129] 2.0% -------------------------------------------------------------------------------------------- ??? [116] 100.0% [123] 29336(4.0%) 11768(1.6%) bffloor ...ib/math/private/bigfloat/mpfr.rkt:733:4 new-mpfr [128] 48.8% ??? [130] 6.8% ??? [129] 4.3% -------------------------------------------------------------------------------------------- get-sigs [112] 2.4% simplify* [42] 2.4% ulp-difference [118] 4.7% ??? [108] 9.3% ->flonum [75] 81.2% [124] 11874(1.6%) 10491(1.4%) dict-ref-contract ...ract/private/arr-i.rkt:976:19 ??? [146] 7.0% ??? [138] 2.4% dict-key-contract [139] 2.3% -------------------------------------------------------------------------------------------- ??? [108] 6.9% ulp-difference [118] 13.7% ->flonum [75] 79.3% [125] 3956(0.5%) 1514(0.2%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [131] 43.6% reverse [156] 18.1% -------------------------------------------------------------------------------------------- hash-has-key? [71] 45.3% table-ref [117] 54.7% [126] 3080(0.4%) 1132(0.2%) ??? ...ects/racket/contract/private/list.rkt:814:4 successfully-got-the-right-kind-of-function [133] 17.9% ??? [134] 17.8% do-chaperone-procedure [135] 9.2% arrow-higher-order:lnp [136] 9.2% handle-the-hash [137] 9.1% -------------------------------------------------------------------------------------------- ??? [119] 100.0% [127] 566(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [132] 100.0% -------------------------------------------------------------------------------------------- real->bigfloat [76] 9.5% bffloor [123] 13.5% bfcosh [122] 29.8% bfdiv [121] 47.2% [128] 106080(14.4%) 106080(14.4%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 -------------------------------------------------------------------------------------------- bfcosh [122] 11.8% bffloor [123] 14.7% bfdiv [121] 73.5% [129] 8592(1.2%) 8592(1.2%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 -------------------------------------------------------------------------------------------- bffloor [123] 49.2% bfdiv [121] 50.8% [130] 4063(0.6%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [141] 100.0% -------------------------------------------------------------------------------------------- one-iter [35] 32.8% return/no-unsupplied [125] 67.2% [131] 2566(0.3%) 2566(0.3%) filter ...t/collects/racket/private/list.rkt:275:2 -------------------------------------------------------------------------------------------- ??? [127] 100.0% [132] 566(0.1%) 0(0.0%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [142] 100.0% -------------------------------------------------------------------------------------------- ??? [126] 100.0% [133] 551(0.1%) 551(0.1%) successfully-got-the-right-kind-of-function ...5:4 -------------------------------------------------------------------------------------------- ??? [126] 100.0% [134] 549(0.1%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 blame-add-missing-party [143] 100.0% -------------------------------------------------------------------------------------------- ??? [126] 100.0% [135] 284(0.0%) 0(0.0%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [144] 100.0% -------------------------------------------------------------------------------------------- ??? [126] 100.0% [136] 282(0.0%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ??? [145] 100.0% -------------------------------------------------------------------------------------------- ??? [126] 100.0% [137] 282(0.0%) 282(0.0%) handle-the-hash ...contract/private/hash.rkt:323:0 -------------------------------------------------------------------------------------------- dict-ref-contract [124] 100.0% [138] 280(0.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [140] 100.0% -------------------------------------------------------------------------------------------- dict-ref-contract [124] 100.0% [139] 274(0.0%) 274(0.0%) dict-key-contract ...collects/racket/dict.rkt:71:0 -------------------------------------------------------------------------------------------- ??? [138] 2.7% ??? [111] 97.3% [140] 10492(1.4%) 2342(0.3%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [146] 63.3% check-list [147] 14.4% -------------------------------------------------------------------------------------------- ??? [130] 100.0% [141] 4063(0.6%) 4063(0.6%) assq ...et/collects/racket/private/list.rkt:187:13 -------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [132] 100.0% [142] 566(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [148] 50.8% do-blame-add-context [149] 49.2% -------------------------------------------------------------------------------------------- ??? [134] 100.0% [143] 549(0.1%) 549(0.1%) blame-add-missing-party ...private/blame.rkt:382:0 -------------------------------------------------------------------------------------------- do-chaperone-procedure [135] 100.0% [144] 284(0.0%) 284(0.0%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 -------------------------------------------------------------------------------------------- arrow-higher-order:lnp [136] 100.0% [145] 282(0.0%) 282(0.0%) ??? ...et/contract/private/arity-checking.rkt:19:2 -------------------------------------------------------------------------------------------- dict-ref-contract [124] 6.9% ...row-higher-order.rkt:375:33 [72] 14.6% ??? [111] 22.9% ??? [140] 55.5% [146] 11968(1.6%) 9034(1.2%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ^TYPE? [150] 17.6% dict? [151] 6.9% -------------------------------------------------------------------------------------------- ??? [140] 100.0% [147] 1506(0.2%) 1506(0.2%) check-list ...ollects/racket/private/for.rkt:690:2 -------------------------------------------------------------------------------------------- ??? [142] 100.0% [148] 288(0.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [152] 100.0% -------------------------------------------------------------------------------------------- ??? [142] 100.0% [149] 278(0.0%) 278(0.0%) do-blame-add-context ...ct/private/blame.rkt:192:0 -------------------------------------------------------------------------------------------- ->flonum [75] 4.1% ??? [146] 8.5% ??? [107] 11.1% ??? [116] 20.6% ??? [110] 55.7% [150] 24722(3.4%) 24722(3.4%) ^TYPE? .../ffi/unsafe.rkt:1621:20 -------------------------------------------------------------------------------------------- ??? [146] 100.0% [151] 830(0.1%) 830(0.1%) dict? ...ollects/racket/private/generic.rkt:146:11 -------------------------------------------------------------------------------------------- ??? [148] 100.0% [152] 288(0.0%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [153] 100.0% -------------------------------------------------------------------------------------------- get/build-late-neg-projection [152] 100.0% [153] 288(0.0%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [154] 100.0% -------------------------------------------------------------------------------------------- ??? [153] 100.0% [154] 288(0.0%) 0(0.0%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [155] 100.0% -------------------------------------------------------------------------------------------- build-compound-type-name [154] 100.0% [155] 288(0.0%) 0(0.0%) contract-struct-name ...ract/private/prop.rkt:98:0 reverse [156] 100.0% -------------------------------------------------------------------------------------------- contract-struct-name [155] 28.7% return/no-unsupplied [125] 71.3% [156] 1005(0.1%) 1005(0.1%) reverse ...collects/racket/private/reverse.rkt:6:4 --------------------------------------------------------------------------------------------