Profiling results ----------------- Total cpu time observed: 134734ms (out of 135236ms) Number of samples taken: 456 (once every 295ms) (Hiding functions with self<1.0% and local<2.0%: 9 of 182 hidden) =========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================================== [1] 134734(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [5] 100.0% ------------------------------------------------------------------------------------------- loop [166] 100.0% [2] 13174(9.8%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [166] 56.6% sort-context-on-expr [6] 32.6% pick-errors [7] 8.7% err-lsts->split-indices [9] 2.2% ------------------------------------------------------------------------------------------- hash-ref! [150] 100.0% [3] 888(0.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 hash-ref! [150] 88.7% simplify [160] 11.3% ------------------------------------------------------------------------------------------- loop [166] 100.0% [4] 296(0.2%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [8] 100.0% ------------------------------------------------------------------------------------------- ??? [1] 100.0% [5] 134734(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [10] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [6] 4294(3.2%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [11] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [7] 1144(0.8%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [12] 100.0% ------------------------------------------------------------------------------------------- make-multiplication-node [4] 100.0% [8] 296(0.2%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubnode [13] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [9] 284(0.2%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [14] 100.0% ------------------------------------------------------------------------------------------- profile-thunk [5] 100.0% [10] 134734(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [15] 100.0% ------------------------------------------------------------------------------------------- sort-context-on-expr [6] 100.0% [11] 4294(3.2%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [16] 100.0% ------------------------------------------------------------------------------------------- loop [166] 33.3% pick-errors [7] 66.7% [12] 1714(1.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [109] 100.0% ------------------------------------------------------------------------------------------- make-multiplication-subnode [8] 100.0% [13] 296(0.2%) 0(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 mterm->expr [17] 100.0% ------------------------------------------------------------------------------------------- err-lsts->split-indices [9] 100.0% [14] 284(0.2%) 284(0.2%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------------- ??? [10] 100.0% [15] 134734(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [18] 92.7% prepare-points [26] 7.3% ------------------------------------------------------------------------------------------- ??? [11] 100.0% [16] 4294(3.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [19] 80.1% ??? [109] 19.9% ------------------------------------------------------------------------------------------- make-multiplication-subsubnode [13] 100.0% [17] 296(0.2%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 f53 [162] 100.0% ------------------------------------------------------------------------------------------- ??? [15] 100.0% [18] 124858(92.7%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [20] 89.0% get-final-combination [21] 10.8% setup-prog! [22] 0.2% ------------------------------------------------------------------------------------------- generic-sort/key [16] 32.4% copying-mergesort [19] 67.6% [19] 3440(2.6%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [19] 67.6% ??? [109] 22.4% ??? [110] 10.0% ------------------------------------------------------------------------------------------- run-improve [18] 100.0% [20] 111101(82.5%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [23] 77.4% gen-series! [24] 12.7% finalize-iter! [27] 6.8% choose-best-alt! [28] 2.4% gen-rewrites! [29] 0.5% localize! [31] 0.3% ------------------------------------------------------------------------------------------- run-improve [18] 100.0% [21] 13462(10.0%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [25] 97.9% extract-alt [30] 2.1% ------------------------------------------------------------------------------------------- run-improve [18] 100.0% [22] 295(0.2%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [26] 100.0% ------------------------------------------------------------------------------------------- run-iter! [20] 100.0% [23] 86038(63.9%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [32] 100.0% ------------------------------------------------------------------------------------------- run-iter! [20] 100.0% [24] 14077(10.4%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [33] 100.0% ------------------------------------------------------------------------------------------- get-final-combination [21] 100.0% [25] 13174(9.8%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f53 [162] 100.0% ------------------------------------------------------------------------------------------- setup-prog! [22] 2.9% ??? [15] 97.1% [26] 10172(7.5%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [39] 59.5% make-exacts [34] 37.6% ??? [36] 2.9% ------------------------------------------------------------------------------------------- run-iter! [20] 100.0% [27] 7506(5.6%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [81] 100.0% ------------------------------------------------------------------------------------------- run-iter! [20] 100.0% [28] 2617(1.9%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [81] 100.0% ------------------------------------------------------------------------------------------- run-iter! [20] 100.0% [29] 574(0.4%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [35] 100.0% ------------------------------------------------------------------------------------------- get-final-combination [21] 100.0% [30] 288(0.2%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [132] 100.0% ------------------------------------------------------------------------------------------- run-iter! [20] 100.0% [31] 288(0.2%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [37] 100.0% ------------------------------------------------------------------------------------------- simplify! [23] 100.0% [32] 86038(63.9%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [38] 100.0% ------------------------------------------------------------------------------------------- gen-series! [24] 100.0% [33] 14077(10.4%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [110] 100.0% ------------------------------------------------------------------------------------------- prepare-points [26] 100.0% [34] 3828(2.8%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [39] 100.0% ------------------------------------------------------------------------------------------- gen-rewrites! [29] 100.0% [35] 574(0.4%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [40] 100.0% ------------------------------------------------------------------------------------------- prepare-points [26] 100.0% [36] 294(0.2%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [110] 100.0% ------------------------------------------------------------------------------------------- localize! [31] 100.0% [37] 288(0.2%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------- ??? [32] 100.0% [38] 86038(63.9%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [41] 100.0% ------------------------------------------------------------------------------------------- make-exacts [34] 38.8% prepare-points [26] 61.2% [39] 9878(7.3%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [166] 100.0% ------------------------------------------------------------------------------------------- matcher [42] 50.0% alt-rewrite-rm [35] 50.0% [40] 574(0.4%) 287(0.2%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [42] 50.0% *rules* [43] 25.0% ------------------------------------------------------------------------------------------- simplify [38] 100.0% [41] 86038(63.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [44] 95.7% loop [45] 3.7% mk-egraph [46] 0.7% ------------------------------------------------------------------------------------------- matcher [42] 50.0% rewriter [40] 50.0% [42] 574(0.4%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [42] 50.0% rewriter [40] 50.0% ------------------------------------------------------------------------------------------- rewriter [40] 100.0% [43] 287(0.2%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [47] 100.0% ------------------------------------------------------------------------------------------- ??? [41] 100.0% [44] 82298(61.1%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [48] 100.0% ------------------------------------------------------------------------------------------- ??? [41] 100.0% [45] 3164(2.3%) 572(0.4%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [49] 54.9% loop [50] 27.0% ------------------------------------------------------------------------------------------- ??? [41] 100.0% [46] 576(0.4%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [51] 100.0% ------------------------------------------------------------------------------------------- *rules* [43] 100.0% [47] 287(0.2%) 0(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 dict-ref-contract [129] 100.0% ------------------------------------------------------------------------------------------- iterate-egraph! [44] 100.0% [48] 82298(61.1%) 1443(1.1%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [52] 31.9% merge-egraph-nodes! [53] 24.1% loop! [57] 14.5% mk-enode! [58] 10.2% list-member? [127] 6.0% substitute-e [54] 4.9% custom-set-member? [55] 4.9% set-member? [128] 1.1% filter [139] 0.4% update-leader! [59] 0.4% ------------------------------------------------------------------------------------------- loop [45] 100.0% [49] 1738(1.3%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [56] 100.0% ------------------------------------------------------------------------------------------- loop [45] 100.0% [50] 854(0.6%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [56] 100.0% ------------------------------------------------------------------------------------------- mk-egraph [46] 33.3% loop [166] 66.7% [51] 576(0.4%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [166] 100.0% ------------------------------------------------------------------------------------------- match-e [52] 33.3% one-iter [48] 66.7% [52] 26252(19.5%) 6385(4.7%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [52] 33.3% loop [166] 8.5% ??? [61] 7.2% ??? [81] 6.3% variable? [60] 6.3% list-cartesian-product [62] 5.5% do-procedure-reduce-keyword-arity [68] 3.3% reverse [146] 3.3% make-sequence [84] 2.2% set-member? [128] 2.2% filter [139] 1.7% check-list [167] 0.5% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [53] 17.4% one-iter [48] 82.6% [53] 19834(14.7%) 292(0.2%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [59] 52.4% loop! [57] 22.8% merge-egraph-nodes! [53] 17.4% enode-merge! [63] 4.4% make-sequence [84] 1.5% ------------------------------------------------------------------------------------------- substitute-e [54] 8.4% one-iter [48] 91.6% [54] 4062(3.0%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [58] 85.5% substitute-e [54] 8.4% variable? [60] 3.6% ??? [81] 2.4% ------------------------------------------------------------------------------------------- one-iter [48] 100.0% [55] 4040(3.0%) 4040(3.0%) custom-set-member? ...t/private/set-types.rkt:45:0 ------------------------------------------------------------------------------------------- loop [50] 33.0% mk-min [49] 67.0% [56] 2593(1.9%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [82] 77.7% dict-ref-contract [129] 11.2% compile [122] 11.1% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [53] 24.4% loop [166] 26.2% one-iter [48] 49.5% [57] 18672(13.9%) 1166(0.9%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [65] 46.9% loop [166] 31.6% make-immutable-set [67] 10.1% ??? [69] 6.2% set-member? [128] 0.8% ------------------------------------------------------------------------------------------- loop [166] 4.6% substitute-e [54] 28.0% one-iter [48] 67.4% [58] 12413(9.2%) 858(0.6%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [64] 93.1% ------------------------------------------------------------------------------------------- one-iter [48] 2.4% merge-egraph-nodes! [53] 97.6% [59] 11891(8.8%) 3191(2.4%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [66] 53.5% update-en-expr [79] 12.3% reverse [146] 7.3% ------------------------------------------------------------------------------------------- substitute-e [54] 6.3% match-e [52] 93.7% [60] 4652(3.5%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [81] 100.0% ------------------------------------------------------------------------------------------- match-e [52] 100.0% [61] 2618(1.9%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [68] 55.1% do-curry [70] 44.9% ------------------------------------------------------------------------------------------- list-cartesian-product [62] 21.4% match-e [52] 78.6% [62] 2022(1.5%) 1439(1.1%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [84] 28.8% list-cartesian-product [62] 21.4% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [53] 100.0% [63] 878(0.7%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [71] 100.0% ------------------------------------------------------------------------------------------- mk-enode! [58] 100.0% [64] 11554(8.6%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [72] 100.0% ------------------------------------------------------------------------------------------- loop! [57] 100.0% [65] 9384(7.0%) 6672(5.0%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [74] 25.8% check-list [167] 3.1% ------------------------------------------------------------------------------------------- update-leader! [59] 100.0% [66] 6364(4.7%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [73] 100.0% ------------------------------------------------------------------------------------------- loop! [57] 100.0% [67] 3778(2.8%) 3778(2.8%) make-immutable-set .../private/set-types.rkt:948:0 ------------------------------------------------------------------------------------------- match-e [52] 44.6% ??? [61] 55.4% [68] 2601(1.9%) 1724(1.3%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [75] 33.7% ------------------------------------------------------------------------------------------- loop! [57] 100.0% [69] 2299(1.7%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [79] 62.9% reverse [146] 37.1% ------------------------------------------------------------------------------------------- ??? [61] 100.0% [70] 1176(0.9%) 296(0.2%) do-curry ...cket/collects/racket/function.rkt:71:2 partially-applied-procedure-arity-mask [76] 25.1% procedure-keywords [75] 24.9% make-keyword-procedure [77] 24.8% ------------------------------------------------------------------------------------------- enode-merge! [63] 100.0% [71] 878(0.7%) 878(0.7%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------------- new-enode [64] 100.0% [72] 11554(8.6%) 282(0.2%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [78] 97.6% ------------------------------------------------------------------------------------------- do-hash-update [66] 100.0% [73] 6364(4.7%) 4912(3.6%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [79] 13.7% make-sequence [84] 4.6% reverse [146] 4.5% ------------------------------------------------------------------------------------------- custom-set-union [65] 100.0% [74] 2423(1.8%) 582(0.4%) choose-immutable ...et/private/set-types.rkt:151:0 check-list [167] 64.1% set-check-compatible [80] 11.9% ------------------------------------------------------------------------------------------- do-curry [70] 25.0% do-procedure-reduce-keyword-arity [68] 75.0% [75] 1170(0.9%) 1170(0.9%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------------- do-curry [70] 100.0% [76] 296(0.2%) 296(0.2%) partially-applied-procedure-arity-mask ...rkt:58:2 ------------------------------------------------------------------------------------------- do-curry [70] 100.0% [77] 292(0.2%) 292(0.2%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------------- f53 [162] 2.6% type-of-enode-expr [72] 97.4% [78] 11568(8.6%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [82] 42.4% ??? [81] 25.1% ??? [83] 22.4% dict-ref-contract [129] 7.6% hash-has-key? [86] 2.5% ------------------------------------------------------------------------------------------- ??? [73] 23.0% ??? [69] 38.3% update-leader! [59] 38.7% [79] 3782(2.8%) 2331(1.7%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [85] 23.0% make-sequence [84] 15.3% ------------------------------------------------------------------------------------------- choose-immutable [74] 100.0% [80] 288(0.2%) 288(0.2%) set-check-compatible ...rivate/set-types.rkt:531:0 ------------------------------------------------------------------------------------------- substitute-e [54] 1.4% choose-best-alt! [28] 12.0% get-sigs [78] 13.3% match-e [52] 16.1% variable? [60] 21.4% finalize-iter! [27] 34.5% [81] 21768(16.2%) 867(0.6%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [86] 48.2% atab-add-altns [87] 34.5% atab-pick-alt [88] 12.0% ??? [148] 1.3% ------------------------------------------------------------------------------------------- ??? [110] 4.0% expression-cost [56] 28.0% get-sigs [78] 68.1% [82] 7200(5.3%) 1734(1.3%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [91] 64.1% set-member? [128] 7.9% return/no-unsupplied [130] 3.9% ------------------------------------------------------------------------------------------- get-sigs [78] 100.0% [83] 2590(1.9%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [89] 78.0% handle-the-hash [98] 22.0% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [53] 12.4% ??? [73] 12.6% update-en-expr [79] 24.9% match-e [52] 25.0% list-cartesian-product [62] 25.0% [84] 2327(1.7%) 2033(1.5%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [90] 12.6% ------------------------------------------------------------------------------------------- update-en-expr [79] 100.0% [85] 871(0.6%) 871(0.6%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ------------------------------------------------------------------------------------------- get-sigs [78] 2.7% ??? [81] 97.3% [86] 10788(8.0%) 7592(5.6%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [91] 26.9% reverse [146] 2.7% ------------------------------------------------------------------------------------------- ??? [81] 100.0% [87] 7506(5.6%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [92] 100.0% ------------------------------------------------------------------------------------------- ??? [81] 100.0% [88] 2617(1.9%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [94] 66.3% ??? [110] 22.2% write-json* [95] 11.4% ------------------------------------------------------------------------------------------- ??? [83] 100.0% [89] 2020(1.5%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [93] 100.0% ------------------------------------------------------------------------------------------- make-sequence [84] 100.0% [90] 294(0.2%) 294(0.2%) :hash-gen ...collects/racket/private/for.rkt:781:4 ------------------------------------------------------------------------------------------- hash-has-key? [86] 38.6% table-ref [82] 61.4% [91] 7516(5.6%) 2308(1.7%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [97] 38.6% handle-the-hash [98] 15.4% do-chaperone-procedure [99] 11.5% successfully-got-the-right-kind-of-function [102] 3.8% ------------------------------------------------------------------------------------------- atab-add-altns [87] 100.0% [92] 7506(5.6%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [96] 100.0% ------------------------------------------------------------------------------------------- ??? [89] 100.0% [93] 2020(1.5%) 1446(1.1%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [100] 28.4% ------------------------------------------------------------------------------------------- atab-pick-alt [88] 100.0% [94] 1736(1.3%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [166] 100.0% ------------------------------------------------------------------------------------------- atab-pick-alt [88] 100.0% [95] 299(0.2%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [101] 100.0% ------------------------------------------------------------------------------------------- atab-add-altn [92] 100.0% [96] 7506(5.6%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [103] 100.0% ------------------------------------------------------------------------------------------- ??? [91] 100.0% [97] 2902(2.2%) 1741(1.3%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 update-the-info [104] 19.8% loop [106] 10.3% blame-add-missing-party [107] 10.0% ------------------------------------------------------------------------------------------- ??? [83] 33.1% ??? [91] 66.9% [98] 1726(1.3%) 288(0.2%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [147] 67.0% ??? [157] 16.3% ------------------------------------------------------------------------------------------- ??? [91] 100.0% [99] 868(0.6%) 579(0.4%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [108] 33.3% ------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [93] 100.0% [100] 574(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [105] 100.0% ------------------------------------------------------------------------------------------- write-json* [95] 25.0% loop [101] 75.0% [101] 299(0.2%) 299(0.2%) loop .../share/racket/collects/json/main.rkt:132:2 loop [101] 75.0% ------------------------------------------------------------------------------------------- ??? [91] 100.0% [102] 283(0.2%) 283(0.2%) successfully-got-the-right-kind-of-function ...5:4 ------------------------------------------------------------------------------------------- composed [168] 5.1% best-and-tied-at-points [96] 44.2% loop [166] 50.7% [103] 16994(12.6%) 292(0.2%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [109] 69.5% eval-prog [111] 20.4% ulp-difference [112] 5.1% ??? [110] 3.3% ------------------------------------------------------------------------------------------- ??? [97] 100.0% [104] 574(0.4%) 574(0.4%) update-the-info ...ontract/private/blame.rkt:318:0 ------------------------------------------------------------------------------------------- ??? [100] 100.0% [105] 574(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [113] 100.0% ------------------------------------------------------------------------------------------- ??? [97] 25.0% loop [106] 75.0% [106] 298(0.2%) 298(0.2%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [106] 75.0% ------------------------------------------------------------------------------------------- ??? [97] 100.0% [107] 290(0.2%) 290(0.2%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------------- do-chaperone-procedure [99] 100.0% [108] 288(0.2%) 288(0.2%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 ------------------------------------------------------------------------------------------- generic-sort/key [16] 3.4% ??? [12] 6.9% copying-mergesort [19] 10.3% loop [166] 32.1% errors [103] 47.3% [109] 24942(18.5%) 14652(10.9%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [116] 23.1% loop [166] 7.0% ??? [118] 3.8% ??? [119] 2.6% ??? [124] 1.2% ??? [125] 1.2% ??? [157] 1.2% ------------------------------------------------------------------------------------------- ??? [36] 1.5% errors [103] 2.1% atab-pick-alt [88] 2.2% f53 [162] 2.9% copying-mergesort [19] 4.3% loop [166] 16.7% loop [114] 35.2% taylor-alt [33] 35.2% [110] 20004(14.8%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:375:33 loop [114] 35.2% approximate [115] 35.2% ->flonum [117] 17.3% real->bigfloat [120] 2.9% best-alt [121] 2.2% ??? [148] 1.5% dict-ref-contract [129] 1.4% table-ref [82] 1.4% ??? [157] 1.4% ------------------------------------------------------------------------------------------- errors [103] 100.0% [111] 3474(2.6%) 2612(1.9%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f53 [162] 16.5% compile [122] 8.3% ------------------------------------------------------------------------------------------- errors [103] 100.0% [112] 862(0.6%) 574(0.4%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [130] 33.4% ------------------------------------------------------------------------------------------- ??? [105] 100.0% [113] 574(0.4%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [123] 100.0% ------------------------------------------------------------------------------------------- ??? [110] 13.7% loop [114] 86.3% [114] 14077(10.4%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [114] 86.3% ??? [110] 13.7% ------------------------------------------------------------------------------------------- ??? [110] 100.0% [115] 14077(10.4%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [126] 89.7% taylor [131] 10.3% ------------------------------------------------------------------------------------------- ??? [109] 100.0% [116] 5757(4.3%) 3456(2.6%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 dict-ref-contract [129] 25.0% return/no-unsupplied [130] 9.9% list-member? [127] 5.1% ------------------------------------------------------------------------------------------- ??? [110] 100.0% [117] 3614(2.7%) 1155(0.9%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [130] 33.7% set-member? [128] 26.4% ??? [137] 8.0% ------------------------------------------------------------------------------------------- ??? [109] 100.0% [118] 950(0.7%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [133] 66.8% bfacos [135] 33.2% ------------------------------------------------------------------------------------------- ??? [109] 100.0% [119] 638(0.5%) 638(0.5%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------- ??? [110] 100.0% [120] 582(0.4%) 294(0.2%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [140] 49.4% ------------------------------------------------------------------------------------------- ??? [110] 100.0% [121] 582(0.4%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [132] 100.0% ------------------------------------------------------------------------------------------- expression-cost [56] 50.0% eval-prog [111] 50.0% [122] 578(0.4%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [113] 100.0% [123] 574(0.4%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [134] 100.0% ------------------------------------------------------------------------------------------- ??? [109] 100.0% [124] 308(0.2%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [147] 100.0% ------------------------------------------------------------------------------------------- ??? [109] 100.0% [125] 292(0.2%) 0(0.0%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [136] 100.0% ------------------------------------------------------------------------------------------- approximate [115] 100.0% [126] 12625(9.4%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------- ??? [116] 5.6% one-iter [48] 94.4% [127] 5250(3.9%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [138] 100.0% ------------------------------------------------------------------------------------------- loop! [57] 9.1% table-ref [82] 17.4% match-e [52] 17.6% one-iter [48] 26.6% ->flonum [117] 29.2% [128] 3261(2.4%) 3261(2.4%) set-member? ...ts/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------------- ??? [110] 9.0% flag-set? [47] 9.0% expression-cost [56] 9.1% get-sigs [78] 27.6% ??? [116] 45.3% [129] 3182(2.4%) 1439(1.1%) dict-ref-contract ...ract/private/arr-i.rkt:976:19 ??? [141] 27.3% ??? [142] 18.4% ??? [148] 9.1% ------------------------------------------------------------------------------------------- table-ref [82] 12.0% ulp-difference [112] 12.2% ??? [116] 24.1% ->flonum [117] 51.7% [130] 2355(1.7%) 620(0.5%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [139] 61.5% reverse [146] 12.2% ------------------------------------------------------------------------------------------- f53 [162] 4.1% taylor [131] 25.5% approximate [115] 70.3% [131] 1452(1.1%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [131] 25.5% normalize-series [149] 20.0% taylor-invert [144] 19.9% debug-print [163] 19.7% taylor-quotient [145] 6.6% f53 [162] 4.1% hash-ref! [150] 4.1% ------------------------------------------------------------------------------------------- extract-alt [30] 33.1% best-alt [121] 66.9% [132] 870(0.6%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [168] 100.0% ------------------------------------------------------------------------------------------- ??? [118] 100.0% [133] 634(0.5%) 292(0.2%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [140] 54.0% ------------------------------------------------------------------------------------------- contract-struct-name [143] 25.3% ??? [123] 74.7% [134] 574(0.4%) 0(0.0%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [143] 100.0% ------------------------------------------------------------------------------------------- ??? [118] 100.0% [135] 316(0.2%) 0(0.0%) bfacos ...lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [140] 100.0% ------------------------------------------------------------------------------------------- ??? [125] 100.0% [136] 292(0.2%) 292(0.2%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------------- ->flonum [117] 100.0% [137] 288(0.2%) 288(0.2%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 ------------------------------------------------------------------------------------------- list-member? [127] 100.0% [138] 5250(3.9%) 5250(3.9%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------------- one-iter [48] 12.6% match-e [52] 25.3% return/no-unsupplied [130] 62.1% [139] 2330(1.7%) 2330(1.7%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------------- real->bigfloat [120] 30.4% bfacos [135] 33.4% bfdiv [133] 36.2% [140] 946(0.7%) 946(0.7%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------------- ??? [147] 33.4% dict-ref-contract [129] 66.6% [141] 869(0.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [147] 66.6% ??? [148] 33.4% ------------------------------------------------------------------------------------------- dict-ref-contract [129] 100.0% [142] 586(0.4%) 586(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 ------------------------------------------------------------------------------------------- build-compound-type-name [134] 100.0% [143] 574(0.4%) 290(0.2%) contract-struct-name ...ract/private/prop.rkt:98:0 reverse [146] 49.4% build-compound-type-name [134] 25.3% ------------------------------------------------------------------------------------------- taylor [131] 100.0% [144] 290(0.2%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [160] 100.0% ------------------------------------------------------------------------------------------- taylor [131] 100.0% [145] 287(0.2%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 normalize-series [149] 100.0% ------------------------------------------------------------------------------------------- contract-struct-name [143] 7.6% return/no-unsupplied [130] 7.7% ??? [73] 7.7% hash-has-key? [86] 7.9% ??? [69] 22.8% match-e [52] 22.9% update-leader! [59] 23.3% [146] 3730(2.8%) 3730(2.8%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------------- ??? [124] 13.2% ??? [141] 37.2% handle-the-hash [98] 49.5% [147] 2333(1.7%) 596(0.4%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [151] 49.5% ??? [141] 24.9% ------------------------------------------------------------------------------------------- ??? [81] 19.6% dict-ref-contract [129] 19.9% ??? [110] 20.6% ??? [141] 40.0% [148] 1452(1.1%) 299(0.2%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [152] 40.0% dict? [153] 39.4% ------------------------------------------------------------------------------------------- taylor-quotient [145] 49.7% taylor [131] 50.3% [149] 578(0.4%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [150] 50.3% simplify [160] 49.7% ------------------------------------------------------------------------------------------- localize-error [37] 0.7% compile [122] 1.5% normalize-series [149] 2.1% taylor [131] 2.1% ??? [3] 2.2% loop [166] 2.6% ??? [156] 8.6% ??? [155] 16.4% ??? [154] 30.9% ??? [126] 30.9% [150] 14081(10.5%) 877(0.7%) hash-ref! .../racket/private/more-scheme.rkt:377:2 simplify [160] 31.1% ??? [154] 30.9% ??? [155] 17.8% ??? [156] 8.6% ??? [3] 2.7% ??? [159] 2.6% f53 [162] 2.0% ------------------------------------------------------------------------------------------- ??? [147] 100.0% [151] 1156(0.9%) 570(0.4%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [157] 50.6% ------------------------------------------------------------------------------------------- ??? [148] 100.0% [152] 580(0.4%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [158] 100.0% ------------------------------------------------------------------------------------------- ??? [148] 100.0% [153] 573(0.4%) 573(0.4%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------------------- hash-ref! [150] 100.0% [154] 12625(9.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [150] 100.0% [155] 7922(5.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [150] 92.5% simplify [160] 7.5% ------------------------------------------------------------------------------------------- hash-ref! [150] 100.0% [156] 5294(3.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------- ??? [110] 19.2% handle-the-hash [98] 19.7% ??? [109] 20.1% ??? [151] 41.0% [157] 1429(1.1%) 844(0.6%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [161] 41.0% ------------------------------------------------------------------------------------------- contract? [152] 100.0% [158] 580(0.4%) 580(0.4%) coerce-contract/f ...ntract/private/guts.rkt:372:0 ------------------------------------------------------------------------------------------- hash-ref! [150] 100.0% [159] 578(0.4%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [166] 100.0% ------------------------------------------------------------------------------------------- normalize-series [149] 2.1% taylor-invert [144] 2.1% ??? [3] 2.2% ??? [155] 4.4% hash-ref! [150] 89.1% [160] 13492(10.0%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f53 [162] 93.5% debug-print [163] 4.3% simplify* [165] 2.2% ------------------------------------------------------------------------------------------- ??? [157] 100.0% [161] 586(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [164] 100.0% ------------------------------------------------------------------------------------------- composed [168] 0.2% mterm->expr [17] 0.3% eval-prog [111] 0.3% hash-ref! [150] 1.1% taylor [131] 1.1% simplify [160] 13.7% loop [166] 35.2% split-table [25] 48.1% [162] 26370(19.6%) 10850(8.1%) f53 ...t/collects/racket/match/compiler.rkt:548:40 loop [166] 84.9% taylor [131] 1.1% ??? [110] 0.3% get-sigs [78] 0.3% composed [168] 0.2% ------------------------------------------------------------------------------------------- taylor [131] 32.8% simplify [160] 67.2% [163] 870(0.6%) 870(0.6%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ------------------------------------------------------------------------------------------- ??? [161] 100.0% [164] 586(0.4%) 292(0.2%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [167] 50.0% ------------------------------------------------------------------------------------------- simplify [160] 100.0% [165] 298(0.2%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 get-evaluator [169] 100.0% ------------------------------------------------------------------------------------------- loop [39] 0.4% ??? [159] 0.8% option-on-expr [2] 0.9% mk-enode-rec! [51] 1.0% point-best-alt [94] 1.0% ??? [109] 1.2% loop! [57] 1.7% match-e [52] 5.5% f53 [162] 14.5% loop [166] 73.1% [166] 52594(39.0%) 2035(1.5%) loop .../private/map.rkt:40:19 loop [166] 73.1% f53 [162] 11.8% step [170] 4.1% option-on-expr [2] 2.5% errors [103] 1.9% loop! [57] 1.6% ??? [110] 1.1% hash-ref! [150] 0.8% mk-enode-rec! [51] 0.6% ??? [109] 0.4% foldl [171] 0.3% mk-enode! [58] 0.3% make-multiplication-node [4] 0.1% ??? [12] 0.0% ------------------------------------------------------------------------------------------- match-e [52] 11.8% custom-set-union [65] 11.9% ??? [164] 12.1% choose-immutable [74] 64.2% [167] 2420(1.8%) 2420(1.8%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------------- f53 [162] 25.1% argmins [132] 74.9% [168] 1162(0.9%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [103] 74.9% f53 [162] 25.1% ------------------------------------------------------------------------------------------- simplify* [165] 100.0% [169] 298(0.2%) 298(0.2%) get-evaluator ...src/function-definitions.rkt:61:0 ------------------------------------------------------------------------------------------- loop [166] 100.0% [170] 2445(1.8%) 2153(1.6%) step .../racket/collects/racket/function.rkt:145:9 sort [173] 11.9% ------------------------------------------------------------------------------------------- loop [166] 100.0% [171] 578(0.4%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 check-fold [172] 100.0% ------------------------------------------------------------------------------------------- foldl [171] 100.0% [172] 578(0.4%) 578(0.4%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------------- step [170] 100.0% [173] 292(0.2%) 292(0.2%) sort ...cket/collects/racket/private/list.rkt:43:2 -------------------------------------------------------------------------------------------