Profiling results ----------------- Total cpu time observed: 77898ms (out of 78058ms) Number of samples taken: 273 (once every 285ms) (Hiding functions with self<1.0% and local<2.0%: 4 of 165 hidden) ======================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ======================================================================================== [1] 77898(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [6] 100.0% ---------------------------------------------------------------------------------------- loop [110] 100.0% [2] 1090(1.4%) 0(0.0%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 ??? [67] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [129] 100.0% [3] 844(1.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [113] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [129] 100.0% [4] 279(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 simplify [7] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [129] 100.0% [5] 278(0.4%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [110] 100.0% ---------------------------------------------------------------------------------------- ??? [1] 100.0% [6] 77898(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [8] 100.0% ---------------------------------------------------------------------------------------- ??? [4] 24.8% hash-ref! [129] 75.2% [7] 1126(1.4%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f163 [100] 50.3% debug-print [9] 49.7% ---------------------------------------------------------------------------------------- profile-thunk [6] 100.0% [8] 77898(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [10] 100.0% ---------------------------------------------------------------------------------------- simplify [7] 100.0% [9] 560(0.7%) 560(0.7%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ---------------------------------------------------------------------------------------- ??? [8] 100.0% [10] 77898(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [11] 92.6% prepare-points [16] 7.4% ---------------------------------------------------------------------------------------- ??? [10] 100.0% [11] 72129(92.6%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [12] 98.1% get-final-combination [13] 1.5% setup-prog! [14] 0.4% ---------------------------------------------------------------------------------------- run-improve [11] 100.0% [12] 70748(90.8%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [15] 94.1% finalize-iter! [17] 3.1% gen-series! [18] 1.6% choose-best-alt! [20] 0.8% localize! [21] 0.4% ---------------------------------------------------------------------------------------- run-improve [11] 100.0% [13] 1104(1.4%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [19] 74.8% ??? [95] 25.2% ---------------------------------------------------------------------------------------- run-improve [11] 100.0% [14] 277(0.4%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [16] 100.0% ---------------------------------------------------------------------------------------- run-iter! [12] 100.0% [15] 66564(85.5%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [22] 100.0% ---------------------------------------------------------------------------------------- setup-prog! [14] 4.6% ??? [10] 95.4% [16] 6046(7.8%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [29] 62.7% make-exacts [23] 28.1% ??? [26] 4.6% make-exacts* [27] 4.6% ---------------------------------------------------------------------------------------- run-iter! [12] 100.0% [17] 2217(2.8%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [67] 100.0% ---------------------------------------------------------------------------------------- run-iter! [12] 100.0% [18] 1126(1.4%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [24] 100.0% ---------------------------------------------------------------------------------------- get-final-combination [13] 100.0% [19] 826(1.1%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f163 [100] 100.0% ---------------------------------------------------------------------------------------- run-iter! [12] 100.0% [20] 561(0.7%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [67] 100.0% ---------------------------------------------------------------------------------------- run-iter! [12] 100.0% [21] 280(0.4%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [25] 100.0% ---------------------------------------------------------------------------------------- simplify! [15] 100.0% [22] 66564(85.5%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [28] 100.0% ---------------------------------------------------------------------------------------- prepare-points [16] 100.0% [23] 1700(2.2%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [29] 100.0% ---------------------------------------------------------------------------------------- gen-series! [18] 100.0% [24] 1126(1.4%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [95] 100.0% ---------------------------------------------------------------------------------------- localize! [21] 100.0% [25] 280(0.4%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [129] 100.0% ---------------------------------------------------------------------------------------- prepare-points [16] 100.0% [26] 277(0.4%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 range-table-ref [30] 100.0% ---------------------------------------------------------------------------------------- prepare-points [16] 100.0% [27] 277(0.4%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [97] 100.0% ---------------------------------------------------------------------------------------- ??? [95] 0.4% ??? [22] 99.6% [28] 66842(85.8%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [31] 100.0% ---------------------------------------------------------------------------------------- make-exacts [23] 31.0% prepare-points [16] 69.0% [29] 5492(7.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [110] 100.0% ---------------------------------------------------------------------------------------- ??? [26] 100.0% [30] 277(0.4%) 277(0.4%) range-table-ref ...ng/src/range-analysis.rkt:182:0 ---------------------------------------------------------------------------------------- simplify [28] 100.0% [31] 66842(85.8%) 278(0.4%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [32] 93.7% loop [33] 5.8% ---------------------------------------------------------------------------------------- ??? [31] 100.0% [32] 62664(80.4%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [34] 97.8% loop [110] 2.2% ---------------------------------------------------------------------------------------- ??? [31] 100.0% [33] 3900(5.0%) 276(0.4%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 loop [35] 57.2% mk-min [36] 35.7% ---------------------------------------------------------------------------------------- iterate-egraph! [32] 100.0% [34] 61299(78.7%) 286(0.4%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [37] 34.1% merge-egraph-nodes! [38] 19.1% mk-enode! [43] 14.5% loop! [44] 11.4% substitute-e [39] 9.6% custom-set-member? [40] 7.7% update-leader! [45] 1.4% make-sequence [66] 0.5% pack-leader [70] 0.5% list-member? [42] 0.4% ---------------------------------------------------------------------------------------- loop [33] 100.0% [35] 2230(2.9%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [41] 100.0% ---------------------------------------------------------------------------------------- loop [33] 100.0% [36] 1394(1.8%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [41] 100.0% ---------------------------------------------------------------------------------------- match-e [37] 29.6% one-iter [34] 70.4% [37] 20912(26.8%) 7814(10.0%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [37] 29.6% ??? [46] 10.0% ??? [67] 8.5% loop [110] 6.7% list-cartesian-product [48] 4.6% do-procedure-reduce-keyword-arity [55] 4.0% variable? [47] 2.9% make-sequence [66] 1.3% reverse [112] 0.7% ---------------------------------------------------------------------------------------- merge-egraph-nodes! [38] 6.0% one-iter [34] 94.0% [38] 11708(15.0%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [45] 60.8% loop! [44] 28.5% merge-egraph-nodes! [38] 6.0% enode-merge! [49] 4.7% ---------------------------------------------------------------------------------------- substitute-e [39] 5.5% one-iter [34] 94.5% [39] 5857(7.5%) 278(0.4%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [43] 85.8% substitute-e [39] 5.5% variable? [47] 2.4% ??? [67] 1.6% ---------------------------------------------------------------------------------------- one-iter [34] 100.0% [40] 4724(6.1%) 4724(6.1%) custom-set-member? ...t/private/set-types.rkt:45:0 ---------------------------------------------------------------------------------------- mk-min [36] 38.5% loop [35] 61.5% [41] 3624(4.7%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [68] 92.3% compile [50] 7.7% ---------------------------------------------------------------------------------------- one-iter [34] 100.0% [42] 270(0.3%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [51] 100.0% ---------------------------------------------------------------------------------------- substitute-e [39] 36.1% one-iter [34] 63.9% [43] 13922(17.9%) 282(0.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [52] 88.0% hash-has-key? [72] 8.0% loop [110] 2.0% ---------------------------------------------------------------------------------------- merge-egraph-nodes! [38] 25.6% loop [110] 28.2% one-iter [34] 46.2% [44] 10856(13.9%) 840(1.1%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [62] 41.0% loop [110] 35.9% make-immutable-set [54] 14.1% ??? [57] 3.8% ---------------------------------------------------------------------------------------- one-iter [34] 10.3% merge-egraph-nodes! [38] 89.7% [45] 8092(10.4%) 1952(2.5%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [53] 55.2% reverse [112] 6.9% update-en-expr [65] 6.9% make-sequence [66] 3.5% custom-set-union! [58] 3.4% ---------------------------------------------------------------------------------------- match-e [37] 100.0% [46] 2234(2.9%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [56] 62.6% do-procedure-reduce-keyword-arity [55] 37.4% ---------------------------------------------------------------------------------------- substitute-e [39] 16.7% match-e [37] 83.3% [47] 1673(2.1%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [67] 100.0% ---------------------------------------------------------------------------------------- list-cartesian-product [48] 12.5% match-e [37] 87.5% [48] 1110(1.4%) 840(1.1%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [66] 24.3% list-cartesian-product [48] 12.5% ---------------------------------------------------------------------------------------- merge-egraph-nodes! [38] 100.0% [49] 553(0.7%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [59] 50.2% adopt-enode! [60] 49.8% ---------------------------------------------------------------------------------------- expression-cost [41] 100.0% [50] 278(0.4%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [129] 100.0% ---------------------------------------------------------------------------------------- list-member? [42] 100.0% [51] 270(0.3%) 270(0.3%) member ...collects/racket/private/member.rkt:13:21 ---------------------------------------------------------------------------------------- mk-enode! [43] 100.0% [52] 12254(15.7%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [61] 100.0% ---------------------------------------------------------------------------------------- update-leader! [45] 100.0% [53] 4465(5.7%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [63] 100.0% ---------------------------------------------------------------------------------------- loop! [44] 100.0% [54] 3063(3.9%) 3063(3.9%) make-immutable-set .../private/set-types.rkt:948:0 ---------------------------------------------------------------------------------------- ??? [46] 42.9% match-e [37] 57.1% [55] 1947(2.5%) 1106(1.4%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [105] 43.2% ---------------------------------------------------------------------------------------- ??? [46] 100.0% [56] 1399(1.8%) 1399(1.8%) do-curry ...cket/collects/racket/function.rkt:71:2 ---------------------------------------------------------------------------------------- loop! [44] 100.0% [57] 834(1.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [65] 66.4% reverse [112] 33.6% ---------------------------------------------------------------------------------------- update-leader! [45] 100.0% [58] 278(0.4%) 278(0.4%) custom-set-union! ...t/private/set-types.rkt:245:0 ---------------------------------------------------------------------------------------- enode-merge! [49] 100.0% [59] 278(0.4%) 278(0.4%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ---------------------------------------------------------------------------------------- enode-merge! [49] 100.0% [60] 276(0.4%) 0(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [62] 100.0% ---------------------------------------------------------------------------------------- new-enode [52] 100.0% [61] 12254(15.7%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [64] 97.7% f163 [100] 2.3% ---------------------------------------------------------------------------------------- adopt-enode! [60] 5.2% loop! [44] 94.8% [62] 5282(6.8%) 5007(6.4%) custom-set-union ...et/private/set-types.rkt:168:0 check-list [85] 5.2% ---------------------------------------------------------------------------------------- do-hash-update [53] 100.0% [63] 4465(5.7%) 3624(4.7%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 reverse [112] 6.4% update-en-expr [65] 6.3% make-sequence [66] 6.2% ---------------------------------------------------------------------------------------- type-of-enode-expr [61] 100.0% [64] 11978(15.4%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [69] 32.6% table-ref [68] 25.7% ??? [67] 25.6% ...sting/src/common.rkt:47:2 [111] 16.2% ---------------------------------------------------------------------------------------- ??? [63] 20.1% ??? [57] 39.9% update-leader! [45] 40.0% [65] 1388(1.8%) 1108(1.4%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [70] 20.2% ---------------------------------------------------------------------------------------- list-cartesian-product [48] 19.5% match-e [37] 19.7% ??? [63] 19.9% update-leader! [45] 20.3% one-iter [34] 20.6% [66] 1385(1.8%) 1109(1.4%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [71] 19.9% ---------------------------------------------------------------------------------------- substitute-e [39] 2.0% f163 [100] 2.0% choose-best-alt! [20] 4.1% setfindf [2] 8.0% variable? [47] 12.3% finalize-iter! [17] 16.3% get-sigs [64] 22.5% match-e [37] 32.8% [67] 13623(17.5%) 826(1.1%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [72] 73.5% atab-add-altns [74] 16.3% atab-pick-alt [75] 4.1% ---------------------------------------------------------------------------------------- get-sigs [64] 47.9% expression-cost [41] 52.1% [68] 6419(8.2%) 841(1.1%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [77] 82.6% ??? [76] 4.3% ---------------------------------------------------------------------------------------- get-sigs [64] 100.0% [69] 3905(5.0%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [73] 78.5% get/build-late-neg-projection [96] 14.4% handle-the-hash [84] 7.2% ---------------------------------------------------------------------------------------- update-en-expr [65] 50.0% one-iter [34] 50.0% [70] 560(0.7%) 560(0.7%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ---------------------------------------------------------------------------------------- make-sequence [66] 100.0% [71] 276(0.4%) 276(0.4%) :hash-gen ...collects/racket/private/for.rkt:781:4 ---------------------------------------------------------------------------------------- mk-enode! [43] 10.0% ??? [67] 90.0% [72] 11132(14.3%) 8068(10.4%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [77] 27.5% ---------------------------------------------------------------------------------------- ??? [69] 100.0% [73] 3064(3.9%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [78] 100.0% ---------------------------------------------------------------------------------------- ??? [67] 100.0% [74] 2217(2.8%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [79] 100.0% ---------------------------------------------------------------------------------------- ??? [67] 100.0% [75] 561(0.7%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 ??? [95] 50.7% point-best-alt [80] 49.3% ---------------------------------------------------------------------------------------- table-ref [68] 100.0% [76] 278(0.4%) 278(0.4%) ??? ...cts/racket/contract/private/list.rkt:211:14 ---------------------------------------------------------------------------------------- hash-has-key? [72] 36.6% table-ref [68] 63.4% [77] 8364(10.7%) 4449(5.7%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [81] 26.8% handle-the-hash [84] 10.0% check-list [85] 3.4% ??? [128] 3.3% successfully-got-the-right-kind-of-function [86] 3.3% ---------------------------------------------------------------------------------------- ??? [73] 100.0% [78] 3064(3.9%) 1388(1.8%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [83] 54.7% ---------------------------------------------------------------------------------------- atab-add-altns [74] 100.0% [79] 2217(2.8%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [82] 100.0% ---------------------------------------------------------------------------------------- atab-pick-alt [75] 100.0% [80] 276(0.4%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [110] 100.0% ---------------------------------------------------------------------------------------- ??? [77] 100.0% [81] 2238(2.9%) 561(0.7%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 blame-add-missing-party [89] 37.6% loop [90] 12.6% make-keyword-procedure [91] 12.4% update-the-info [94] 12.3% ---------------------------------------------------------------------------------------- atab-add-altn [79] 100.0% [82] 2217(2.8%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [87] 100.0% ---------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [78] 100.0% [83] 1676(2.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [88] 83.5% blame-add-context [92] 16.5% ---------------------------------------------------------------------------------------- ??? [69] 25.0% ??? [77] 75.0% [84] 1120(1.4%) 561(0.7%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [128] 49.9% ---------------------------------------------------------------------------------------- custom-set-union [62] 49.4% ??? [77] 50.6% [85] 558(0.7%) 558(0.7%) check-list ...ollects/racket/private/for.rkt:690:2 ---------------------------------------------------------------------------------------- ??? [77] 100.0% [86] 277(0.4%) 0(0.0%) successfully-got-the-right-kind-of-function ...5:4 arity-checking-wrapper [93] 100.0% ---------------------------------------------------------------------------------------- loop [110] 10.0% composed [122] 10.2% best-and-tied-at-points [82] 79.8% [87] 2778(3.6%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [154] 60.0% eval-prog [97] 30.0% ??? [95] 10.1% ---------------------------------------------------------------------------------------- ??? [83] 100.0% [88] 1398(1.8%) 283(0.4%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [96] 59.7% do-blame-add-context [98] 20.0% ---------------------------------------------------------------------------------------- ??? [81] 100.0% [89] 841(1.1%) 841(1.1%) blame-add-missing-party ...private/blame.rkt:382:0 ---------------------------------------------------------------------------------------- ??? [81] 25.0% loop [90] 75.0% [90] 282(0.4%) 282(0.4%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [90] 75.0% ---------------------------------------------------------------------------------------- ??? [81] 100.0% [91] 278(0.4%) 278(0.4%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ---------------------------------------------------------------------------------------- ??? [83] 100.0% [92] 277(0.4%) 277(0.4%) blame-add-context ...tract/private/blame.rkt:170:0 ---------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [86]100.0% [93] 277(0.4%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:443:0 matches-arity-exactly? [99] 100.0% ---------------------------------------------------------------------------------------- ??? [81] 100.0% [94] 276(0.4%) 276(0.4%) update-the-info ...ontract/private/blame.rkt:318:0 ---------------------------------------------------------------------------------------- get-final-combination [13] 5.1% loop [116] 5.2% errors [87] 5.2% atab-pick-alt [75] 5.3% loop [103] 10.4% taylor-alt [24] 10.4% loop [110] 58.5% [95] 5418(7.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:375:33 real->bigfloat [101] 32.0% ->flonum [102] 21.1% ??? [130] 10.5% loop [103] 10.4% approximate [104] 10.4% best-alt [108] 5.3% ??? [145] 5.2% simplify [28] 5.1% ---------------------------------------------------------------------------------------- ??? [107] 20.1% ??? [69] 20.1% ??? [88] 59.8% [96] 1397(1.8%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [106] 69.9% ??? [107] 20.1% contract-struct-late-neg-projection [109] 10.0% ---------------------------------------------------------------------------------------- make-exacts* [27] 25.0% errors [87] 75.0% [97] 1110(1.4%) 833(1.1%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f163 [100] 25.0% ---------------------------------------------------------------------------------------- ??? [88] 100.0% [98] 280(0.4%) 280(0.4%) do-blame-add-context ...ct/private/blame.rkt:192:0 ---------------------------------------------------------------------------------------- arity-checking-wrapper [93] 100.0% [99] 277(0.4%) 0(0.0%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 procedure-keywords [105] 100.0% ---------------------------------------------------------------------------------------- type-of-enode-expr [61] 12.4% eval-prog [97] 12.4% hash-ref! [129] 12.6% simplify [7] 25.5% split-table [19] 37.1% [100] 2225(2.9%) 842(1.1%) f163 .../collects/racket/match/compiler.rkt:548:40 loop [110] 43.4% ??? [67] 12.4% loop [116] 6.3% ---------------------------------------------------------------------------------------- ??? [95] 100.0% [101] 1735(2.2%) 0(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [160] 100.0% ---------------------------------------------------------------------------------------- ??? [95] 100.0% [102] 1142(1.5%) 290(0.4%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [114] 49.0% ...sting/src/common.rkt:47:2 [111] 25.6% ---------------------------------------------------------------------------------------- ??? [95] 25.8% loop [103] 74.2% [103] 1126(1.4%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [103] 74.2% ??? [95] 25.8% ---------------------------------------------------------------------------------------- ??? [95] 100.0% [104] 1126(1.4%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [129] 75.0% ??? [113] 25.0% ---------------------------------------------------------------------------------------- matches-arity-exactly? [99] 24.8% do-procedure-reduce-keyword-arity [55] 75.2% [105] 1118(1.4%) 1118(1.4%) procedure-keywords .../racket/private/kw.rkt:534:2 ---------------------------------------------------------------------------------------- get/build-late-neg-projection [96] 100.0% [106] 1116(1.4%) 560(0.7%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [117] 24.9% reverse [112] 24.9% ---------------------------------------------------------------------------------------- get/build-late-neg-projection [96] 100.0% [107] 562(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [96] 100.0% ---------------------------------------------------------------------------------------- ??? [95] 100.0% [108] 284(0.4%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [115] 100.0% ---------------------------------------------------------------------------------------- get/build-late-neg-projection [96] 100.0% [109] 280(0.4%) 280(0.4%) contract-struct-late-neg-projection ...p.rkt:121:0 ---------------------------------------------------------------------------------------- ??? [154] 0.1% loop [29] 0.2% set-precompute! [119] 0.2% iterate-egraph! [32] 0.2% mk-enode! [43] 0.8% point-best-alt [80] 0.8% ??? [5] 1.6% loop! [44] 2.0% f163 [100] 3.2% match-e [37] 6.9% loop [110] 84.2% [110] 17415(22.4%) 1382(1.8%) loop .../private/map.rkt:40:19 loop [110] 84.2% option-on-expr [120] 2.4% keyword-apply [121] 2.0% foldl [125] 1.6% hash-ref! [129] 1.6% loop! [44] 1.2% composed [124] 0.8% errors [87] 0.8% set-precompute! [119] 0.2% setfindf [2] 0.2% ??? [154] 0.1% ??? [95] 0.1% ---------------------------------------------------------------------------------------- ??? [127] 6.2% ->flonum [102] 13.1% get-sigs [64] 80.6% [111] 2227(2.9%) 292(0.4%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [118] 74.4% ??? [127] 6.2% ??? [130] 6.2% ---------------------------------------------------------------------------------------- ??? [106] 16.5% ??? [57] 16.6% match-e [37] 16.8% ??? [63] 16.9% update-leader! [45] 33.2% [112] 1686(2.2%) 1686(2.2%) reverse ...collects/racket/private/reverse.rkt:6:4 ---------------------------------------------------------------------------------------- approximate [104] 25.0% ??? [3] 75.0% [113] 1126(1.4%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [129] 100.0% ---------------------------------------------------------------------------------------- ->flonum [102] 100.0% [114] 559(0.7%) 280(0.4%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [123] 50.0% ---------------------------------------------------------------------------------------- best-alt [108] 100.0% [115] 284(0.4%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [122] 100.0% ---------------------------------------------------------------------------------------- f163 [100] 5.6% loop [116] 94.4% [116] 280(0.4%) 0(0.0%) loop .../private/map.rkt:54:19 loop [116] 94.4% ??? [95] 5.6% ---------------------------------------------------------------------------------------- contract-struct-name [126] 50.0% ??? [106] 50.0% [117] 278(0.4%) 278(0.4%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [126] 50.0% ---------------------------------------------------------------------------------------- ??? [128] 16.9% ...sting/src/common.rkt:47:2 [111] 83.1% [118] 1656(2.1%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [128] 83.1% ??? [130] 16.9% ---------------------------------------------------------------------------------------- loop [110] 100.0% [119] 1365(1.8%) 0(0.0%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [110] 79.9% simple-compose [135] 20.1% ---------------------------------------------------------------------------------------- loop [110] 100.0% [120] 826(1.1%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 err-lsts->split-indices [131] 66.5% sort-context-on-expr [134] 33.5% ---------------------------------------------------------------------------------------- loop [110] 100.0% [121] 563(0.7%) 281(0.4%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [132] 50.1% ---------------------------------------------------------------------------------------- argmins [115] 100.0% [122] 284(0.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [87] 100.0% ---------------------------------------------------------------------------------------- return/no-unsupplied [114] 100.0% [123] 280(0.4%) 280(0.4%) filter ...t/collects/racket/private/list.rkt:275:2 ---------------------------------------------------------------------------------------- loop [110] 100.0% [124] 280(0.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [129] 100.0% ---------------------------------------------------------------------------------------- loop [110] 100.0% [125] 278(0.4%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 check-fold [133] 100.0% ---------------------------------------------------------------------------------------- build-compound-type-name [117] 100.0% [126] 278(0.4%) 0(0.0%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [117] 100.0% ---------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [111] 100.0% [127] 278(0.4%) 0(0.0%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 ...sting/src/common.rkt:47:2 [111] 100.0% ---------------------------------------------------------------------------------------- ??? [77] 11.1% handle-the-hash [84] 22.4% ??? [118] 66.5% [128] 2492(3.2%) 1095(1.4%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [118] 22.5% ??? [140] 22.4% ??? [145] 11.1% ---------------------------------------------------------------------------------------- loop [110] 8.3% compile [50] 8.3% composed [124] 8.3% localize-error [25] 8.3% ??? [139] 8.9% ??? [137] 10.3% approximate [104] 10.3% ??? [136] 18.7% ??? [113] 18.7% [129] 1684(2.2%) 278(0.4%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [136] 18.7% f163 [100] 16.6% simplify [7] 15.9% ??? [3] 10.3% ??? [137] 10.3% ??? [139] 8.9% ??? [5] 8.3% ??? [4] 2.8% ---------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [111] 19.7% ??? [118] 39.8% ??? [95] 40.5% [130] 1410(1.8%) 280(0.4%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [138] 39.8% ^TYPE? [142] 20.6% dict? [143] 19.7% ---------------------------------------------------------------------------------------- option-on-expr [120] 100.0% [131] 549(0.7%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [141] 100.0% ---------------------------------------------------------------------------------------- keyword-apply [121] 100.0% [132] 282(0.4%) 282(0.4%) loop ...cket/collects/racket/private/kw.rkt:518:13 ---------------------------------------------------------------------------------------- foldl [125] 100.0% [133] 278(0.4%) 278(0.4%) check-fold ...llects/racket/private/list.rkt:223:2 ---------------------------------------------------------------------------------------- option-on-expr [120] 100.0% [134] 277(0.4%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [144] 100.0% ---------------------------------------------------------------------------------------- set-precompute! [119] 100.0% [135] 274(0.4%) 274(0.4%) simple-compose ...s/racket/private/list.rkt:426:10 ---------------------------------------------------------------------------------------- hash-ref! [129] 100.0% [136] 1126(1.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [129] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [129] 100.0% [137] 844(1.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [129] 100.0% ---------------------------------------------------------------------------------------- ??? [130] 100.0% [138] 562(0.7%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [146] 50.7% simple-flat-contract? [148] 49.3% ---------------------------------------------------------------------------------------- hash-ref! [129] 100.0% [139] 560(0.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [129] 100.0% ---------------------------------------------------------------------------------------- ??? [128] 100.0% [140] 558(0.7%) 279(0.4%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [145] 50.0% ---------------------------------------------------------------------------------------- err-lsts->split-indices [131] 100.0% [141] 549(0.7%) 549(0.7%) ??? ...e/racket/collects/racket/function.rkt:93:12 ---------------------------------------------------------------------------------------- ??? [130] 100.0% [142] 291(0.4%) 291(0.4%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ---------------------------------------------------------------------------------------- ??? [130] 100.0% [143] 278(0.4%) 0(0.0%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [147] 100.0% ---------------------------------------------------------------------------------------- sort-context-on-expr [134] 100.0% [144] 277(0.4%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [149] 100.0% ---------------------------------------------------------------------------------------- ??? [128] 33.0% ??? [140] 33.3% ??? [95] 33.6% [145] 838(1.1%) 282(0.4%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [151] 33.3% ??? [152] 33.0% ---------------------------------------------------------------------------------------- contract? [138] 100.0% [146] 284(0.4%) 0(0.0%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [150] 100.0% ---------------------------------------------------------------------------------------- dict? [143] 100.0% [147] 278(0.4%) 278(0.4%) assoc? ...et/collects/racket/private/dict.rkt:13:0 ---------------------------------------------------------------------------------------- contract? [138] 100.0% [148] 277(0.4%) 277(0.4%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ---------------------------------------------------------------------------------------- ??? [144] 100.0% [149] 277(0.4%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [153] 100.0% ---------------------------------------------------------------------------------------- coerce-contract/f [146] 100.0% [150] 284(0.4%) 284(0.4%) coerce-simple-value ...ract/private/guts.rkt:385:0 ---------------------------------------------------------------------------------------- ??? [145] 100.0% [151] 280(0.4%) 280(0.4%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ---------------------------------------------------------------------------------------- ??? [145] 100.0% [152] 277(0.4%) 277(0.4%) ??? ...lects/racket/contract/private/orc.rkt:117:8 ---------------------------------------------------------------------------------------- generic-sort/key [149] 20.0% copying-mergesort [153] 80.0% [153] 277(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [153] 80.0% ??? [154] 20.0% ---------------------------------------------------------------------------------------- copying-mergesort [153] 4.2% errors [87] 25.4% loop [110] 70.4% [154] 6570(8.4%) 1418(1.8%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [110] 35.1% ??? [158] 13.4% ??? [155] 12.6% bf* [156] 8.9% ??? [157] 8.4% ---------------------------------------------------------------------------------------- ??? [154] 100.0% [155] 828(1.1%) 828(1.1%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ---------------------------------------------------------------------------------------- ??? [154] 100.0% [156] 582(0.7%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [158] 100.0% ---------------------------------------------------------------------------------------- ??? [154] 100.0% [157] 552(0.7%) 552(0.7%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ---------------------------------------------------------------------------------------- bf* [156] 39.7% ??? [154] 60.3% [158] 1466(1.9%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [159] 100.0% ---------------------------------------------------------------------------------------- ??? [158] 100.0% [159] 1466(1.9%) 566(0.7%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [160] 40.9% ??? [161] 20.4% ---------------------------------------------------------------------------------------- bfsub [159] 25.7% real->bigfloat [101] 74.3% [160] 2335(3.0%) 2335(3.0%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ---------------------------------------------------------------------------------------- bfsub [159] 100.0% [161] 300(0.4%) 300(0.4%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ----------------------------------------------------------------------------------------