Profiling results ----------------- Total cpu time observed: 89690ms (out of 90085ms) Number of samples taken: 315 (once every 285ms) (Hiding functions with self<1.0% and local<2.0%: 7 of 171 hidden) ============================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================== [1] 89690(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [4] 100.0% ------------------------------------------------------------------------------ loop [132] 100.0% [2] 8683(9.7%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [5] 54.8% loop [132] 32.1% sort-context-on-expr [6] 9.8% eval-prog [98] 3.3% ------------------------------------------------------------------------------ loop [132] 100.0% [3] 1120(1.2%) 836(0.9%) set-precompute! ...ing/src/core/simplify.rkt:193:0 eval-const-expr [7] 25.3% ------------------------------------------------------------------------------ ??? [1] 100.0% [4] 89690(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [8] 100.0% ------------------------------------------------------------------------------ option-on-expr [2] 100.0% [5] 4761(5.3%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [9] 100.0% ------------------------------------------------------------------------------ option-on-expr [2] 100.0% [6] 847(0.9%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [10] 100.0% ------------------------------------------------------------------------------ set-precompute! [3] 100.0% [7] 283(0.3%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f53 [128] 100.0% ------------------------------------------------------------------------------ profile-thunk [4] 100.0% [8] 89690(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [11] 100.0% ------------------------------------------------------------------------------ sindices->spoints [5] 100.0% [9] 4761(5.3%) 0(0.0%) loop .../private/map.rkt:54:19 sidx->spoint [12] 100.0% ------------------------------------------------------------------------------ sort-context-on-expr [6] 100.0% [10] 847(0.9%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [13] 100.0% ------------------------------------------------------------------------------ ??? [8] 100.0% [11] 89690(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [14] 88.8% prepare-points [22] 11.2% ------------------------------------------------------------------------------ loop [9] 100.0% [12] 4761(5.3%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [15] 100.0% ------------------------------------------------------------------------------ ??? [10] 100.0% [13] 847(0.9%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [16] 66.6% ??? [134] 33.4% ------------------------------------------------------------------------------ ??? [11] 100.0% [14] 79640(88.8%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [17] 88.4% get-final-combination [18] 11.3% setup-prog! [20] 0.4% ------------------------------------------------------------------------------ sidx->spoint [12] 100.0% [15] 4761(5.3%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [19] 100.0% ------------------------------------------------------------------------------ generic-sort/key [13] 100.0% [16] 564(0.6%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 ??? [134] 100.0% ------------------------------------------------------------------------------ run-improve [14] 100.0% [17] 70390(78.5%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [21] 86.5% finalize-iter! [24] 7.5% gen-series! [25] 3.6% choose-best-alt! [26] 2.0% localize! [27] 0.4% ------------------------------------------------------------------------------ run-improve [14] 100.0% [18] 8968(10.0%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [23] 96.8% loop [132] 3.2% ------------------------------------------------------------------------------ binary-search-floats [15] 100.0% [19] 4761(5.3%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 errors [90] 53.1% prepare-points [22] 46.9% ------------------------------------------------------------------------------ run-improve [14] 100.0% [20] 282(0.3%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [22] 100.0% ------------------------------------------------------------------------------ run-iter! [17] 100.0% [21] 60894(67.9%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [28] 100.0% ------------------------------------------------------------------------------ setup-prog! [20] 2.2% pred [19] 17.8% ??? [11] 80.0% [22] 12566(14.0%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [34] 56.0% make-exacts [29] 26.0% make-exacts* [31] 18.0% ------------------------------------------------------------------------------ get-final-combination [18] 100.0% [23] 8683(9.7%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f53 [128] 100.0% ------------------------------------------------------------------------------ run-iter! [17] 100.0% [24] 5279(5.9%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [67] 100.0% ------------------------------------------------------------------------------ run-iter! [17] 100.0% [25] 2538(2.8%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [30] 100.0% ------------------------------------------------------------------------------ run-iter! [17] 100.0% [26] 1394(1.6%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [67] 100.0% ------------------------------------------------------------------------------ run-iter! [17] 100.0% [27] 285(0.3%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [32] 100.0% ------------------------------------------------------------------------------ simplify! [21] 100.0% [28] 60894(67.9%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [33] 100.0% ------------------------------------------------------------------------------ prepare-points [22] 100.0% [29] 3268(3.6%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [34] 91.4% debug-print [130] 8.6% ------------------------------------------------------------------------------ gen-series! [25] 100.0% [30] 2538(2.8%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [97] 100.0% ------------------------------------------------------------------------------ prepare-points [22] 100.0% [31] 2264(2.5%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [98] 100.0% ------------------------------------------------------------------------------ localize! [27] 100.0% [32] 285(0.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [117] 100.0% ------------------------------------------------------------------------------ ??? [28] 100.0% [33] 60894(67.9%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [35] 100.0% ------------------------------------------------------------------------------ make-exacts [29] 29.8% prepare-points [22] 70.2% [34] 10018(11.2%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [132] 96.2% gen-andmap [36] 3.8% ------------------------------------------------------------------------------ simplify [33] 100.0% [35] 60894(67.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [37] 92.2% loop [38] 6.9% mk-egraph [39] 0.9% ------------------------------------------------------------------------------ loop [34] 100.0% [36] 380(0.4%) 380(0.4%) gen-andmap ...ollects/racket/private/map.rkt:275:2 ------------------------------------------------------------------------------ ??? [35] 100.0% [37] 56140(62.6%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [40] 98.0% loop [132] 2.0% ------------------------------------------------------------------------------ ??? [35] 100.0% [38] 4208(4.7%) 284(0.3%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [41] 59.7% loop [42] 33.5% ------------------------------------------------------------------------------ ??? [35] 100.0% [39] 547(0.6%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [43] 100.0% ------------------------------------------------------------------------------ iterate-egraph! [37] 100.0% [40] 55020(61.3%) 1120(1.2%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [44] 43.2% mk-enode! [49] 11.2% loop! [135] 10.6% merge-egraph-nodes! [45] 10.6% substitute-e [46] 10.1% custom-set-member? [48] 5.6% update-leader! [50] 3.0% list-member? [113] 1.0% filter [161] 1.0% reverse [158] 1.0% ------------------------------------------------------------------------------ loop [38] 100.0% [41] 2514(2.8%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [47] 100.0% ------------------------------------------------------------------------------ loop [38] 100.0% [42] 1411(1.6%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [47] 100.0% ------------------------------------------------------------------------------ loop [132] 33.1% mk-egraph [39] 66.9% [43] 547(0.6%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [132] 100.0% ------------------------------------------------------------------------------ match-e [44] 30.2% one-iter [40] 69.8% [44] 23772(26.5%) 6709(7.5%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [44] 30.2% variable? [51] 7.3% do-procedure-reduce-keyword-arity [57] 7.1% ??? [67] 6.7% ??? [52] 5.9% loop [132] 4.7% list-cartesian-product [53] 4.1% make-sequence [159] 2.9% reverse [158] 1.8% pack-leader [162] 1.2% filter [161] 0.6% ------------------------------------------------------------------------------ merge-egraph-nodes! [45] 2.4% one-iter [40] 97.6% [45] 5820(6.5%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [50] 64.7% loop! [135] 18.8% enode-merge! [54] 9.4% update-en-expr [152] 4.7% merge-egraph-nodes! [45] 2.4% ------------------------------------------------------------------------------ substitute-e [46] 10.9% one-iter [40] 89.1% [46] 5582(6.2%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [49] 79.9% substitute-e [46] 10.9% ??? [67] 4.2% reverse [158] 2.5% variable? [51] 2.5% ------------------------------------------------------------------------------ loop [42] 36.0% mk-min [41] 64.0% [47] 3924(4.4%) 278(0.3%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [68] 57.0% compile [103] 21.6% ...sting/src/common.rkt:47:2 [72] 14.3% ------------------------------------------------------------------------------ one-iter [40] 100.0% [48] 3070(3.4%) 3070(3.4%) custom-set-member? ...t/private/set-types.rkt:45:0 ------------------------------------------------------------------------------ loop [132] 4.9% substitute-e [46] 39.9% one-iter [40] 55.2% [49] 11191(12.5%) 838(0.9%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [55] 90.2% set-add! [108] 2.4% ------------------------------------------------------------------------------ one-iter [40] 29.9% merge-egraph-nodes! [45] 70.1% [50] 5575(6.2%) 1107(1.2%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [56] 60.0% update-en-expr [152] 10.0% make-sequence [159] 5.1% custom-set-union! [60] 5.0% ------------------------------------------------------------------------------ substitute-e [46] 6.6% match-e [44] 93.4% [51] 4188(4.7%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [67] 100.0% ------------------------------------------------------------------------------ match-e [44] 100.0% [52] 1407(1.6%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [58] 60.3% do-procedure-reduce-keyword-arity [57] 39.7% ------------------------------------------------------------------------------ match-e [44] 100.0% [53] 1125(1.3%) 568(0.6%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [159] 49.5% ------------------------------------------------------------------------------ merge-egraph-nodes! [45] 100.0% [54] 546(0.6%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [59] 51.4% adopt-enode! [61] 48.6% ------------------------------------------------------------------------------ mk-enode! [49] 100.0% [55] 10090(11.2%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [62] 97.2% make-imperative-set [65] 2.8% ------------------------------------------------------------------------------ update-leader! [50] 100.0% [56] 3344(3.7%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [63] 100.0% ------------------------------------------------------------------------------ ??? [52] 22.2% match-e [44] 77.8% [57] 2515(2.8%) 2236(2.5%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [64] 11.1% ------------------------------------------------------------------------------ ??? [52] 100.0% [58] 848(0.9%) 568(0.6%) do-curry ...cket/collects/racket/function.rkt:71:2 procedure-keywords [64] 33.1% ------------------------------------------------------------------------------ enode-merge! [54] 100.0% [59] 280(0.3%) 280(0.3%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------ update-leader! [50] 100.0% [60] 279(0.3%) 279(0.3%) custom-set-union! ...t/private/set-types.rkt:245:0 ------------------------------------------------------------------------------ enode-merge! [54] 100.0% [61] 265(0.3%) 0(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [140] 100.0% ------------------------------------------------------------------------------ new-enode [55] 100.0% [62] 9812(10.9%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [66] 100.0% ------------------------------------------------------------------------------ do-hash-update [56] 100.0% [63] 3344(3.7%) 2792(3.1%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 reverse [158] 8.3% update-en-expr [152] 8.2% ------------------------------------------------------------------------------ do-procedure-reduce-keyword-arity [57] 49.9% do-curry [58] 50.1% [64] 560(0.6%) 560(0.6%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------ new-enode [55] 100.0% [65] 278(0.3%) 278(0.3%) make-imperative-set ...private/set-types.rkt:954:0 ------------------------------------------------------------------------------ type-of-enode-expr [62] 100.0% [66] 9812(10.9%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [68] 39.9% ??? [69] 25.7% ...sting/src/common.rkt:47:2 [72] 22.8% ??? [67] 11.5% ------------------------------------------------------------------------------ ??? [107] 1.7% substitute-e [46] 3.5% get-sigs [66] 7.0% choose-best-alt! [26] 8.6% match-e [44] 20.8% variable? [51] 25.9% finalize-iter! [24] 32.6% [67] 16192(18.1%) 282(0.3%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [70] 55.4% atab-add-altns [71] 32.6% atab-pick-alt [74] 8.6% ??? [107] 1.7% ------------------------------------------------------------------------------ f53 [128] 4.4% expression-cost [47] 34.7% get-sigs [66] 60.9% [68] 6434(7.2%) 284(0.3%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [76] 78.1% set-add! [108] 8.7% ??? [75] 4.4% ...sting/src/common.rkt:47:2 [72] 4.3% ------------------------------------------------------------------------------ get-sigs [66] 100.0% [69] 2524(2.8%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [73] 77.7% handle-the-hash [85] 22.3% ------------------------------------------------------------------------------ ??? [67] 100.0% [70] 8965(10.0%) 7840(8.7%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [76] 12.5% ------------------------------------------------------------------------------ ??? [67] 100.0% [71] 5279(5.9%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [77] 100.0% ------------------------------------------------------------------------------ ??? [80] 4.6% table-ref [68] 9.0% expression-cost [47] 18.3% get-sigs [66] 68.2% [72] 3080(3.4%) 560(0.6%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [78] 63.9% ??? [80] 22.6% ------------------------------------------------------------------------------ ??? [69] 100.0% [73] 1962(2.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [79] 100.0% ------------------------------------------------------------------------------ ??? [67] 100.0% [74] 1394(1.6%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 ??? [97] 40.4% point-best-alt [81] 39.7% errors [90] 19.9% ------------------------------------------------------------------------------ table-ref [68] 100.0% [75] 283(0.3%) 283(0.3%) ??? ...cts/racket/contract/private/list.rkt:211:14 ------------------------------------------------------------------------------ hash-has-key? [70] 18.3% table-ref [68] 81.7% [76] 6153(6.9%) 3363(3.7%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [83] 27.2% handle-the-hash [85] 13.5% do-chaperone-procedure [87] 4.6% ------------------------------------------------------------------------------ atab-add-altns [71] 100.0% [77] 5279(5.9%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [82] 84.2% override-at-pnts [86] 10.5% remove-chnged-pnts [89] 5.3% ------------------------------------------------------------------------------ ??? [91] 21.5% ...sting/src/common.rkt:47:2 [72] 78.5% [78] 1968(2.2%) 1118(1.2%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [91] 35.8% ??? [107] 14.4% ------------------------------------------------------------------------------ ??? [73] 100.0% [79] 1962(2.2%) 282(0.3%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [84] 71.3% ??? [88] 14.3% ------------------------------------------------------------------------------ ...sting/src/common.rkt:47:2 [72] 100.0% [80] 836(0.9%) 278(0.3%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 ...sting/src/common.rkt:47:2 [72] 33.8% return/no-unsupplied [150] 32.9% ------------------------------------------------------------------------------ atab-pick-alt [74] 100.0% [81] 553(0.6%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [132] 100.0% ------------------------------------------------------------------------------ atab-add-altn [77] 100.0% [82] 4446(5.0%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [90] 100.0% ------------------------------------------------------------------------------ ??? [76] 100.0% [83] 1674(1.9%) 1112(1.2%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 update-the-info [93] 17.1% make-keyword-procedure [96] 16.5% ------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [79] 100.0% [84] 1400(1.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [92] 100.0% ------------------------------------------------------------------------------ ??? [69] 40.3% ??? [76] 59.7% [85] 1396(1.6%) 554(0.6%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [91] 60.4% ------------------------------------------------------------------------------ atab-add-altn [77] 100.0% [86] 554(0.6%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [90] 100.0% ------------------------------------------------------------------------------ ??? [76] 100.0% [87] 282(0.3%) 0(0.0%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [94] 100.0% ------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [79] 100.0% [88] 280(0.3%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:44 do-blame-add-context [95] 100.0% ------------------------------------------------------------------------------ atab-add-altn [77] 100.0% [89] 278(0.3%) 0(0.0%) remove-chnged-pnts ...src/core/alt-table.rkt:167:0 loop [132] 100.0% ------------------------------------------------------------------------------ atab-pick-alt [74] 2.4% override-at-pnts [86] 4.7% composed [154] 7.2% pred [19] 21.6% loop [132] 26.2% best-and-tied-at-points [82] 37.9% [90] 11721(13.1%) 554(0.6%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [134] 47.6% eval-prog [98] 28.6% ??? [97] 11.9% ulp-difference [100] 7.2% ------------------------------------------------------------------------------ handle-the-hash [85] 42.8% ??? [78] 57.2% [91] 1969(2.2%) 566(0.6%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [78] 42.9% ??? [101] 28.3% ------------------------------------------------------------------------------ ??? [84] 100.0% [92] 1400(1.6%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [99] 100.0% ------------------------------------------------------------------------------ ??? [83] 100.0% [93] 287(0.3%) 287(0.3%) update-the-info ...ontract/private/blame.rkt:318:0 ------------------------------------------------------------------------------ do-chaperone-procedure [87] 100.0% [94] 282(0.3%) 282(0.3%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 ------------------------------------------------------------------------------ ??? [88] 100.0% [95] 280(0.3%) 280(0.3%) do-blame-add-context ...ct/private/blame.rkt:192:0 ------------------------------------------------------------------------------ ??? [83] 100.0% [96] 276(0.3%) 276(0.3%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------ f53 [128] 3.8% atab-pick-alt [74] 7.8% loop [104] 17.5% taylor-alt [30] 17.5% errors [90] 19.2% loop [132] 34.3% [97] 7259(8.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:375:33 ->flonum [102] 49.3% loop [104] 17.5% approximate [105] 17.5% best-alt [109] 7.8% real->bigfloat [110] 4.2% ??? [107] 3.8% ------------------------------------------------------------------------------ option-on-expr [2] 4.8% make-exacts* [31] 38.4% errors [90] 56.8% [98] 5902(6.6%) 3362(3.7%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [103] 38.4% f53 [128] 4.7% ------------------------------------------------------------------------------ ??? [92] 100.0% [99] 1400(1.6%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [106] 100.0% ------------------------------------------------------------------------------ errors [90] 100.0% [100] 841(0.9%) 561(0.6%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 set-add! [108] 33.3% ------------------------------------------------------------------------------ ??? [91] 100.0% [101] 558(0.6%) 558(0.6%) ??? ...ects/racket/contract/private/list.rkt:763:7 ------------------------------------------------------------------------------ ??? [97] 100.0% [102] 3578(4.0%) 1688(1.9%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [150] 37.3% list-member? [113] 15.5% ------------------------------------------------------------------------------ expression-cost [47] 27.3% eval-prog [98] 72.7% [103] 3113(3.5%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [117] 100.0% ------------------------------------------------------------------------------ ??? [97] 19.4% loop [104] 80.6% [104] 2538(2.8%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [104] 80.6% ??? [97] 19.4% ------------------------------------------------------------------------------ ??? [97] 100.0% [105] 2538(2.8%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [111] 66.7% taylor [114] 33.3% ------------------------------------------------------------------------------ get/build-late-neg-projection [99] 100.0% [106] 1400(1.6%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [112] 79.9% reverse [158] 20.1% ------------------------------------------------------------------------------ ??? [67] 24.3% ??? [97] 24.7% ??? [78] 50.9% [107] 1116(1.2%) 0(0.0%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [115] 50.9% ??? [67] 24.7% dict? [116] 24.3% ------------------------------------------------------------------------------ mk-enode! [49] 23.8% ulp-difference [100] 25.3% table-ref [68] 50.9% [108] 1106(1.2%) 1106(1.2%) set-add! ...lects/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------ ??? [97] 100.0% [109] 564(0.6%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [144] 100.0% ------------------------------------------------------------------------------ ??? [97] 100.0% [110] 304(0.3%) 0(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [160] 100.0% ------------------------------------------------------------------------------ approximate [105] 100.0% [111] 1692(1.9%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [117] 100.0% ------------------------------------------------------------------------------ contract-struct-name [118] 24.8% ??? [106] 75.2% [112] 1118(1.2%) 284(0.3%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [118] 87.3% ------------------------------------------------------------------------------ ->flonum [102] 49.7% one-iter [40] 50.3% [113] 1117(1.2%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [119] 100.0% ------------------------------------------------------------------------------ taylor [114] 16.6% approximate [105] 83.4% [114] 845(0.9%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor-invert [120] 33.5% taylor-log [122] 33.4% taylor [114] 16.6% loop [132] 16.6% ------------------------------------------------------------------------------ ??? [107] 100.0% [115] 568(0.6%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [121] 50.5% simple-flat-contract? [123] 49.5% ------------------------------------------------------------------------------ ??? [107] 100.0% [116] 272(0.3%) 272(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------ simplify* [131] 2.7% localize-error [32] 5.6% ??? [127] 13.0% ??? [111] 15.7% loop [132] 20.6% compile [103] 40.5% [117] 5090(5.7%) 1406(1.6%) hash-ref! .../racket/private/more-scheme.rkt:377:2 bigfloat-hash [125] 29.9% ??? [126] 20.6% simplify [124] 15.7% ??? [127] 13.0% f53 [128] 5.6% ------------------------------------------------------------------------------ build-compound-type-name [112] 100.0% [118] 1118(1.2%) 552(0.6%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [112] 37.5% reverse [158] 25.3% ------------------------------------------------------------------------------ list-member? [113] 100.0% [119] 1117(1.2%) 1117(1.2%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------ loop [132] 49.7% taylor [114] 50.3% [120] 563(0.6%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [124] 100.0% ------------------------------------------------------------------------------ contract? [115] 100.0% [121] 287(0.3%) 287(0.3%) coerce-contract/f ...ntract/private/guts.rkt:372:0 ------------------------------------------------------------------------------ taylor [114] 100.0% [122] 282(0.3%) 0(0.0%) taylor-log ...lt-testing/src/core/taylor.rkt:476:0 simplify [124] 100.0% ------------------------------------------------------------------------------ contract? [115] 100.0% [123] 282(0.3%) 282(0.3%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------ taylor-log [122] 11.1% taylor-invert [120] 22.2% hash-ref! [117] 66.7% [124] 2538(2.8%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f53 [128] 78.0% debug-print [130] 11.2% simplify* [131] 10.9% ------------------------------------------------------------------------------ hash-ref! [117] 100.0% [125] 1982(2.2%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [129] 100.0% ------------------------------------------------------------------------------ hash-ref! [117] 100.0% [126] 1679(1.9%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [132] 100.0% ------------------------------------------------------------------------------ hash-ref! [117] 100.0% [127] 1417(1.6%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [117] 100.0% ------------------------------------------------------------------------------ eval-prog [98] 0.5% eval-const-expr [7] 2.5% hash-ref! [117] 2.5% loop [132] 7.6% simplify [124] 11.4% split-table [23] 75.4% [128] 11230(12.5%) 1979(2.2%) f53 ...t/collects/racket/match/compiler.rkt:548:40 loop [132] 85.5% table-ref [68] 2.5% ??? [97] 0.5% ------------------------------------------------------------------------------ bigfloat-hash [125] 100.0% [129] 1982(2.2%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [133] 100.0% ------------------------------------------------------------------------------ make-exacts [29] 50.0% simplify [124] 50.0% [130] 566(0.6%) 566(0.6%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ------------------------------------------------------------------------------ simplify [124] 100.0% [131] 276(0.3%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [117] 100.0% ------------------------------------------------------------------------------ ??? [134] 0.0% loop [34] 0.1% iterate-egraph! [37] 0.3% taylor [114] 0.5% point-best-alt [81] 0.6% remove-chnged-pnts [89] 1.0% get-final-combination [18] 1.0% option-on-expr [2] 1.3% loop! [135] 1.5% mk-enode-rec! [43] 1.5% ??? [126] 2.2% match-e [44] 4.1% f53 [128] 6.4% loop [132] 79.5% [132] 28626(31.9%) 1114(1.2%) loop .../private/map.rkt:40:19 loop [132] 79.5% option-on-expr [2] 4.1% f53 [128] 2.3% hash-ref! [117] 2.2% errors [90] 1.9% loop! [135] 1.5% mk-enode! [49] 1.2% foldl [136] 1.1% extract-alt [137] 1.0% rloop [139] 1.0% taylor-invert [120] 0.5% mk-enode-rec! [43] 0.4% set-precompute! [3] 0.3% ??? [134] 0.1% step [138] 0.1% ??? [141] 0.0% ??? [97] 0.0% ------------------------------------------------------------------------------ bfcanonicalize [129] 100.0% [133] 1982(2.2%) 1982(2.2%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------ generic-sort/key [13] 2.0% copying-mergesort [16] 4.0% errors [90] 39.4% loop [132] 52.6% [134] 14156(15.8%) 9284(10.4%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [141] 15.9% ??? [143] 9.9% ??? [145] 4.5% loop [132] 4.2% ------------------------------------------------------------------------------ merge-egraph-nodes! [45] 11.9% loop [132] 27.9% one-iter [40] 60.2% [135] 6950(7.7%) 1400(1.6%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [140] 40.2% loop [132] 27.9% make-immutable-set [142] 11.8% ??? [146] 3.9% update-custom-set-table [147] 2.0% ------------------------------------------------------------------------------ loop [132] 100.0% [136] 556(0.6%) 278(0.3%) foldl ...et/collects/racket/private/list.rkt:248:4 check-fold [149] 50.1% ------------------------------------------------------------------------------ loop [132] 100.0% [137] 284(0.3%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [144] 100.0% ------------------------------------------------------------------------------ loop [132] 100.0% [138] 281(0.3%) 0(0.0%) step .../racket/collects/racket/function.rkt:145:9 sort [148] 100.0% ------------------------------------------------------------------------------ loop [132] 2.2% rloop [139] 97.8% [139] 278(0.3%) 278(0.3%) rloop ...ket/collects/racket/private/list.rkt:88:4 rloop [139] 97.8% ------------------------------------------------------------------------------ adopt-enode! [61] 7.9% loop! [135] 92.1% [140] 3341(3.7%) 2505(2.8%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [155] 25.0% ------------------------------------------------------------------------------ loop [132] 11.3% ??? [134] 88.7% [141] 2531(2.8%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfadd [151] 59.1% bflog [153] 40.9% ------------------------------------------------------------------------------ loop! [135] 100.0% [142] 1642(1.8%) 1388(1.5%) make-immutable-set .../private/set-types.rkt:948:0 stream? [157] 15.5% ------------------------------------------------------------------------------ ??? [134] 100.0% [143] 1397(1.6%) 1120(1.2%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [150] 19.9% ------------------------------------------------------------------------------ extract-alt [137] 33.5% best-alt [109] 66.5% [144] 848(0.9%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [154] 100.0% ------------------------------------------------------------------------------ ??? [134] 100.0% [145] 642(0.7%) 282(0.3%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [156] 56.1% ------------------------------------------------------------------------------ loop! [135] 100.0% [146] 548(0.6%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [152] 52.0% reverse [158] 48.0% ------------------------------------------------------------------------------ loop! [135] 100.0% [147] 283(0.3%) 283(0.3%) update-custom-set-table ...ate/set-types.rkt:339:0 ------------------------------------------------------------------------------ step [138] 100.0% [148] 281(0.3%) 281(0.3%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------ foldl [136] 100.0% [149] 278(0.3%) 278(0.3%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------ ??? [80] 14.6% ??? [143] 14.7% ->flonum [102] 70.7% [150] 1888(2.1%) 1054(1.2%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [161] 29.6% reverse [158] 14.6% ------------------------------------------------------------------------------ ??? [141] 100.0% [151] 1495(1.7%) 602(0.7%) bfadd ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [160] 59.7% ------------------------------------------------------------------------------ ??? [63] 19.7% merge-egraph-nodes! [45] 19.8% ??? [146] 20.4% update-leader! [50] 40.1% [152] 1394(1.6%) 838(0.9%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [159] 20.2% pack-leader [162] 19.8% ------------------------------------------------------------------------------ ??? [141] 100.0% [153] 1036(1.2%) 312(0.3%) bflog ...-lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [160] 69.9% ------------------------------------------------------------------------------ argmins [144] 100.0% [154] 848(0.9%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [90] 100.0% ------------------------------------------------------------------------------ custom-set-union [140] 100.0% [155] 836(0.9%) 562(0.6%) choose-immutable ...et/private/set-types.rkt:151:0 set-check-compatible [163] 32.8% ------------------------------------------------------------------------------ ??? [145] 100.0% [156] 360(0.4%) 360(0.4%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------ make-immutable-set [142] 100.0% [157] 254(0.3%) 254(0.3%) stream? ...t/collects/racket/private/for.rkt:493:2 ------------------------------------------------------------------------------ ??? [146] 9.5% return/no-unsupplied [150] 9.9% ??? [63] 10.0% substitute-e [46] 10.1% ??? [106] 10.1% contract-struct-name [118] 10.1% one-iter [40] 20.0% match-e [44] 20.2% [158] 2784(3.1%) 2784(3.1%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------ update-en-expr [152] 14.3% update-leader! [50] 14.6% list-cartesian-product [53] 28.3% match-e [44] 42.8% [159] 1965(2.2%) 1678(1.9%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [164] 14.6% ------------------------------------------------------------------------------ real->bigfloat [110] 15.8% bflog [153] 37.7% bfadd [151] 46.5% [160] 1921(2.1%) 1921(2.1%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------ match-e [44] 19.7% return/no-unsupplied [150] 40.1% one-iter [40] 40.2% [161] 1392(1.6%) 1392(1.6%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------ pack-leader [162] 24.6% update-en-expr [152] 24.6% match-e [44] 50.9% [162] 562(0.6%) 562(0.6%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 pack-leader [162] 24.6% ------------------------------------------------------------------------------ choose-immutable [155] 100.0% [163] 274(0.3%) 274(0.3%) set-check-compatible ...rivate/set-types.rkt:531:0 ------------------------------------------------------------------------------ make-sequence [159] 100.0% [164] 286(0.3%) 286(0.3%) :hash-gen ...collects/racket/private/for.rkt:781:4 ------------------------------------------------------------------------------