Profiling results ----------------- Total cpu time observed: 78304ms (out of 78844ms) Number of samples taken: 267 (once every 293ms) (Hiding functions with self<1.0% and local<2.0%: 5 of 172 hidden) ======================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ======================================================================================== [1] 78304(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [6] 100.0% ---------------------------------------------------------------------------------------- loop [156] 100.0% [2] 16670(21.3%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [7] 45.8% sort-context-on-expr [8] 21.0% loop [156] 20.9% err-lsts->split-indices [10] 12.3% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [3] 2616(3.3%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [9] 83.4% hash-ref! [138] 16.6% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [4] 293(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 ??? [11] 100.0% ---------------------------------------------------------------------------------------- loop [5] 50.0% loop [156] 50.0% [5] 290(0.4%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:40:19 loop [5] 50.0% ...row-higher-order.rkt:375:33 [105] 50.0% ---------------------------------------------------------------------------------------- ??? [1] 100.0% [6] 78304(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [12] 100.0% ---------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [7] 7628(9.7%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [13] 100.0% ---------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [8] 3502(4.5%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [14] 100.0% ---------------------------------------------------------------------------------------- ??? [3] 100.0% [9] 2616(3.3%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [10] 2048(2.6%) 881(1.1%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [15] 42.7% check-list [147] 14.3% ---------------------------------------------------------------------------------------- ??? [4] 100.0% [11] 293(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- profile-thunk [6] 100.0% [12] 78304(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [16] 100.0% ---------------------------------------------------------------------------------------- f8 [152] 0.0% loop [13] 30.2% sindices->spoints [7] 69.8% [13] 7919(10.1%) 0(0.0%) loop .../private/map.rkt:54:19 sidx->spoint [17] 69.8% loop [13] 30.2% ...row-higher-order.rkt:375:33 [105] 0.0% ---------------------------------------------------------------------------------------- sort-context-on-expr [8] 100.0% [14] 3502(4.5%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [18] 100.0% ---------------------------------------------------------------------------------------- err-lsts->split-indices [10] 100.0% [15] 874(1.1%) 874(1.1%) ??? ...e/racket/collects/racket/function.rkt:93:12 ---------------------------------------------------------------------------------------- ??? [12] 100.0% [16] 78304(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [19] 88.9% prepare-points [29] 11.1% ---------------------------------------------------------------------------------------- loop [13] 100.0% [17] 7628(9.7%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [20] 100.0% ---------------------------------------------------------------------------------------- ??? [14] 100.0% [18] 3502(4.5%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [21] 91.7% ??? [100] 8.3% ---------------------------------------------------------------------------------------- ??? [16] 100.0% [19] 69630(88.9%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [22] 71.8% get-final-combination [23] 24.4% setup-alt-simplified [25] 3.0% setup-prog! [26] 0.4% ??? [74] 0.4% ---------------------------------------------------------------------------------------- sidx->spoint [17] 100.0% [20] 7628(9.7%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [24] 100.0% ---------------------------------------------------------------------------------------- generic-sort/key [18] 38.5% copying-mergesort [21] 61.5% [21] 3210(4.1%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [21] 61.5% ??? [100] 34.9% ...row-higher-order.rkt:375:33 [105] 3.6% ---------------------------------------------------------------------------------------- run-improve [19] 100.0% [22] 50022(63.9%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [27] 79.6% finalize-iter! [30] 9.9% gen-series! [31] 6.4% choose-best-alt! [33] 2.9% localize! [34] 1.2% ---------------------------------------------------------------------------------------- run-improve [19] 100.0% [23] 16959(21.7%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [28] 100.0% ---------------------------------------------------------------------------------------- binary-search-floats [20] 100.0% [24] 7628(9.7%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [29] 73.0% errors [96] 23.2% errors-score [35] 3.9% ---------------------------------------------------------------------------------------- run-improve [19] 100.0% [25] 2060(2.6%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [32] 100.0% ---------------------------------------------------------------------------------------- run-improve [19] 100.0% [26] 297(0.4%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [29] 100.0% ---------------------------------------------------------------------------------------- run-iter! [22] 100.0% [27] 39817(50.8%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [36] 100.0% ---------------------------------------------------------------------------------------- get-final-combination [23] 100.0% [28] 16959(21.7%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [152] 98.3% ??? [74] 1.7% ---------------------------------------------------------------------------------------- setup-prog! [26] 2.0% pred [24] 38.3% ??? [16] 59.7% [29] 14536(18.6%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [43] 47.4% make-exacts [37] 22.3% make-exacts* [39] 18.1% ??? [40] 10.2% debug [132] 2.0% ---------------------------------------------------------------------------------------- run-iter! [22] 100.0% [30] 4967(6.3%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [74] 100.0% ---------------------------------------------------------------------------------------- run-iter! [22] 100.0% [31] 3202(4.1%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [38] 100.0% ---------------------------------------------------------------------------------------- setup-alt-simplified [25] 100.0% [32] 2060(2.6%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [42] 100.0% ---------------------------------------------------------------------------------------- run-iter! [22] 100.0% [33] 1456(1.9%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [74] 100.0% ---------------------------------------------------------------------------------------- run-iter! [22] 100.0% [34] 581(0.7%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [41] 100.0% ---------------------------------------------------------------------------------------- pred [24] 100.0% [35] 296(0.4%) 0(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 loop [156] 100.0% ---------------------------------------------------------------------------------------- simplify! [27] 100.0% [36] 39817(50.8%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [42] 100.0% ---------------------------------------------------------------------------------------- prepare-points [29] 100.0% [37] 3244(4.1%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [43] 91.0% debug-print [154] 9.0% ---------------------------------------------------------------------------------------- gen-series! [31] 100.0% [38] 3202(4.1%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [105] 100.0% ---------------------------------------------------------------------------------------- prepare-points [29] 100.0% [39] 2636(3.4%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [101] 100.0% ---------------------------------------------------------------------------------------- prepare-points [29] 100.0% [40] 1479(1.9%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ...row-higher-order.rkt:375:33 [105] 100.0% ---------------------------------------------------------------------------------------- localize! [34] 100.0% [41] 581(0.7%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- simplify-alt [32] 4.9% ??? [36] 95.1% [42] 41876(53.5%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [44] 99.3% *simplify-rules* [45] 0.7% ---------------------------------------------------------------------------------------- make-exacts [37] 30.0% prepare-points [29] 70.0% [43] 9840(12.6%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [156] 100.0% ---------------------------------------------------------------------------------------- simplify [42] 100.0% [44] 41593(53.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [46] 90.8% loop [47] 9.2% ---------------------------------------------------------------------------------------- simplify [42] 100.0% [45] 284(0.4%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [48] 100.0% ---------------------------------------------------------------------------------------- ??? [44] 100.0% [46] 37780(48.2%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [49] 98.4% loop [156] 1.6% ---------------------------------------------------------------------------------------- ??? [44] 100.0% [47] 3813(4.9%) 290(0.4%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 loop [50] 61.9% mk-min [51] 30.5% ---------------------------------------------------------------------------------------- *simplify-rules* [45] 100.0% [48] 284(0.4%) 284(0.4%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ---------------------------------------------------------------------------------------- iterate-egraph! [46] 100.0% [49] 37188(47.5%) 1432(1.8%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [52] 39.8% merge-egraph-nodes! [53] 13.4% custom-set-member? [55] 9.4% loop! [158] 9.4% substitute-e [56] 7.0% mk-enode! [57] 7.0% list-member? [122] 4.7% in-set [123] 2.3% pack-leader [68] 0.8% update-leader! [58] 0.8% reverse [164] 0.8% ---------------------------------------------------------------------------------------- loop [47] 100.0% [50] 2360(3.0%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [54] 100.0% ---------------------------------------------------------------------------------------- loop [47] 100.0% [51] 1163(1.5%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [54] 100.0% ---------------------------------------------------------------------------------------- match-e [52] 22.4% one-iter [49] 77.6% [52] 14794(18.9%) 4039(5.2%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [52] 22.4% make-sequence [167] 8.7% custom-in-set [61] 7.8% reverse [164] 6.9% ??? [74] 5.9% variable? [59] 5.3% ??? [60] 4.9% list-cartesian-product [62] 4.9% in-set [123] 3.9% loop [156] 2.0% do-procedure-reduce-keyword-arity [67] 1.0% ---------------------------------------------------------------------------------------- merge-egraph-nodes! [53] 12.8% one-iter [49] 87.2% [53] 4969(6.3%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [58] 55.2% loop! [158] 26.4% merge-egraph-nodes! [53] 12.8% enode-merge! [64] 5.7% ---------------------------------------------------------------------------------------- mk-min [51] 33.0% loop [50] 67.0% [54] 3523(4.5%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [75] 50.3% dict-ref-contract [121] 33.2% compile [63] 16.5% ---------------------------------------------------------------------------------------- one-iter [49] 100.0% [55] 3510(4.5%) 3510(4.5%) custom-set-member? ...t/private/set-types.rkt:45:0 ---------------------------------------------------------------------------------------- substitute-e [56] 27.8% one-iter [49] 72.2% [56] 2614(3.3%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [57] 44.3% substitute-e [56] 27.8% ??? [74] 12.9% make-sequence [167] 11.3% variable? [59] 3.7% ---------------------------------------------------------------------------------------- substitute-e [56] 30.8% one-iter [49] 69.2% [57] 3760(4.8%) 567(0.7%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [65] 84.9% ---------------------------------------------------------------------------------------- one-iter [49] 9.0% merge-egraph-nodes! [53] 91.0% [58] 3228(4.1%) 588(0.8%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [66] 63.7% pack-leader [68] 9.2% update-en-expr [165] 8.9% ---------------------------------------------------------------------------------------- substitute-e [56] 14.3% match-e [52] 85.7% [59] 2052(2.6%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [74] 100.0% ---------------------------------------------------------------------------------------- match-e [52] 100.0% [60] 1166(1.5%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [67] 50.0% do-curry [69] 50.0% ---------------------------------------------------------------------------------------- match-e [52] 100.0% [61] 1155(1.5%) 1155(1.5%) custom-in-set ...acket/private/set-types.rkt:580:0 ---------------------------------------------------------------------------------------- list-cartesian-product [62] 50.0% match-e [52] 50.0% [62] 868(1.1%) 0(0.0%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [62] 50.0% make-sequence [167] 50.0% ---------------------------------------------------------------------------------------- expression-cost [54] 100.0% [63] 582(0.7%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- merge-egraph-nodes! [53] 100.0% [64] 284(0.4%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [70] 100.0% ---------------------------------------------------------------------------------------- mk-enode! [57] 100.0% [65] 3194(4.1%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [71] 100.0% ---------------------------------------------------------------------------------------- update-leader! [58] 100.0% [66] 2057(2.6%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [72] 100.0% ---------------------------------------------------------------------------------------- match-e [52] 33.6% ??? [60] 66.4% [67] 878(1.1%) 878(1.1%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 ---------------------------------------------------------------------------------------- pack-leader [68] 25.0% update-leader! [58] 25.0% one-iter [49] 50.0% [68] 592(0.8%) 592(0.8%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 pack-leader [68] 25.0% ---------------------------------------------------------------------------------------- ??? [60] 100.0% [69] 583(0.7%) 583(0.7%) do-curry ...cket/collects/racket/function.rkt:71:2 ---------------------------------------------------------------------------------------- enode-merge! [64] 100.0% [70] 284(0.4%) 0(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [161] 100.0% ---------------------------------------------------------------------------------------- new-enode [65] 100.0% [71] 3194(4.1%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [73] 100.0% ---------------------------------------------------------------------------------------- do-hash-update [66] 100.0% [72] 2057(2.6%) 2057(2.6%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 ---------------------------------------------------------------------------------------- type-of-enode-expr [71] 100.0% [73] 3194(4.1%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [76] 45.1% ??? [74] 18.6% dict-ref-contract [121] 18.4% table-ref [75] 18.0% ---------------------------------------------------------------------------------------- split-table [28] 2.3% run-improve [19] 2.3% ??? [139] 3.5% get-sigs [73] 4.7% substitute-e [56] 6.9% choose-best-alt! [33] 10.4% match-e [52] 13.9% variable? [59] 16.3% finalize-iter! [30] 39.5% [74] 12567(16.0%) 591(0.8%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [78] 41.8% hash-has-key? [77] 40.7% atab-pick-alt [79] 10.4% split-atab [81] 2.3% ---------------------------------------------------------------------------------------- ->bf [119] 11.0% get-sigs [73] 21.7% expression-cost [54] 67.3% [75] 2637(3.4%) 894(1.1%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [83] 66.1% ---------------------------------------------------------------------------------------- get-sigs [73] 100.0% [76] 1439(1.8%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [80] 60.0% handle-the-hash [90] 40.0% ---------------------------------------------------------------------------------------- ??? [74] 100.0% [77] 5266(6.7%) 4091(5.2%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [83] 22.3% ---------------------------------------------------------------------------------------- ??? [74] 100.0% [78] 5258(6.7%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [82] 100.0% ---------------------------------------------------------------------------------------- ??? [74] 100.0% [79] 1456(1.9%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [85] 39.7% write-json* [86] 20.2% errors [96] 20.1% ...row-higher-order.rkt:375:33 [105] 20.0% ---------------------------------------------------------------------------------------- ??? [76] 100.0% [80] 863(1.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [84] 100.0% ---------------------------------------------------------------------------------------- ??? [74] 100.0% [81] 289(0.4%) 0(0.0%) split-atab ...testing/src/core/alt-table.rkt:105:0 ??? [87] 100.0% ---------------------------------------------------------------------------------------- atab-add-altns [78] 100.0% [82] 5258(6.7%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [88] 94.4% minimize-alts [95] 5.6% ---------------------------------------------------------------------------------------- hash-has-key? [77] 40.3% table-ref [75] 59.7% [83] 2918(3.7%) 868(1.1%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [91] 20.2% handle-the-hash [90] 20.0% successfully-got-the-right-kind-of-function [92] 19.9% do-chaperone-procedure [93] 10.2% ---------------------------------------------------------------------------------------- ??? [80] 100.0% [84] 863(1.1%) 863(1.1%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ---------------------------------------------------------------------------------------- atab-pick-alt [79] 100.0% [85] 578(0.7%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [156] 100.0% ---------------------------------------------------------------------------------------- atab-pick-alt [79] 100.0% [86] 294(0.4%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [94] 100.0% ---------------------------------------------------------------------------------------- split-atab [81] 100.0% [87] 289(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:302:4 ??? [89] 100.0% ---------------------------------------------------------------------------------------- atab-add-altn [82] 100.0% [88] 4965(6.3%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [96] 94.1% ??? [98] 5.9% ---------------------------------------------------------------------------------------- ??? [87] 24.8% loop [156] 75.2% [89] 1164(1.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [100] 100.0% ---------------------------------------------------------------------------------------- ??? [76] 49.6% ??? [83] 50.4% [90] 1160(1.5%) 290(0.4%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [136] 75.0% ---------------------------------------------------------------------------------------- ??? [83] 100.0% [91] 588(0.8%) 588(0.8%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 ---------------------------------------------------------------------------------------- ??? [83] 100.0% [92] 580(0.7%) 290(0.4%) successfully-got-the-right-kind-of-function ...5:4 arity-checking-wrapper [99] 50.0% ---------------------------------------------------------------------------------------- ??? [83] 100.0% [93] 297(0.4%) 297(0.4%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 ---------------------------------------------------------------------------------------- write-json* [86] 25.0% loop [94] 75.0% [94] 294(0.4%) 294(0.4%) loop .../share/racket/collects/json/main.rkt:132:2 loop [94] 75.0% ---------------------------------------------------------------------------------------- atab-add-altn [82] 100.0% [95] 294(0.4%) 0(0.0%) minimize-alts ...ting/src/core/alt-table.rkt:193:0 rm-alts [97] 100.0% ---------------------------------------------------------------------------------------- composed [134] 2.9% atab-pick-alt [79] 2.9% pred [24] 17.8% loop [156] 29.3% best-and-tied-at-points [88] 47.1% [96] 9928(12.7%) 298(0.4%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [100] 70.5% eval-prog [101] 17.7% ulp-difference [102] 3.0% ...row-higher-order.rkt:375:33 [105] 3.0% flonums-between [103] 2.9% ---------------------------------------------------------------------------------------- minimize-alts [95] 100.0% [97] 294(0.4%) 0(0.0%) rm-alts ...lt-testing/src/core/alt-table.rkt:222:0 loop [156] 100.0% ---------------------------------------------------------------------------------------- best-and-tied-at-points [88] 100.0% [98] 293(0.4%) 293(0.4%) ??? ...ket/collects/racket/private/for.rkt:1280:14 ---------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [92]100.0% [99] 290(0.4%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:443:0 procedure-keywords [104] 100.0% ---------------------------------------------------------------------------------------- generic-sort/key [18] 1.4% ??? [89] 5.7% copying-mergesort [21] 12.9% errors [96] 34.5% loop [156] 45.4% [100] 20314(25.9%) 8596(11.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [156] 35.1% bf* [106] 4.8% ??? [107] 4.3% ??? [108] 3.1% ??? [109] 2.9% ??? [145] 2.9% ??? [116] 1.5% ---------------------------------------------------------------------------------------- errors [96] 39.9% make-exacts* [39] 60.1% [101] 4390(5.6%) 3219(4.1%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 ...row-higher-order.rkt:375:33 [105] 13.4% f8 [152] 6.7% kw-chaperone [111] 6.6% ---------------------------------------------------------------------------------------- errors [96] 100.0% [102] 295(0.4%) 0(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 list-member? [122] 100.0% ---------------------------------------------------------------------------------------- errors [96] 100.0% [103] 290(0.4%) 0(0.0%) flonums-between ...te/flonum/flonum-bits.rkt:103:2 flonum->ordinal [110] 100.0% ---------------------------------------------------------------------------------------- arity-checking-wrapper [99] 100.0% [104] 290(0.4%) 290(0.4%) procedure-keywords .../racket/private/kw.rkt:534:2 ---------------------------------------------------------------------------------------- loop [5] 2.0% loop [13] 2.0% atab-pick-alt [79] 2.0% f8 [152] 2.0% errors [96] 2.0% copying-mergesort [21] 3.9% eval-prog [101] 4.0% ??? [40] 10.0% loop [113] 10.8% taylor-alt [38] 10.8% loop [156] 50.5% [105] 14756(18.8%) 289(0.4%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 ->flonum [112] 41.6% real->bigfloat [115] 14.8% loop [113] 10.8% approximate [114] 10.8% sample-multi-bounded [117] 8.0% ??? [139] 6.0% ??? [136] 2.0% best-alt [118] 2.0% ->bf [119] 2.0% ---------------------------------------------------------------------------------------- ??? [100] 100.0% [106] 984(1.3%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [116] 100.0% ---------------------------------------------------------------------------------------- ??? [100] 100.0% [107] 876(1.1%) 587(0.7%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 dict-ref-contract [121] 33.0% ---------------------------------------------------------------------------------------- ??? [100] 100.0% [108] 623(0.8%) 623(0.8%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ---------------------------------------------------------------------------------------- ??? [100] 100.0% [109] 591(0.8%) 298(0.4%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [136] 49.7% ---------------------------------------------------------------------------------------- flonums-between [103] 100.0% [110] 290(0.4%) 290(0.4%) flonum->ordinal ...ate/flonum/flonum-bits.rkt:68:0 ---------------------------------------------------------------------------------------- eval-prog [101] 100.0% [111] 290(0.4%) 0(0.0%) kw-chaperone ...ects/racket/private/kw.rkt:2036:33 ...row-higher-order.rkt:387:44 [120] 100.0% ---------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [105] 100.0% [112] 6145(7.8%) 2933(3.7%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 dict-ref-contract [121] 19.1% return/no-unsupplied [140] 14.4% in-set [123] 9.4% list-member? [122] 9.4% ---------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [105] 15.8% loop [113] 84.2% [113] 3202(4.1%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [113] 84.2% ...row-higher-order.rkt:375:33 [105] 15.8% ---------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [105] 100.0% [114] 3202(4.1%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [138] 81.7% taylor [125] 9.3% f8 [152] 9.0% ---------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [105] 100.0% [115] 2179(2.8%) 0(0.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [129] 100.0% ---------------------------------------------------------------------------------------- ??? [100] 23.3% bf* [106] 76.7% [116] 1282(1.6%) 316(0.4%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfdiv [124] 75.3% ---------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [105] 100.0% [117] 1182(1.5%) 594(0.8%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [126] 49.8% ---------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [105] 100.0% [118] 291(0.4%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [127] 100.0% ---------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [105] 100.0% [119] 290(0.4%) 0(0.0%) ->bf ...s/herbie/alt-testing/src/programs.rkt:53:0 table-ref [75] 100.0% ---------------------------------------------------------------------------------------- kw-chaperone [111] 100.0% [120] 290(0.4%) 290(0.4%) ...row-higher-order.rkt:387:44 ...order.rkt:387:44 ---------------------------------------------------------------------------------------- ??? [107] 9.0% get-sigs [73] 18.3% expression-cost [54] 36.3% ->flonum [112] 36.4% [121] 3218(4.1%) 1172(1.5%) dict-ref-contract ...ract/private/arr-i.rkt:976:19 ??? [130] 45.4% ??? [133] 9.2% ??? [139] 9.0% ---------------------------------------------------------------------------------------- ulp-difference [102] 11.2% ->flonum [112] 21.9% one-iter [49] 66.9% [122] 2638(3.4%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [128] 100.0% ---------------------------------------------------------------------------------------- match-e [52] 28.8% ->flonum [112] 28.8% one-iter [49] 42.3% [123] 2013(2.6%) 2013(2.6%) in-set ...ollects/racket/private/generic.rkt:472:9 ---------------------------------------------------------------------------------------- ??? [116] 100.0% [124] 966(1.2%) 667(0.9%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [129] 31.0% ---------------------------------------------------------------------------------------- f8 [152] 8.5% approximate [114] 8.5% taylor [125] 17.1% hash-ref! [138] 65.9% [125] 870(1.1%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 debug [132] 33.6% normalize-series [135] 32.3% taylor [125] 17.1% f8 [152] 8.5% taylor-invert [131] 8.5% ---------------------------------------------------------------------------------------- sample-multi-bounded [117] 41.7% random-exp [126] 58.3% [126] 588(0.8%) 588(0.8%) random-exp ...bie/alt-testing/src/common.rkt:253:0 random-exp [126] 58.3% ---------------------------------------------------------------------------------------- best-alt [118] 100.0% [127] 291(0.4%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [134] 100.0% ---------------------------------------------------------------------------------------- list-member? [122] 100.0% [128] 2638(3.4%) 2638(3.4%) member ...collects/racket/private/member.rkt:13:21 ---------------------------------------------------------------------------------------- bfdiv [124] 12.1% real->bigfloat [115] 87.9% [129] 2478(3.2%) 2478(3.2%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ---------------------------------------------------------------------------------------- ??? [136] 10.2% dict-ref-contract [121] 89.8% [130] 1460(1.9%) 868(1.1%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [136] 30.3% ??? [139] 10.2% ---------------------------------------------------------------------------------------- f8 [152] 49.4% taylor [125] 50.6% [131] 586(0.7%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [142] 100.0% ---------------------------------------------------------------------------------------- prepare-points [29] 49.7% taylor [125] 50.3% [132] 580(0.7%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [137] 100.0% ---------------------------------------------------------------------------------------- dict-ref-contract [121] 100.0% [133] 297(0.4%) 297(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 ---------------------------------------------------------------------------------------- argmins [127] 100.0% [134] 291(0.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [96] 100.0% ---------------------------------------------------------------------------------------- taylor [125] 100.0% [135] 281(0.4%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- ??? [109] 14.3% ...row-higher-order.rkt:375:33 [105] 14.5% ??? [130] 28.8% handle-the-hash [90] 42.4% [136] 2054(2.6%) 880(1.1%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [141] 28.3% ??? [130] 14.6% ??? [139] 14.3% ---------------------------------------------------------------------------------------- debug [132] 100.0% [137] 580(0.7%) 0(0.0%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 return/no-unsupplied [140] 50.3% hash-ref! [138] 49.7% ---------------------------------------------------------------------------------------- ??? [11] 1.2% normalize-series [135] 1.7% ??? [149] 2.3% composed [160] 3.6% ??? [146] 4.1% ??? [3] 4.8% compile [63] 5.4% cur-debug-level [137] 7.1% loop [156] 8.9% localize-error [41] 10.7% ??? [143] 13.2% ??? [9] 18.5% approximate [114] 18.5% [138] 4067(5.2%) 870(1.1%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [3] 23.3% simplify [142] 14.9% f8 [152] 14.3% ??? [143] 13.2% ??? [148] 8.9% taylor [125] 5.3% ??? [146] 4.1% ??? [149] 2.3% ??? [4] 1.2% ---------------------------------------------------------------------------------------- dict-ref-contract [121] 16.4% ??? [136] 16.6% ??? [130] 17.0% ...row-higher-order.rkt:375:33 [105] 50.0% [139] 1764(2.3%) 584(0.7%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ??? [74] 33.5% contract? [150] 17.0% dict? [151] 16.4% ---------------------------------------------------------------------------------------- cur-debug-level [137] 24.9% ->flonum [112] 75.1% [140] 1174(1.5%) 292(0.4%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [144] 75.1% ---------------------------------------------------------------------------------------- ??? [136] 100.0% [141] 581(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:763:7 check-list [147] 50.8% ??? [145] 49.2% ---------------------------------------------------------------------------------------- taylor-invert [131] 20.1% hash-ref! [138] 79.9% [142] 2910(3.7%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [152] 80.3% debug-print [154] 19.7% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [143] 2043(2.6%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- return/no-unsupplied [140] 100.0% [144] 882(1.1%) 882(1.1%) filter ...t/collects/racket/private/list.rkt:275:2 ---------------------------------------------------------------------------------------- ??? [141] 32.9% ??? [100] 67.1% [145] 869(1.1%) 0(0.0%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [153] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [146] 852(1.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- err-lsts->split-indices [10] 49.8% ??? [141] 50.2% [147] 588(0.8%) 588(0.8%) check-list ...ollects/racket/private/for.rkt:690:2 ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [148] 582(0.7%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [156] 100.0% ---------------------------------------------------------------------------------------- hash-ref! [138] 100.0% [149] 570(0.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- ??? [139] 100.0% [150] 299(0.4%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [155] 100.0% ---------------------------------------------------------------------------------------- ??? [139] 100.0% [151] 290(0.4%) 290(0.4%) dict? ...ollects/racket/private/generic.rkt:146:11 ---------------------------------------------------------------------------------------- eval-prog [101] 0.4% approximate [114] 0.7% taylor [125] 0.7% hash-ref! [138] 2.9% simplify [142] 4.1% loop [156] 7.2% split-table [28] 83.9% [152] 19880(25.4%) 2336(3.0%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [156] 93.3% taylor [125] 0.7% loop [13] 0.7% taylor-invert [131] 0.7% ...row-higher-order.rkt:375:33 [105] 0.4% ---------------------------------------------------------------------------------------- ??? [145] 100.0% [153] 869(1.1%) 575(0.7%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ^TYPE? [157] 33.8% ---------------------------------------------------------------------------------------- make-exacts [37] 33.7% simplify [142] 66.3% [154] 866(1.1%) 866(1.1%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ---------------------------------------------------------------------------------------- contract? [150] 100.0% [155] 299(0.4%) 299(0.4%) coerce-contract/f ...ntract/private/guts.rkt:372:0 ---------------------------------------------------------------------------------------- rm-alts [97] 0.0% iterate-egraph! [46] 0.0% errors-score [35] 0.0% loop [43] 0.4% option-on-expr [2] 0.6% loop! [158] 0.7% match-e [52] 0.9% ??? [148] 1.0% point-best-alt [85] 1.0% ??? [100] 2.9% f8 [152] 11.4% loop [156] 81.0% [156] 33221(42.4%) 1176(1.5%) loop .../private/map.rkt:40:19 loop [156] 81.0% option-on-expr [2] 6.7% f8 [152] 4.3% ...row-higher-order.rkt:375:33 [105] 2.8% errors [96] 1.6% hash-ref! [138] 1.0% loop! [158] 0.7% composed [160] 0.4% ??? [100] 0.3% ??? [89] 0.0% loop [5] 0.0% rloop [159] 0.0% ---------------------------------------------------------------------------------------- ??? [153] 100.0% [157] 294(0.4%) 294(0.4%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ---------------------------------------------------------------------------------------- merge-egraph-nodes! [53] 21.4% loop [156] 26.2% one-iter [49] 52.5% [158] 5228(6.7%) 593(0.8%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [161] 41.2% loop [156] 26.2% ??? [162] 13.9% make-immutable-set [163] 13.0% ---------------------------------------------------------------------------------------- rloop [159] 50.0% loop [156] 50.0% [159] 294(0.4%) 294(0.4%) rloop ...ket/collects/racket/private/list.rkt:88:4 rloop [159] 50.0% ---------------------------------------------------------------------------------------- loop [156] 100.0% [160] 290(0.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [138] 100.0% ---------------------------------------------------------------------------------------- adopt-enode! [70] 11.0% loop! [158] 89.0% [161] 2582(3.3%) 1728(2.2%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [166] 33.1% ---------------------------------------------------------------------------------------- loop! [158] 100.0% [162] 1171(1.5%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [165] 50.5% reverse [164] 49.5% ---------------------------------------------------------------------------------------- loop! [158] 100.0% [163] 1166(1.5%) 1166(1.5%) make-immutable-set .../private/set-types.rkt:948:0 ---------------------------------------------------------------------------------------- one-iter [49] 12.4% ??? [162] 25.0% match-e [52] 62.6% [164] 2320(3.0%) 2320(3.0%) reverse ...collects/racket/private/reverse.rkt:6:4 ---------------------------------------------------------------------------------------- update-leader! [58] 32.7% ??? [162] 67.3% [165] 878(1.1%) 296(0.4%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [167] 66.2% ---------------------------------------------------------------------------------------- custom-set-union [161] 100.0% [166] 854(1.1%) 854(1.1%) choose-immutable ...et/private/set-types.rkt:151:0 ---------------------------------------------------------------------------------------- substitute-e [56] 9.3% update-en-expr [165] 18.3% list-cartesian-product [62] 27.3% match-e [52] 45.1% [167] 3180(4.1%) 3180(4.1%) make-sequence ...ects/racket/private/for.rkt:557:2 ----------------------------------------------------------------------------------------