Profiling results ----------------- Total cpu time observed: 761099ms (out of 762291ms) Number of samples taken: 2714 (once every 280ms) (Hiding functions with self<1.0% and local<2.0%: 26 of 282 hidden) ============================================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================================ [1] 761099(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [10] 100.0% -------------------------------------------------------------------------------------------- loop [172] 100.0% [2] 295182(38.8%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [11] 80.7% loop [172] 13.7% sort-context-on-expr [12] 4.3% err-lsts->split-indices [13] 0.8% pick-errors [17] 0.3% -------------------------------------------------------------------------------------------- hash-ref! [137] 100.0% [3] 12100(1.6%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [132] 71.4% hash-ref! [137] 28.6% -------------------------------------------------------------------------------------------- hash-ref! [137] 100.0% [4] 4503(0.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [137] 74.9% ??? [14] 25.1% -------------------------------------------------------------------------------------------- loop [172] 100.0% [5] 1966(0.3%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 combine-mterms [15] 57.1% combine-aterms [18] 28.7% gather-multiplicative-terms [20] 14.2% -------------------------------------------------------------------------------------------- taylor [180] 100.0% [6] 1408(0.2%) 0(0.0%) taylor-log ...lt-testing/src/core/taylor.rkt:476:0 simplify [161] 80.1% composed [16] 19.9% -------------------------------------------------------------------------------------------- f8 [165] 24.9% taylor [180] 75.1% [7] 1108(0.1%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [161] 100.0% -------------------------------------------------------------------------------------------- loop [8] 49.3% loop [172] 50.7% [8] 549(0.1%) 272(0.0%) loop ...cket/collects/racket/private/map.rkt:40:19 ??? [114] 50.5% loop [8] 49.3% -------------------------------------------------------------------------------------------- f8 [165] 100.0% [9] 281(0.0%) 0(0.0%) exprs-to-branch-on ...ng/src/core/regimes.rkt:42:0 all-critical-subexpressions [19] 100.0% -------------------------------------------------------------------------------------------- ??? [1] 100.0% [10] 761099(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [21] 100.0% -------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [11] 238338(31.3%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [22] 99.9% eval-prog [108] 0.1% -------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [12] 12652(1.7%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [23] 97.8% eval-prog [108] 2.2% -------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [13] 2489(0.3%) 2212(0.3%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [189] 11.1% -------------------------------------------------------------------------------------------- ??? [4] 100.0% [14] 1416(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [137] 100.0% -------------------------------------------------------------------------------------------- simplify-node [5] 100.0% [15] 1122(0.1%) 272(0.0%) combine-mterms ...esting/src/core/reduce.rkt:191:0 hash-ref! [137] 75.8% -------------------------------------------------------------------------------------------- taylor-log [6] 33.4% loop [172] 66.6% [16] 839(0.1%) 280(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [137] 66.6% -------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [17] 822(0.1%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [24] 66.6% loop [25] 33.4% -------------------------------------------------------------------------------------------- simplify-node [5] 100.0% [18] 564(0.1%) 278(0.0%) combine-aterms ...esting/src/core/reduce.rkt:183:0 hash-ref! [137] 50.7% -------------------------------------------------------------------------------------------- exprs-to-branch-on [9] 100.0% [19] 281(0.0%) 0(0.0%) all-critical-subexpressions ...re/regimes.rkt:58:0 f8 [165] 100.0% -------------------------------------------------------------------------------------------- simplify-node [5] 100.0% [20] 280(0.0%) 280(0.0%) gather-multiplicative-terms ...re/reduce.rkt:116:0 -------------------------------------------------------------------------------------------- profile-thunk [10] 100.0% [21] 761099(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [26] 100.0% -------------------------------------------------------------------------------------------- loop [22] 18.1% sindices->spoints [11] 81.9% [22] 238062(31.3%) 0(0.0%) loop .../private/map.rkt:54:19 sidx->spoint [27] 81.9% loop [22] 18.1% -------------------------------------------------------------------------------------------- sort-context-on-expr [12] 100.0% [23] 12376(1.6%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [28] 100.0% -------------------------------------------------------------------------------------------- ??? [244] 20.3% loop [172] 39.6% pick-errors [17] 40.2% [24] 1364(0.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [178] 100.0% -------------------------------------------------------------------------------------------- pick-errors [17] 0.8% loop [25] 99.2% [25] 275(0.0%) 275(0.0%) loop ...cket/collects/racket/private/map.rkt:259:4 loop [25] 99.2% -------------------------------------------------------------------------------------------- ??? [21] 100.0% [26] 761099(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [29] 87.6% prepare-points [36] 12.4% -------------------------------------------------------------------------------------------- loop [22] 100.0% [27] 238062(31.3%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [30] 100.0% -------------------------------------------------------------------------------------------- ??? [23] 100.0% [28] 12376(1.6%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [31] 91.2% ??? [178] 8.8% -------------------------------------------------------------------------------------------- ??? [26] 100.0% [29] 666415(87.6%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [32] 54.6% get-final-combination [33] 44.6% setup-alt-simplified [35] 0.2% -------------------------------------------------------------------------------------------- sidx->spoint [27] 100.0% [30] 238062(31.3%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [34] 100.0% -------------------------------------------------------------------------------------------- generic-sort/key [28] 38.2% copying-mergesort [31] 61.8% [31] 11282(1.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [31] 61.8% ??? [178] 35.7% ??? [114] 2.5% -------------------------------------------------------------------------------------------- run-improve [29] 100.0% [32] 363690(47.8%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [37] 86.6% finalize-iter! [39] 5.1% gen-series! [40] 5.1% choose-best-alt! [41] 2.7% gen-rewrites! [43] 0.3% localize! [44] 0.2% -------------------------------------------------------------------------------------------- run-improve [29] 100.0% [33] 297116(39.0%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [38] 99.5% loop [172] 0.4% ??? [114] 0.1% -------------------------------------------------------------------------------------------- binary-search-floats [30] 100.0% [34] 238062(31.3%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [36] 96.3% errors [105] 3.7% -------------------------------------------------------------------------------------------- run-improve [29] 100.0% [35] 1121(0.1%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [42] 100.0% -------------------------------------------------------------------------------------------- ??? [26] 28.8% pred [34] 69.8% [36] 328508(43.2%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 make-exacts* [52] 56.4% loop [53] 29.7% make-exacts [46] 12.1% ??? [48] 1.7% debug [168] 0.1% -------------------------------------------------------------------------------------------- run-iter! [32] 100.0% [37] 314953(41.4%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [45] 100.0% -------------------------------------------------------------------------------------------- get-final-combination [33] 100.0% [38] 295740(38.9%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [165] 99.9% ??? [89] 0.1% -------------------------------------------------------------------------------------------- run-iter! [32] 100.0% [39] 18564(2.4%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [89] 100.0% -------------------------------------------------------------------------------------------- run-iter! [32] 100.0% [40] 18548(2.4%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [47] 100.0% -------------------------------------------------------------------------------------------- run-iter! [32] 100.0% [41] 9952(1.3%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [89] 100.0% -------------------------------------------------------------------------------------------- setup-alt-simplified [35] 100.0% [42] 1121(0.1%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [51] 100.0% -------------------------------------------------------------------------------------------- run-iter! [32] 100.0% [43] 1112(0.1%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [49] 100.0% -------------------------------------------------------------------------------------------- run-iter! [32] 100.0% [44] 559(0.1%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [50] 100.0% -------------------------------------------------------------------------------------------- simplify! [37] 100.0% [45] 314953(41.4%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [51] 100.0% -------------------------------------------------------------------------------------------- prepare-points [36] 100.0% [46] 39746(5.2%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [53] 81.0% make-exacts* [52] 19.0% -------------------------------------------------------------------------------------------- gen-series! [40] 100.0% [47] 18548(2.4%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [114] 100.0% -------------------------------------------------------------------------------------------- prepare-points [36] 100.0% [48] 5578(0.7%) 556(0.1%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [114] 79.9% reverse [227] 5.1% range-table-ref [55] 5.0% -------------------------------------------------------------------------------------------- gen-rewrites! [43] 100.0% [49] 1112(0.1%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [54] 100.0% -------------------------------------------------------------------------------------------- localize! [44] 100.0% [50] 559(0.1%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [137] 100.0% -------------------------------------------------------------------------------------------- ??? [114] 0.1% simplify-alt [42] 0.4% ??? [45] 99.6% [51] 316351(41.6%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [56] 99.9% *simplify-rules* [59] 0.1% -------------------------------------------------------------------------------------------- make-exacts [46] 3.9% prepare-points [36] 96.1% [52] 192820(25.3%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [108] 100.0% -------------------------------------------------------------------------------------------- make-exacts [46] 24.8% prepare-points [36] 75.2% [53] 129839(17.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [172] 99.4% debug [168] 0.4% -------------------------------------------------------------------------------------------- alt-rewrite-rm [49] 37.6% matcher [57] 62.4% [54] 1112(0.1%) 561(0.1%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [57] 70.7% *rules* [58] 8.3% -------------------------------------------------------------------------------------------- ??? [48] 100.0% [55] 280(0.0%) 280(0.0%) range-table-ref ...ng/src/range-analysis.rkt:182:0 -------------------------------------------------------------------------------------------- simplify [51] 100.0% [56] 316074(41.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [60] 83.6% loop [61] 16.3% -------------------------------------------------------------------------------------------- matcher [57] 50.0% rewriter [54] 50.0% [57] 1112(0.1%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [57] 50.0% rewriter [54] 45.9% pattern-substitute [63] 4.1% -------------------------------------------------------------------------------------------- rewriter [54] 100.0% [58] 278(0.0%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [62] 100.0% -------------------------------------------------------------------------------------------- simplify [51] 100.0% [59] 276(0.0%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [62] 100.0% -------------------------------------------------------------------------------------------- ??? [56] 100.0% [60] 264198(34.7%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [64] 98.4% loop [172] 1.6% -------------------------------------------------------------------------------------------- ??? [56] 100.0% [61] 51602(6.8%) 1948(0.3%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [65] 49.2% loop [66] 45.9% reverse [227] 0.5% make-sequence [229] 0.5% -------------------------------------------------------------------------------------------- *simplify-rules* [59] 49.9% *rules* [58] 50.1% [62] 554(0.1%) 276(0.0%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ...sting/src/common.rkt:47:2 [131] 50.1% -------------------------------------------------------------------------------------------- matcher [57] 33.3% pattern-substitute [63] 66.7% [63] 274(0.0%) 0(0.0%) pattern-substitute ...ng/src/core/matcher.rkt:73:0 pattern-substitute [63] 66.7% assoc [221] 33.3% -------------------------------------------------------------------------------------------- iterate-egraph! [60] 100.0% [64] 260018(34.2%) 3085(0.4%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 merge-egraph-nodes! [67] 27.3% match-e [68] 26.1% mk-enode! [74] 15.1% substitute-e [70] 13.5% loop! [179] 5.1% custom-set-member? [71] 5.0% list-member? [217] 4.3% update-leader! [75] 1.0% filter [231] 0.3% reduce-to-single! [72] 0.3% reverse [227] 0.2% pack-leader [232] 0.2% make-sequence [229] 0.1% loop [73] 0.1% ??? [78] 0.1% -------------------------------------------------------------------------------------------- loop [61] 100.0% [65] 25401(3.3%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [69] 100.0% -------------------------------------------------------------------------------------------- loop [61] 100.0% [66] 23700(3.1%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [69] 100.0% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [67] 13.4% one-iter [64] 86.6% [67] 71027(9.3%) 1121(0.1%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [75] 75.3% merge-egraph-nodes! [67] 13.4% loop! [179] 8.6% enode-merge! [79] 0.8% make-sequence [229] 0.4% update-en-expr [219] 0.2% -------------------------------------------------------------------------------------------- match-e [68] 30.1% one-iter [64] 69.9% [68] 67874(8.9%) 18084(2.4%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [68] 30.1% loop [172] 13.8% ??? [89] 5.6% ??? [201] 5.5% do-procedure-reduce-keyword-arity [220] 4.2% variable? [76] 3.6% reverse [227] 3.5% make-sequence [229] 3.3% list-cartesian-product [77] 3.1% check-list [256] 1.2% custom-in-set [249] 1.2% pack-leader [232] 0.8% in-set [205] 0.8% make-curried [80] 0.8% ??? [78] 0.6% filter [231] 0.2% -------------------------------------------------------------------------------------------- argmins [133] 0.6% loop [66] 48.0% mk-min [65] 51.4% [69] 49374(6.5%) 1952(0.3%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [120] 59.3% ...sting/src/common.rkt:47:2 [131] 24.3% compile [113] 10.2% make-sequence [229] 1.1% -------------------------------------------------------------------------------------------- substitute-e [70] 7.4% one-iter [64] 92.6% [70] 34992(4.6%) 558(0.1%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [74] 86.4% substitute-e [70] 7.4% variable? [76] 2.9% ??? [89] 1.2% reverse [227] 0.4% -------------------------------------------------------------------------------------------- one-iter [64] 100.0% [71] 13096(1.7%) 12816(1.7%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [81] 2.1% -------------------------------------------------------------------------------------------- one-iter [64] 100.0% [72] 836(0.1%) 558(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 make-sequence [229] 33.2% -------------------------------------------------------------------------------------------- one-iter [64] 0.4% loop [73] 99.6% [73] 278(0.0%) 278(0.0%) loop ...cket/collects/racket/private/hash.rkt:25:8 loop [73] 99.6% -------------------------------------------------------------------------------------------- substitute-e [70] 43.3% one-iter [64] 56.3% [74] 69824(9.2%) 3894(0.5%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [82] 91.7% hash-has-key? [91] 2.4% in-set [205] 0.4% -------------------------------------------------------------------------------------------- one-iter [64] 4.0% merge-egraph-nodes! [67] 96.0% [75] 62992(8.3%) 17560(2.3%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [83] 66.4% update-en-expr [219] 2.7% reverse [227] 2.2% pack-leader [232] 0.4% make-sequence [229] 0.4% -------------------------------------------------------------------------------------------- free-variables [193] 2.8% substitute-e [70] 28.6% match-e [68] 68.6% [76] 9768(1.3%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [89] 100.0% -------------------------------------------------------------------------------------------- list-cartesian-product [77] 9.2% match-e [68] 90.8% [77] 3054(0.4%) 1654(0.2%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [229] 36.7% list-cartesian-product [77] 9.2% reverse [227] 9.1% -------------------------------------------------------------------------------------------- one-iter [64] 32.9% match-e [68] 67.1% [78] 844(0.1%) 566(0.1%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 make-sequence [229] 32.9% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [67] 100.0% [79] 558(0.1%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [84] 50.3% custom-set-intersect! [85] 49.7% -------------------------------------------------------------------------------------------- match-e [68] 100.0% [80] 556(0.1%) 0(0.0%) make-curried ...collects/racket/function.rkt:130:9 partially-applied-procedure-arity-mask [234] 50.2% make-keyword-procedure [152] 49.8% -------------------------------------------------------------------------------------------- custom-set-member? [71] 100.0% [81] 280(0.0%) 280(0.0%) set-check-elem ...cket/private/set-types.rkt:329:0 -------------------------------------------------------------------------------------------- mk-enode! [74] 100.0% [82] 64000(8.4%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [86] 99.6% make-immutable-set [202] 0.4% -------------------------------------------------------------------------------------------- update-leader! [75] 100.0% [83] 41800(5.5%) 560(0.1%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [87] 98.7% -------------------------------------------------------------------------------------------- enode-merge! [79] 100.0% [84] 280(0.0%) 0(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [197] 100.0% -------------------------------------------------------------------------------------------- enode-merge! [79] 100.0% [85] 277(0.0%) 277(0.0%) custom-set-intersect! ...ivate/set-types.rkt:269:0 -------------------------------------------------------------------------------------------- new-enode [82] 100.0% [86] 63722(8.4%) 560(0.1%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [88] 99.1% -------------------------------------------------------------------------------------------- do-hash-update [83] 100.0% [87] 41240(5.4%) 34556(4.5%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [219] 12.2% reverse [227] 3.4% make-sequence [229] 0.7% -------------------------------------------------------------------------------------------- f8 [165] 0.9% type-of-enode-expr [86] 99.1% [88] 63720(8.4%) 557(0.1%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [120] 34.6% ??? [90] 31.9% ??? [89] 17.4% ...sting/src/common.rkt:47:2 [131] 15.3% -------------------------------------------------------------------------------------------- split-table [38] 0.4% simplify* [185] 0.4% f8 [165] 0.8% substitute-e [70] 1.7% ??? [226] 7.2% variable? [76] 14.5% choose-best-alt! [41] 14.8% match-e [68] 15.4% get-sigs [88] 16.5% finalize-iter! [39] 27.4% [89] 67170(8.8%) 826(0.1%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [91] 54.8% atab-add-altns [92] 27.4% atab-pick-alt [94] 14.8% ??? [226] 1.3% split-atab [95] 0.4% -------------------------------------------------------------------------------------------- ??? [114] 4.0% get-sigs [88] 96.0% [90] 21161(2.8%) 556(0.1%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [93] 73.6% handle-the-hash [140] 14.5% get/build-late-neg-projection [109] 7.9% ??? [138] 1.3% -------------------------------------------------------------------------------------------- mk-enode! [74] 4.3% ??? [89] 95.7% [91] 38646(5.1%) 22871(3.0%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [130] 40.1% reverse [227] 0.7% -------------------------------------------------------------------------------------------- ??? [89] 100.0% [92] 18564(2.4%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [96] 100.0% -------------------------------------------------------------------------------------------- ??? [90] 100.0% [93] 15566(2.0%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [97] 100.0% -------------------------------------------------------------------------------------------- ??? [89] 100.0% [94] 9952(1.3%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [98] 61.1% ??? [114] 33.4% errors [105] 5.5% -------------------------------------------------------------------------------------------- ??? [89] 100.0% [95] 276(0.0%) 0(0.0%) split-atab ...testing/src/core/alt-table.rkt:105:0 filter [231] 100.0% -------------------------------------------------------------------------------------------- atab-add-altns [92] 100.0% [96] 18564(2.4%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [99] 88.1% override-at-pnts [101] 10.5% minimize-alts [104] 1.5% -------------------------------------------------------------------------------------------- ??? [93] 100.0% [97] 15566(2.0%) 6666(0.9%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [100] 48.3% ??? [102] 5.3% ??? [103] 3.6% -------------------------------------------------------------------------------------------- atab-pick-alt [94] 100.0% [98] 6079(0.8%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [172] 100.0% -------------------------------------------------------------------------------------------- atab-add-altn [96] 100.0% [99] 16346(2.1%) 280(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [105] 96.5% reverse [227] 1.7% -------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [97] 100.0% [100] 7512(1.0%) 278(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [106] 88.9% do-blame-add-context [110] 7.4% -------------------------------------------------------------------------------------------- atab-add-altn [96] 100.0% [101] 1942(0.3%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [105] 100.0% -------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [97] 100.0% [102] 828(0.1%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:44 blame-add-context [112] 66.9% do-blame-add-context [110] 33.1% -------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [97] 100.0% [103] 560(0.1%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:34 blame-add-context [112] 50.0% do-blame-add-context [110] 50.0% -------------------------------------------------------------------------------------------- atab-add-altn [96] 100.0% [104] 276(0.0%) 0(0.0%) minimize-alts ...ting/src/core/alt-table.rkt:193:0 rm-alts [107] 100.0% -------------------------------------------------------------------------------------------- atab-pick-alt [94] 0.7% override-at-pnts [101] 2.5% composed [173] 5.4% pred [34] 11.4% best-and-tied-at-points [99] 20.6% loop [172] 59.3% [105] 76464(10.0%) 556(0.1%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [178] 60.3% eval-prog [108] 36.0% ulp-difference [111] 1.8% ??? [114] 1.1% -------------------------------------------------------------------------------------------- ??? [100] 100.0% [106] 6680(0.9%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [109] 79.1% do-blame-add-context [110] 8.4% reverse [227] 8.3% blame-add-context [112] 4.2% -------------------------------------------------------------------------------------------- minimize-alts [104] 100.0% [107] 276(0.0%) 0(0.0%) rm-alts ...lt-testing/src/core/alt-table.rkt:222:0 loop [172] 100.0% -------------------------------------------------------------------------------------------- sindices->spoints [11] 0.1% sort-context-on-expr [12] 0.1% errors [105] 12.4% make-exacts* [52] 87.1% [108] 221484(29.1%) 72524(9.5%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [113] 58.4% f8 [165] 7.2% ??? [114] 0.6% ??? [117] 0.5% kw-chaperone [119] 0.2% -------------------------------------------------------------------------------------------- loop [172] 2.0% ??? [116] 10.1% ??? [90] 12.0% ??? [106] 75.9% [109] 6958(0.9%) 816(0.1%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [115] 70.1% ??? [116] 10.1% contract-struct-late-neg-projection [118] 8.1% -------------------------------------------------------------------------------------------- ??? [102] 16.4% ??? [103] 16.8% ??? [100] 33.2% ??? [106] 33.6% [110] 1670(0.2%) 1670(0.2%) do-blame-add-context ...ct/private/blame.rkt:192:0 -------------------------------------------------------------------------------------------- errors [105] 100.0% [111] 1396(0.2%) 1118(0.1%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 list-member? [217] 19.9% -------------------------------------------------------------------------------------------- ??? [103] 25.1% ??? [106] 25.2% ??? [102] 49.7% [112] 1116(0.1%) 1116(0.1%) blame-add-context ...tract/private/blame.rkt:170:0 -------------------------------------------------------------------------------------------- expression-cost [69] 3.7% eval-prog [108] 96.3% [113] 134400(17.7%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [137] 99.8% reverse [227] 0.2% -------------------------------------------------------------------------------------------- ??? [114] 0.2% loop [8] 0.3% get-final-combination [33] 0.3% errors [105] 1.0% copying-mergesort [31] 1.0% eval-prog [108] 1.7% atab-pick-alt [94] 4.0% ??? [48] 5.5% loop [121] 11.5% taylor-alt [47] 11.5% f8 [165] 18.8% loop [172] 44.0% [114] 80504(10.6%) 2521(0.3%) ??? ...tract/private/arrow-higher-order.rkt:375:33 real->bigfloat [123] 22.2% ->flonum [124] 19.5% loop [121] 11.5% approximate [122] 11.3% table-ref [120] 9.0% ??? [226] 7.2% best-alt [126] 4.0% sample-multi-bounded [127] 3.8% ...sting/src/common.rkt:47:2 [131] 3.3% ??? [90] 1.0% ??? [216] 0.7% ??? [237] 0.6% simplify [51] 0.3% ??? [114] 0.2% simplify [161] 0.2% -------------------------------------------------------------------------------------------- get/build-late-neg-projection [109] 100.0% [115] 5578(0.7%) 1676(0.2%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [125] 65.1% reverse [227] 4.9% -------------------------------------------------------------------------------------------- get/build-late-neg-projection [109] 100.0% [116] 1400(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [109] 100.0% -------------------------------------------------------------------------------------------- eval-prog [108] 100.0% [117] 1102(0.1%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [128] 100.0% -------------------------------------------------------------------------------------------- get/build-late-neg-projection [109] 100.0% [118] 564(0.1%) 564(0.1%) contract-struct-late-neg-projection ...p.rkt:121:0 -------------------------------------------------------------------------------------------- eval-prog [108] 100.0% [119] 549(0.1%) 0(0.0%) kw-chaperone ...ects/racket/private/kw.rkt:2036:33 ...row-higher-order.rkt:387:44 [129] 100.0% -------------------------------------------------------------------------------------------- ??? [114] 12.4% get-sigs [88] 37.6% expression-cost [69] 50.0% [120] 58548(7.7%) 13092(1.7%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [130] 68.6% return/no-unsupplied [218] 2.4% reverse [227] 2.4% ...sting/src/common.rkt:47:2 [131] 2.4% in-set [205] 0.9% dict? [240] 0.5% -------------------------------------------------------------------------------------------- ??? [114] 8.2% loop [121] 91.8% [121] 18548(2.4%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [121] 91.8% ??? [114] 8.2% -------------------------------------------------------------------------------------------- ??? [114] 100.0% [122] 18270(2.4%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [137] 66.2% ??? [132] 17.0% taylor [180] 16.8% -------------------------------------------------------------------------------------------- ??? [114] 100.0% [123] 17899(2.4%) 7714(1.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [236] 50.7% ??? [241] 3.1% ??? [238] 3.1% -------------------------------------------------------------------------------------------- ??? [114] 100.0% [124] 15810(2.1%) 9153(1.2%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [218] 21.0% ...sting/src/common.rkt:47:2 [131] 8.7% ??? [135] 5.3% list-member? [217] 3.6% in-set [205] 3.5% -------------------------------------------------------------------------------------------- contract-struct-name [134] 19.2% ??? [115] 80.8% [125] 3630(0.5%) 1958(0.3%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [134] 61.4% -------------------------------------------------------------------------------------------- ??? [114] 100.0% [126] 3328(0.4%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [133] 100.0% -------------------------------------------------------------------------------------------- ??? [114] 100.0% [127] 3095(0.4%) 2812(0.4%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [136] 9.1% -------------------------------------------------------------------------------------------- ??? [117] 100.0% [128] 1102(0.1%) 1102(0.1%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 -------------------------------------------------------------------------------------------- kw-chaperone [119] 100.0% [129] 549(0.1%) 266(0.0%) ...row-higher-order.rkt:387:44 ...order.rkt:387:44 arrow-higher-order:lnp [142] 51.5% -------------------------------------------------------------------------------------------- hash-has-key? [91] 27.8% table-ref [120] 72.2% [130] 55671(7.3%) 25947(3.4%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [138] 31.3% handle-the-hash [140] 13.0% ??? [151] 2.0% ??? [216] 2.0% do-chaperone-procedure [143] 2.0% arrow-higher-order:lnp [142] 1.5% successfully-got-the-right-kind-of-function [145] 1.0% check-list [256] 0.5% -------------------------------------------------------------------------------------------- flag-set? [62] 1.0% ??? [141] 1.0% simplify* [185] 1.0% ??? [198] 2.9% ->flonum [124] 4.8% table-ref [120] 4.9% ??? [114] 9.2% get-sigs [88] 33.7% expression-cost [69] 41.6% [131] 28535(3.7%) 3854(0.5%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [139] 59.7% ??? [141] 22.9% dict-key-contract [144] 2.9% ??? [226] 1.5% -------------------------------------------------------------------------------------------- approximate [122] 20.4% ??? [3] 79.6% [132] 15197(2.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [137] 100.0% -------------------------------------------------------------------------------------------- extract-alt [187] 24.8% best-alt [126] 75.2% [133] 4428(0.6%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [173] 93.8% expression-cost [69] 6.2% -------------------------------------------------------------------------------------------- build-compound-type-name [125] 100.0% [134] 2784(0.4%) 1108(0.1%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [125] 45.0% reverse [227] 20.2% -------------------------------------------------------------------------------------------- ->flonum [124] 100.0% [135] 838(0.1%) 838(0.1%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 -------------------------------------------------------------------------------------------- random-exp [136] 50.0% sample-multi-bounded [127] 50.0% [136] 283(0.0%) 283(0.0%) random-exp ...bie/alt-testing/src/common.rkt:253:0 random-exp [136] 50.0% -------------------------------------------------------------------------------------------- localize-error [50] 0.1% combine-aterms [18] 0.1% simplify* [185] 0.1% combine-mterms [15] 0.1% ??? [14] 0.1% cur-debug-level [175] 0.2% composed [16] 0.3% ??? [4] 0.4% normalize-series [206] 0.6% ??? [3] 0.8% approximate [122] 1.6% ??? [148] 1.6% ??? [132] 2.0% compile [113] 35.7% loop [172] 53.3% [137] 150714(19.8%) 7280(1.0%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [147] 53.7% bigfloat-hash [146] 33.8% ??? [3] 2.5% ??? [148] 1.9% simplify [161] 1.8% ??? [4] 0.6% taylor [180] 0.6% f8 [165] 0.3% -------------------------------------------------------------------------------------------- ??? [90] 1.6% ??? [130] 98.4% [138] 17736(2.3%) 8818(1.2%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 blame-add-missing-party [149] 22.0% loop [150] 14.2% make-keyword-procedure [152] 6.3% update-the-info [153] 4.7% ??? [155] 3.1% -------------------------------------------------------------------------------------------- ??? [216] 20.5% ...sting/src/common.rkt:47:2 [131] 79.5% [139] 17030(2.2%) 6124(0.8%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [216] 46.7% ??? [226] 17.3% ??? [151] 1.7% handle-the-hash [140] 1.7% -------------------------------------------------------------------------------------------- ??? [139] 2.7% ??? [90] 29.0% ??? [130] 68.3% [140] 10609(1.4%) 3357(0.4%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [216] 68.4% -------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [131] 100.0% [141] 6810(0.9%) 2795(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 return/no-unsupplied [218] 42.8% ...sting/src/common.rkt:47:2 [131] 8.2% assoc-ref [156] 8.0% -------------------------------------------------------------------------------------------- ...row-higher-order.rkt:387:44 [129] 25.3% ??? [130] 74.7% [142] 1120(0.1%) 560(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ??? [154] 50.0% -------------------------------------------------------------------------------------------- ??? [130] 100.0% [143] 1104(0.1%) 558(0.1%) do-chaperone-procedure ...et/private/kw.rkt:1952:2 normalize-proc [158] 25.0% wrap [159] 24.4% -------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [131] 100.0% [144] 839(0.1%) 839(0.1%) dict-key-contract ...collects/racket/dict.rkt:71:0 -------------------------------------------------------------------------------------------- ??? [130] 100.0% [145] 560(0.1%) 282(0.0%) successfully-got-the-right-kind-of-function ...5:4 arity-checking-wrapper [157] 49.7% -------------------------------------------------------------------------------------------- hash-ref! [137] 100.0% [146] 127702(16.8%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [160] 96.7% bigfloat->sig+exp [167] 1.7% sig+exp->bigfloat [162] 1.5% -------------------------------------------------------------------------------------------- hash-ref! [137] 100.0% [147] 114175(15.0%) 558(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [172] 99.8% -------------------------------------------------------------------------------------------- hash-ref! [137] 100.0% [148] 10700(1.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [137] 93.4% simplify [161] 6.6% -------------------------------------------------------------------------------------------- ??? [138] 100.0% [149] 3902(0.5%) 3902(0.5%) blame-add-missing-party ...private/blame.rkt:382:0 -------------------------------------------------------------------------------------------- ??? [138] 33.2% loop [150] 66.8% [150] 2512(0.3%) 2512(0.3%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [150] 66.8% -------------------------------------------------------------------------------------------- ??? [139] 20.1% ??? [130] 79.9% [151] 1410(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [163] 100.0% -------------------------------------------------------------------------------------------- make-curried [80] 19.8% ??? [138] 80.2% [152] 1398(0.2%) 1398(0.2%) make-keyword-procedure ...ket/private/kw.rkt:448:4 -------------------------------------------------------------------------------------------- ??? [138] 100.0% [153] 831(0.1%) 831(0.1%) update-the-info ...ontract/private/blame.rkt:318:0 -------------------------------------------------------------------------------------------- arrow-higher-order:lnp [142] 100.0% [154] 560(0.1%) 560(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 -------------------------------------------------------------------------------------------- ??? [138] 100.0% [155] 552(0.1%) 552(0.1%) ??? ...rivate/unconstrained-domain-arrow.rkt:19:10 -------------------------------------------------------------------------------------------- ??? [141] 100.0% [156] 546(0.1%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [221] 100.0% -------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [145]100.0% [157] 278(0.0%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:443:0 matches-arity-exactly? [164] 100.0% -------------------------------------------------------------------------------------------- do-chaperone-procedure [143] 100.0% [158] 276(0.0%) 276(0.0%) normalize-proc ...cts/racket/private/kw.rkt:2228:2 -------------------------------------------------------------------------------------------- do-chaperone-procedure [143] 100.0% [159] 270(0.0%) 270(0.0%) wrap ...ket/collects/racket/private/kw.rkt:2038:27 -------------------------------------------------------------------------------------------- bigfloat-hash [146] 100.0% [160] 123537(16.2%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [166] 98.2% bigfloat->sig+exp [167] 1.6% -------------------------------------------------------------------------------------------- ??? [114] 1.6% taylor-exp [212] 1.6% loop [172] 1.6% taylor-invert [7] 6.3% taylor-log [6] 6.4% ??? [148] 6.4% hash-ref! [137] 76.2% [161] 17710(2.3%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [165] 84.1% debug-print [208] 7.9% debug [168] 4.8% loop [170] 1.6% make-multiplication-node [171] 1.6% -------------------------------------------------------------------------------------------- bigfloat-hash [146] 100.0% [162] 1946(0.3%) 553(0.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:404:0 new-mpfr [236] 71.6% -------------------------------------------------------------------------------------------- ??? [151] 100.0% [163] 1410(0.2%) 563(0.1%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [169] 60.1% -------------------------------------------------------------------------------------------- arity-checking-wrapper [157] 100.0% [164] 278(0.0%) 0(0.0%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 procedure-keywords [233] 100.0% -------------------------------------------------------------------------------------------- composed [173] 0.0% all-critical-subexpressions [19] 0.0% eval-const-expr [214] 0.1% expression->type [211] 0.2% hash-ref! [137] 0.2% taylor [180] 0.4% eval-prog [108] 1.1% simplify [161] 1.4% loop [172] 6.2% split-table [38] 90.4% [165] 313432(41.2%) 8714(1.1%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [172] 97.2% ??? [114] 1.0% taylor [180] 0.3% ??? [89] 0.1% expression->type [211] 0.1% get-sigs [88] 0.1% taylor-invert [7] 0.0% exprs-to-branch-on [9] 0.0% composed [173] 0.0% -------------------------------------------------------------------------------------------- bfcanonicalize [160] 100.0% [166] 121339(15.9%) 121339(15.9%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 -------------------------------------------------------------------------------------------- bfcanonicalize [160] 46.4% bigfloat-hash [146] 53.6% [167] 4139(0.5%) 556(0.1%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:389:0 new-mpz [174] 60.3% mpz->integer [176] 26.3% -------------------------------------------------------------------------------------------- prepare-points [36] 16.2% loop [53] 33.3% simplify [161] 50.5% [168] 1666(0.2%) 276(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [175] 83.4% -------------------------------------------------------------------------------------------- check-hash/c [163] 100.0% [169] 846(0.1%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [246] 100.0% -------------------------------------------------------------------------------------------- simplify [161] 20.0% loop [170] 80.0% [170] 280(0.0%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 loop [170] 80.0% expression->type [211] 20.0% -------------------------------------------------------------------------------------------- simplify [161] 100.0% [171] 278(0.0%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [177] 100.0% -------------------------------------------------------------------------------------------- rm-alts [107] 0.0% set-precompute! [181] 0.0% iterate-egraph! [60] 0.1% taylor [180] 0.1% get-final-combination [33] 0.2% point-best-alt [98] 0.2% loop! [179] 0.3% ??? [178] 0.4% option-on-expr [2] 0.4% loop [53] 1.0% match-e [68] 1.8% ??? [147] 6.1% f8 [165] 9.2% loop [172] 80.2% [172] 444734(58.4%) 5334(0.7%) loop .../private/map.rkt:40:19 loop [172] 80.2% hash-ref! [137] 6.0% option-on-expr [2] 5.9% f8 [165] 3.0% ??? [178] 1.0% errors [105] 0.6% keyword-apply [182] 0.4% ??? [114] 0.4% foldl [183] 0.4% step [184] 0.4% loop! [179] 0.3% extract-alt [187] 0.2% simplify-node [5] 0.1% simplify* [185] 0.1% simplify [161] 0.1% taylor [180] 0.1% set-precompute! [181] 0.1% setfindf [186] 0.0% enode-vars [190] 0.0% free-variables [193] 0.0% composed [16] 0.0% ??? [191] 0.0% loop [8] 0.0% get/build-late-neg-projection [109] 0.0% ??? [24] 0.0% rloop [194] 0.0% ??? [189] 0.0% -------------------------------------------------------------------------------------------- f8 [165] 6.3% argmins [133] 93.7% [173] 4432(0.6%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [105] 93.7% f8 [165] 6.3% -------------------------------------------------------------------------------------------- bigfloat->sig+exp [167] 100.0% [174] 2496(0.3%) 2496(0.3%) new-mpz ...-lib/math/private/bigfloat/gmp.rkt:73:0 -------------------------------------------------------------------------------------------- debug [168] 100.0% [175] 1390(0.2%) 270(0.0%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 get-setting [188] 40.7% return/no-unsupplied [218] 19.9% hash-ref! [137] 19.9% -------------------------------------------------------------------------------------------- bigfloat->sig+exp [167] 100.0% [176] 1087(0.1%) 821(0.1%) mpz->integer ...ath/private/bigfloat/gmp.rkt:115:0 size+limbs->integer [195] 24.5% -------------------------------------------------------------------------------------------- make-multiplication-node [171] 100.0% [177] 278(0.0%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 mterm->expr [192] 100.0% -------------------------------------------------------------------------------------------- generic-sort/key [28] 0.6% ??? [24] 0.8% copying-mergesort [31] 5.8% errors [105] 25.4% loop [172] 67.5% [178] 181656(23.9%) 77588(10.2%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [172] 16.9% ??? [215] 11.5% bf* [196] 7.4% ??? [237] 5.8% ??? [198] 5.3% ??? [199] 4.6% ??? [200] 3.4% ??? [203] 2.3% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [67] 27.5% loop [172] 28.0% one-iter [64] 44.5% [179] 21651(2.8%) 3067(0.4%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [197] 43.6% loop [172] 29.3% make-immutable-set [202] 10.9% ??? [204] 7.0% in-set [205] 1.9% -------------------------------------------------------------------------------------------- loop [172] 1.2% f8 [165] 4.9% hash-ref! [137] 18.4% approximate [122] 20.5% taylor [180] 55.0% [180] 5900(0.8%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [180] 55.0% normalize-series [206] 21.9% taylor-log [6] 7.0% f8 [165] 6.5% debug-print [208] 2.8% taylor-invert [7] 2.5% taylor-exp [212] 2.4% loop [172] 1.2% -------------------------------------------------------------------------------------------- loop [172] 100.0% [181] 4179(0.5%) 284(0.0%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [172] 73.2% eval-const-expr [214] 6.7% make-sequence [229] 6.7% ??? [201] 6.6% -------------------------------------------------------------------------------------------- loop [172] 100.0% [182] 2781(0.4%) 1653(0.2%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [209] 40.6% -------------------------------------------------------------------------------------------- loop [172] 100.0% [183] 2528(0.3%) 284(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [207] 88.7% -------------------------------------------------------------------------------------------- loop [172] 100.0% [184] 2512(0.3%) 1952(0.3%) step .../racket/collects/racket/function.rkt:145:9 sort [210] 22.3% -------------------------------------------------------------------------------------------- loop [172] 100.0% [185] 2266(0.3%) 572(0.1%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [137] 37.1% return/no-unsupplied [218] 12.6% ...sting/src/common.rkt:47:2 [131] 12.5% ??? [89] 12.5% -------------------------------------------------------------------------------------------- loop [172] 100.0% [186] 2219(0.3%) 1376(0.2%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 make-sequence [229] 38.0% -------------------------------------------------------------------------------------------- loop [172] 100.0% [187] 1100(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [133] 100.0% -------------------------------------------------------------------------------------------- cur-debug-level [175] 100.0% [188] 566(0.1%) 566(0.1%) get-setting ...rbie/alt-testing/src/debug.rkt:96:0 -------------------------------------------------------------------------------------------- err-lsts->split-indices [13] 50.0% loop [172] 50.0% [189] 554(0.1%) 554(0.1%) ??? ...e/racket/collects/racket/function.rkt:93:12 -------------------------------------------------------------------------------------------- loop [172] 100.0% [190] 281(0.0%) 0(0.0%) enode-vars ...alt-testing/src/core/enode.rkt:263:0 pack-leader [232] 100.0% -------------------------------------------------------------------------------------------- loop [172] 100.0% [191] 281(0.0%) 0(0.0%) ??? ...herbie/alt-testing/src/core/reduce.rkt:61:5 pattern-match [213] 100.0% -------------------------------------------------------------------------------------------- make-multiplication-subnode [177] 100.0% [192] 278(0.0%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 expression->type [211] 100.0% -------------------------------------------------------------------------------------------- loop [172] 100.0% [193] 278(0.0%) 0(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 variable? [76] 100.0% -------------------------------------------------------------------------------------------- loop [172] 16.7% rloop [194] 83.3% [194] 276(0.0%) 276(0.0%) rloop ...ket/collects/racket/private/list.rkt:88:4 rloop [194] 83.3% -------------------------------------------------------------------------------------------- mpz->integer [176] 100.0% [195] 266(0.0%) 266(0.0%) size+limbs->integer ...vate/bigfloat/gmp.rkt:103:0 -------------------------------------------------------------------------------------------- ??? [178] 100.0% [196] 13424(1.8%) 592(0.1%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [215] 95.6% -------------------------------------------------------------------------------------------- adopt-enode! [84] 2.7% loop! [179] 97.3% [197] 10545(1.4%) 8060(1.1%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [223] 18.4% check-list [256] 5.2% -------------------------------------------------------------------------------------------- ??? [178] 100.0% [198] 9654(1.3%) 7446(1.0%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [218] 11.5% ...sting/src/common.rkt:47:2 [131] 8.5% list-member? [217] 2.9% -------------------------------------------------------------------------------------------- ??? [178] 100.0% [199] 8280(1.1%) 562(0.1%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [216] 89.5% ??? [226] 3.7% -------------------------------------------------------------------------------------------- ??? [178] 100.0% [200] 6240(0.8%) 6240(0.8%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 -------------------------------------------------------------------------------------------- set-precompute! [181] 5.2% match-e [68] 94.8% [201] 5278(0.7%) 276(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [220] 47.6% do-curry [222] 47.2% -------------------------------------------------------------------------------------------- new-enode [82] 5.9% loop! [179] 94.1% [202] 4732(0.6%) 4447(0.6%) make-immutable-set .../private/set-types.rkt:948:0 stream? [224] 6.0% -------------------------------------------------------------------------------------------- ??? [178] 100.0% [203] 4253(0.6%) 2814(0.4%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [252] 33.8% -------------------------------------------------------------------------------------------- loop! [179] 100.0% [204] 2760(0.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [219] 60.1% reverse [227] 39.9% -------------------------------------------------------------------------------------------- mk-enode! [74] 9.4% ->flonum [124] 20.1% table-ref [120] 20.1% match-e [68] 20.4% loop! [179] 30.1% [205] 2753(0.4%) 2753(0.4%) in-set ...ollects/racket/private/generic.rkt:472:9 -------------------------------------------------------------------------------------------- taylor [180] 100.0% [206] 2256(0.3%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [137] 100.0% -------------------------------------------------------------------------------------------- foldl [183] 100.0% [207] 2243(0.3%) 0(0.0%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [221] 100.0% -------------------------------------------------------------------------------------------- taylor [180] 28.4% simplify [161] 71.6% [208] 1965(0.3%) 1965(0.3%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 -------------------------------------------------------------------------------------------- keyword-apply [182] 100.0% [209] 1128(0.1%) 1128(0.1%) loop ...cket/collects/racket/private/kw.rkt:518:13 -------------------------------------------------------------------------------------------- step [184] 100.0% [210] 560(0.1%) 560(0.1%) sort ...cket/collects/racket/private/list.rkt:43:2 -------------------------------------------------------------------------------------------- loop [170] 12.5% mterm->expr [192] 16.6% f8 [165] 29.2% expression->type [211] 41.7% [211] 558(0.1%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 f8 [165] 58.3% expression->type [211] 41.7% -------------------------------------------------------------------------------------------- taylor [180] 100.0% [212] 283(0.0%) 0(0.0%) taylor-exp ...lt-testing/src/core/taylor.rkt:386:0 simplify [161] 100.0% -------------------------------------------------------------------------------------------- ??? [191] 100.0% [213] 281(0.0%) 281(0.0%) pattern-match ...testing/src/core/matcher.rkt:48:0 -------------------------------------------------------------------------------------------- set-precompute! [181] 100.0% [214] 281(0.0%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f8 [165] 100.0% -------------------------------------------------------------------------------------------- bf* [196] 38.0% ??? [178] 62.0% [215] 33736(4.4%) 2577(0.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [225] 90.7% ^TYPE? [252] 1.6% -------------------------------------------------------------------------------------------- ??? [114] 2.0% ??? [130] 4.0% handle-the-hash [140] 26.1% ??? [199] 26.7% ??? [139] 41.2% [216] 27790(3.7%) 10114(1.3%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [139] 25.1% ??? [230] 21.1% ??? [226] 15.4% check-list [256] 1.0% ??? [237] 1.0% -------------------------------------------------------------------------------------------- ??? [198] 2.3% ulp-difference [111] 2.3% ->flonum [124] 4.6% one-iter [64] 90.9% [217] 12264(1.6%) 838(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 member [228] 93.2% -------------------------------------------------------------------------------------------- cur-debug-level [175] 3.0% simplify* [185] 3.1% ??? [198] 11.9% table-ref [120] 15.1% ??? [141] 31.2% ->flonum [124] 35.7% [218] 9319(1.2%) 4863(0.6%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [231] 32.8% reverse [227] 15.1% -------------------------------------------------------------------------------------------- merge-egraph-nodes! [67] 3.3% ??? [204] 19.2% update-leader! [75] 19.4% ??? [87] 58.1% [219] 8636(1.1%) 4732(0.6%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [229] 25.9% pack-leader [232] 19.3% -------------------------------------------------------------------------------------------- ??? [201] 43.6% match-e [68] 56.4% [220] 5756(0.8%) 4918(0.6%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [233] 14.6% -------------------------------------------------------------------------------------------- pattern-substitute [63] 8.9% assoc-ref [156] 17.8% merge2 [207] 73.2% [221] 3064(0.4%) 3064(0.4%) assoc ...t/collects/racket/private/list.rkt:196:13 -------------------------------------------------------------------------------------------- ??? [201] 100.0% [222] 2490(0.3%) 1652(0.2%) do-curry ...cket/collects/racket/function.rkt:71:2 procedure-keywords [233] 22.3% partially-applied-procedure-arity-mask [234] 11.3% -------------------------------------------------------------------------------------------- custom-set-union [197] 100.0% [223] 1939(0.3%) 1664(0.2%) choose-immutable ...et/private/set-types.rkt:151:0 set-check-compatible [235] 14.2% -------------------------------------------------------------------------------------------- make-immutable-set [202] 100.0% [224] 286(0.0%) 286(0.0%) stream? ...t/collects/racket/private/for.rkt:493:2 -------------------------------------------------------------------------------------------- ??? [215] 100.0% [225] 30606(4.0%) 9634(1.3%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [236] 51.8% ??? [238] 13.8% ??? [241] 2.9% -------------------------------------------------------------------------------------------- ??? [199] 1.8% ...sting/src/common.rkt:47:2 [131] 3.2% ??? [89] 4.0% ??? [216] 24.2% ??? [114] 32.1% ??? [139] 33.2% [226] 17680(2.3%) 4276(0.6%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ??? [89] 27.4% contract? [239] 25.3% ^TYPE? [252] 16.0% dict? [240] 7.2% -------------------------------------------------------------------------------------------- ??? [115] 2.0% hash-has-key? [91] 2.1% loop [61] 2.1% substitute-e [70] 2.1% list-cartesian-product [77] 2.1% compile [113] 2.1% best-and-tied-at-points [99] 2.1% ??? [48] 2.1% ??? [106] 4.2% one-iter [64] 4.2% contract-struct-name [134] 4.2% ??? [204] 8.2% ??? [87] 10.4% update-leader! [75] 10.4% table-ref [120] 10.4% return/no-unsupplied [218] 10.5% match-e [68] 20.9% [227] 13391(1.8%) 13391(1.8%) reverse ...collects/racket/private/reverse.rkt:6:4 -------------------------------------------------------------------------------------------- list-member? [217] 100.0% [228] 11426(1.5%) 11426(1.5%) member ...collects/racket/private/member.rkt:13:21 -------------------------------------------------------------------------------------------- loop [61] 3.0% reduce-to-single! [72] 3.0% ??? [78] 3.0% ??? [87] 3.0% set-precompute! [181] 3.0% update-leader! [75] 3.0% merge-egraph-nodes! [67] 3.1% one-iter [64] 3.1% expression-cost [69] 6.1% setfindf [186] 9.1% list-cartesian-product [77] 12.1% match-e [68] 24.2% update-en-expr [219] 24.3% [229] 9222(1.2%) 8113(1.1%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [242] 9.0% ??? [243] 3.0% -------------------------------------------------------------------------------------------- ??? [216] 100.0% [230] 5850(0.8%) 2508(0.3%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [237] 28.6% check-list [256] 28.5% -------------------------------------------------------------------------------------------- split-atab [95] 6.2% match-e [68] 6.3% one-iter [64] 18.9% return/no-unsupplied [218] 68.5% [231] 4454(0.6%) 4178(0.5%) filter ...t/collects/racket/private/list.rkt:275:2 ??? [244] 6.2% -------------------------------------------------------------------------------------------- pack-leader [232] 4.2% update-leader! [75] 4.2% enode-vars [190] 8.4% one-iter [64] 16.7% match-e [68] 16.8% update-en-expr [219] 49.7% [232] 3350(0.4%) 3350(0.4%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 pack-leader [232] 4.2% -------------------------------------------------------------------------------------------- matches-arity-exactly? [164] 16.7% do-curry [222] 33.2% do-procedure-reduce-keyword-arity [220] 50.1% [233] 1672(0.2%) 1672(0.2%) procedure-keywords .../racket/private/kw.rkt:534:2 -------------------------------------------------------------------------------------------- make-curried [80] 49.7% do-curry [222] 50.3% [234] 562(0.1%) 562(0.1%) partially-applied-procedure-arity-mask ...rkt:58:2 -------------------------------------------------------------------------------------------- choose-immutable [223] 100.0% [235] 274(0.0%) 274(0.0%) set-check-compatible ...rivate/set-types.rkt:531:0 -------------------------------------------------------------------------------------------- sig+exp->bigfloat [162] 5.2% real->bigfloat [123] 34.1% bfmul [225] 59.6% [236] 26586(3.5%) 26586(3.5%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 -------------------------------------------------------------------------------------------- ??? [216] 2.1% ??? [114] 3.9% ??? [230] 12.8% ??? [178] 81.1% [237] 13024(1.7%) 3644(0.5%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [245] 68.1% ??? [250] 3.9% -------------------------------------------------------------------------------------------- real->bigfloat [123] 11.6% bfmul [225] 88.4% [238] 4793(0.6%) 4793(0.6%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 -------------------------------------------------------------------------------------------- ??? [226] 100.0% [239] 4475(0.6%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [246] 62.6% coerce-contract/f [247] 37.4% -------------------------------------------------------------------------------------------- table-ref [120] 16.4% ??? [226] 83.6% [240] 1681(0.2%) 1402(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [251] 16.6% -------------------------------------------------------------------------------------------- real->bigfloat [123] 38.8% bfmul [225] 61.2% [241] 1448(0.2%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [248] 100.0% -------------------------------------------------------------------------------------------- make-sequence [229] 100.0% [242] 832(0.1%) 832(0.1%) :hash-gen ...collects/racket/private/for.rkt:781:4 -------------------------------------------------------------------------------------------- make-sequence [229] 100.0% [243] 277(0.0%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:477:7 custom-in-set [249] 100.0% -------------------------------------------------------------------------------------------- filter [231] 100.0% [244] 276(0.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:302:4 ??? [24] 100.0% -------------------------------------------------------------------------------------------- ??? [237] 100.0% [245] 8873(1.2%) 4643(0.6%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ^TYPE? [252] 32.0% ??? [253] 15.7% -------------------------------------------------------------------------------------------- flat-contract? [169] 23.2% contract? [239] 76.8% [246] 3649(0.5%) 3649(0.5%) simple-flat-contract? ...ct/private/guts.rkt:141:0 -------------------------------------------------------------------------------------------- contract? [239] 100.0% [247] 1672(0.2%) 839(0.1%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [254] 49.8% -------------------------------------------------------------------------------------------- ??? [241] 100.0% [248] 1448(0.2%) 1448(0.2%) assq ...et/collects/racket/private/list.rkt:187:13 -------------------------------------------------------------------------------------------- ??? [243] 25.1% match-e [68] 74.9% [249] 1102(0.1%) 1102(0.1%) custom-in-set ...acket/private/set-types.rkt:580:0 -------------------------------------------------------------------------------------------- ??? [237] 100.0% [250] 507(0.1%) 228(0.0%) ??? ...lects/racket/contract/private/orc.rkt:117:8 eqables-pred [255] 54.9% -------------------------------------------------------------------------------------------- dict? [240] 100.0% [251] 278(0.0%) 278(0.0%) assoc? ...et/collects/racket/private/dict.rkt:13:0 -------------------------------------------------------------------------------------------- ??? [215] 7.2% ??? [203] 18.8% ??? [226] 36.9% ??? [245] 37.1% [252] 7660(1.0%) 7660(1.0%) ^TYPE? .../ffi/unsafe.rkt:1621:20 -------------------------------------------------------------------------------------------- ??? [245] 100.0% [253] 1390(0.2%) 834(0.1%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [256] 40.0% -------------------------------------------------------------------------------------------- coerce-contract/f [247] 100.0% [254] 834(0.1%) 834(0.1%) coerce-simple-value ...ract/private/guts.rkt:385:0 -------------------------------------------------------------------------------------------- ??? [250] 100.0% [255] 278(0.0%) 278(0.0%) eqables-pred ...et/contract/private/orc.rkt:100:10 -------------------------------------------------------------------------------------------- ??? [130] 6.3% ??? [216] 6.4% custom-set-union [197] 12.3% ??? [253] 12.5% match-e [68] 25.0% ??? [230] 37.5% [256] 4450(0.6%) 4450(0.6%) check-list ...ollects/racket/private/for.rkt:690:2 --------------------------------------------------------------------------------------------