Profiling results ----------------- Total cpu time observed: 76250ms (out of 76450ms) Number of samples taken: 266 (once every 287ms) (Hiding functions with self<1.0% and local<2.0%: 4 of 174 hidden) ================================================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ================================================================================================================== [1] 76250(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [8] 100.0% ------------------------------------------------------------------------------------------------------------------ hash-ref! [146] 100.0% [2] 3870(5.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 ??? [9] 92.6% hash-ref! [146] 7.4% ------------------------------------------------------------------------------------------------------------------ loop [125] 100.0% [3] 2832(3.7%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [125] 60.0% sort-context-on-expr [10] 30.0% err-lsts->split-indices [13] 10.0% ------------------------------------------------------------------------------------------------------------------ hash-ref! [146] 100.0% [4] 2560(3.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [146] 88.9% composed [140] 11.1% ------------------------------------------------------------------------------------------------------------------ hash-ref! [146] 100.0% [5] 2142(2.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 simplify [15] 100.0% ------------------------------------------------------------------------------------------------------------------ loop [125] 100.0% [6] 1718(2.3%) 290(0.4%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [125] 66.4% eval-const-expr [12] 16.7% ------------------------------------------------------------------------------------------------------------------ taylor [153] 100.0% [7] 444(0.6%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 normalize-series [11] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [1] 100.0% [8] 76250(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [14] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [2] 100.0% [9] 3586(4.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [146] 100.0% ------------------------------------------------------------------------------------------------------------------ option-on-expr [3] 100.0% [10] 850(1.1%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [16] 100.0% ------------------------------------------------------------------------------------------------------------------ taylor-invert [7] 100.0% [11] 444(0.6%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 simplify [15] 100.0% ------------------------------------------------------------------------------------------------------------------ set-precompute! [6] 100.0% [12] 287(0.4%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f8 [110] 100.0% ------------------------------------------------------------------------------------------------------------------ option-on-expr [3] 100.0% [13] 283(0.4%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [142] 100.0% ------------------------------------------------------------------------------------------------------------------ profile-thunk [8] 100.0% [14] 76250(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [17] 100.0% ------------------------------------------------------------------------------------------------------------------ normalize-series [11] 5.8% ??? [5] 27.8% hash-ref! [146] 66.4% [15] 7694(10.1%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [110] 79.5% debug-print [18] 11.0% debug [20] 5.8% simplify* [143] 3.7% ------------------------------------------------------------------------------------------------------------------ sort-context-on-expr [10] 100.0% [16] 850(1.1%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [19] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [14] 100.0% [17] 76250(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [21] 91.8% prepare-points [30] 8.2% ------------------------------------------------------------------------------------------------------------------ simplify [15] 100.0% [18] 850(1.1%) 850(1.1%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 ------------------------------------------------------------------------------------------------------------------ ??? [16] 100.0% [19] 850(1.1%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [22] 66.6% ??? [106] 33.4% ------------------------------------------------------------------------------------------------------------------ simplify [15] 100.0% [20] 444(0.6%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 get-setting [23] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [17] 100.0% [21] 70002(91.8%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [24] 94.5% get-final-combination [25] 4.0% setup-prog! [26] 0.7% setup-alt-simplified [27] 0.7% ------------------------------------------------------------------------------------------------------------------ generic-sort/key [19] 29.2% copying-mergesort [22] 70.8% [22] 566(0.7%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [22] 70.8% ??? [106] 29.2% ------------------------------------------------------------------------------------------------------------------ debug [20] 100.0% [23] 444(0.6%) 0(0.0%) get-setting ...rbie/alt-testing/src/debug.rkt:96:0 ??? [83] 100.0% ------------------------------------------------------------------------------------------------------------------ run-improve [21] 100.0% [24] 66168(86.8%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [28] 80.8% gen-series! [29] 12.1% finalize-iter! [31] 5.1% choose-best-alt! [33] 1.3% gen-rewrites! [35] 0.4% localize! [36] 0.4% ------------------------------------------------------------------------------------------------------------------ run-improve [21] 100.0% [25] 2832(3.7%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [32] 100.0% ------------------------------------------------------------------------------------------------------------------ run-improve [21] 100.0% [26] 522(0.7%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [30] 100.0% ------------------------------------------------------------------------------------------------------------------ run-improve [21] 100.0% [27] 478(0.6%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [34] 100.0% ------------------------------------------------------------------------------------------------------------------ run-iter! [24] 100.0% [28] 53458(70.1%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [37] 100.0% ------------------------------------------------------------------------------------------------------------------ run-iter! [24] 100.0% [29] 7978(10.5%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [38] 100.0% ------------------------------------------------------------------------------------------------------------------ setup-prog! [26] 7.7% ??? [17] 92.3% [30] 6770(8.9%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [44] 57.7% make-exacts [39] 38.1% ??? [40] 4.2% ------------------------------------------------------------------------------------------------------------------ run-iter! [24] 100.0% [31] 3368(4.4%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [83] 100.0% ------------------------------------------------------------------------------------------------------------------ get-final-combination [25] 100.0% [32] 2832(3.7%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [110] 100.0% ------------------------------------------------------------------------------------------------------------------ run-iter! [24] 100.0% [33] 844(1.1%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [83] 100.0% ------------------------------------------------------------------------------------------------------------------ setup-alt-simplified [27] 100.0% [34] 478(0.6%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [43] 100.0% ------------------------------------------------------------------------------------------------------------------ run-iter! [24] 100.0% [35] 285(0.4%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [41] 100.0% ------------------------------------------------------------------------------------------------------------------ run-iter! [24] 100.0% [36] 236(0.3%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [42] 100.0% ------------------------------------------------------------------------------------------------------------------ simplify! [28] 100.0% [37] 53458(70.1%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [43] 100.0% ------------------------------------------------------------------------------------------------------------------ gen-series! [29] 100.0% [38] 7978(10.5%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [105] 100.0% ------------------------------------------------------------------------------------------------------------------ prepare-points [30] 100.0% [39] 2580(3.4%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [44] 77.7% make-exacts* [45] 22.3% ------------------------------------------------------------------------------------------------------------------ prepare-points [30] 100.0% [40] 286(0.4%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [105] 100.0% ------------------------------------------------------------------------------------------------------------------ gen-rewrites! [35] 100.0% [41] 285(0.4%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [46] 100.0% ------------------------------------------------------------------------------------------------------------------ localize! [36] 100.0% [42] 236(0.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [146] 100.0% ------------------------------------------------------------------------------------------------------------------ simplify-alt [34] 0.9% ??? [37] 99.1% [43] 53936(70.7%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [47] 100.0% ------------------------------------------------------------------------------------------------------------------ make-exacts [39] 33.9% prepare-points [30] 66.1% [44] 5909(7.7%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [125] 100.0% ------------------------------------------------------------------------------------------------------------------ make-exacts [39] 100.0% [45] 576(0.8%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [107] 100.0% ------------------------------------------------------------------------------------------------------------------ matcher [49] 50.0% alt-rewrite-rm [41] 50.0% [46] 285(0.4%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [49] 50.0% *rules* [48] 50.0% ------------------------------------------------------------------------------------------------------------------ simplify [43] 100.0% [47] 53936(70.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [50] 94.8% loop [51] 5.2% ------------------------------------------------------------------------------------------------------------------ rewriter [46] 100.0% [48] 285(0.4%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [52] 100.0% ------------------------------------------------------------------------------------------------------------------ matcher [49] 50.0% rewriter [46] 50.0% [49] 285(0.4%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [49] 50.0% rewriter [46] 50.0% ------------------------------------------------------------------------------------------------------------------ ??? [47] 100.0% [50] 51118(67.0%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [53] 96.6% loop [125] 3.4% ------------------------------------------------------------------------------------------------------------------ ??? [47] 100.0% [51] 2818(3.7%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [54] 51.0% loop [55] 49.0% ------------------------------------------------------------------------------------------------------------------ *rules* [48] 100.0% [52] 285(0.4%) 285(0.4%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ------------------------------------------------------------------------------------------------------------------ iterate-egraph! [50] 100.0% [53] 49400(64.8%) 3146(4.1%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [56] 37.5% merge-egraph-nodes! [57] 15.1% mk-enode! [63] 9.2% custom-set-member? [58] 8.1% loop! [134] 8.0% substitute-e [59] 5.8% list-member? [61] 3.5% filter [62] 2.3% reverse [159] 1.2% set-member? [129] 1.2% ------------------------------------------------------------------------------------------------------------------ loop [51] 100.0% [54] 1437(1.9%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [60] 100.0% ------------------------------------------------------------------------------------------------------------------ loop [51] 100.0% [55] 1380(1.8%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [60] 100.0% ------------------------------------------------------------------------------------------------------------------ match-e [56] 34.0% one-iter [53] 66.0% [56] 18542(24.3%) 4602(6.0%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [56] 34.0% ??? [83] 11.0% loop [125] 9.8% ??? [66] 7.7% reverse [159] 4.5% variable? [65] 4.1% list-cartesian-product [68] 3.8% do-procedure-reduce-keyword-arity [73] 2.3% make-sequence [74] 1.5% make-curried [70] 0.8% ------------------------------------------------------------------------------------------------------------------ merge-egraph-nodes! [57] 3.9% one-iter [53] 96.1% [57] 7450(9.8%) 288(0.4%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [64] 69.1% loop! [134] 19.3% merge-egraph-nodes! [57] 3.9% enode-merge! [69] 3.9% ------------------------------------------------------------------------------------------------------------------ one-iter [53] 100.0% [58] 4006(5.3%) 4006(5.3%) custom-set-member? ...t/private/set-types.rkt:45:0 ------------------------------------------------------------------------------------------------------------------ substitute-e [59] 13.4% one-iter [53] 86.6% [59] 2876(3.8%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [63] 79.9% substitute-e [59] 13.4% variable? [65] 6.7% ------------------------------------------------------------------------------------------------------------------ loop [55] 49.0% mk-min [54] 51.0% [60] 2818(3.7%) 0(0.0%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [84] 69.3% compile [116] 20.4% ...sting/src/common.rkt:47:2 [128] 10.3% ------------------------------------------------------------------------------------------------------------------ one-iter [53] 100.0% [61] 1721(2.3%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [67] 100.0% ------------------------------------------------------------------------------------------------------------------ one-iter [53] 100.0% [62] 1156(1.5%) 1156(1.5%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------------------------------------ substitute-e [59] 33.6% one-iter [53] 66.4% [63] 6844(9.0%) 562(0.7%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [71] 87.6% hash-has-key? [86] 4.2% ------------------------------------------------------------------------------------------------------------------ merge-egraph-nodes! [57] 100.0% [64] 5438(7.1%) 2015(2.6%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [72] 57.7% custom-set-union! [77] 5.3% ------------------------------------------------------------------------------------------------------------------ substitute-e [59] 22.4% match-e [56] 77.6% [65] 2580(3.4%) 286(0.4%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [83] 88.9% ------------------------------------------------------------------------------------------------------------------ match-e [56] 100.0% [66] 1996(2.6%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [73] 57.2% do-curry [75] 42.8% ------------------------------------------------------------------------------------------------------------------ list-member? [61] 100.0% [67] 1721(2.3%) 1721(2.3%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------------------------------------ list-cartesian-product [68] 16.7% match-e [56] 83.3% [68] 851(1.1%) 281(0.4%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [74] 50.3% list-cartesian-product [68] 16.7% ------------------------------------------------------------------------------------------------------------------ merge-egraph-nodes! [57] 100.0% [69] 287(0.4%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [76] 100.0% ------------------------------------------------------------------------------------------------------------------ match-e [56] 100.0% [70] 283(0.4%) 0(0.0%) make-curried ...collects/racket/function.rkt:130:9 make-keyword-procedure [80] 100.0% ------------------------------------------------------------------------------------------------------------------ mk-enode! [63] 100.0% [71] 5995(7.9%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [78] 100.0% ------------------------------------------------------------------------------------------------------------------ update-leader! [64] 100.0% [72] 3136(4.1%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [79] 100.0% ------------------------------------------------------------------------------------------------------------------ match-e [56] 33.4% ??? [66] 66.6% [73] 1716(2.3%) 1716(2.3%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 ------------------------------------------------------------------------------------------------------------------ list-cartesian-product [68] 49.9% match-e [56] 50.1% [74] 1142(1.5%) 854(1.1%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [81] 25.2% ------------------------------------------------------------------------------------------------------------------ ??? [66] 100.0% [75] 854(1.1%) 568(0.7%) do-curry ...cket/collects/racket/function.rkt:71:2 make-keyword-procedure [80] 33.4% ------------------------------------------------------------------------------------------------------------------ enode-merge! [69] 100.0% [76] 287(0.4%) 287(0.4%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------------------------------------ update-leader! [64] 100.0% [77] 287(0.4%) 287(0.4%) custom-set-union! ...t/private/set-types.rkt:245:0 ------------------------------------------------------------------------------------------------------------------ new-enode [71] 100.0% [78] 5995(7.9%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [82] 100.0% ------------------------------------------------------------------------------------------------------------------ do-hash-update [72] 100.0% [79] 3136(4.1%) 2576(3.4%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [164] 9.1% reverse [159] 8.7% ------------------------------------------------------------------------------------------------------------------ make-curried [70] 49.8% do-curry [75] 50.2% [80] 568(0.7%) 568(0.7%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------------------------------------ make-sequence [74] 100.0% [81] 288(0.4%) 288(0.4%) :hash-gen ...collects/racket/private/for.rkt:781:4 ------------------------------------------------------------------------------------------------------------------ type-of-enode-expr [78] 100.0% [82] 5995(7.9%) 0(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 ??? [85] 37.7% table-ref [84] 33.6% ??? [83] 19.0% ...sting/src/common.rkt:47:2 [128] 4.9% hash-has-key? [86] 4.8% ------------------------------------------------------------------------------------------------------------------ get-setting [23] 3.6% choose-best-alt! [33] 6.8% get-sigs [82] 9.2% variable? [65] 18.5% finalize-iter! [31] 27.2% match-e [56] 34.6% [83] 12376(16.2%) 578(0.8%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [86] 55.4% atab-add-altns [87] 27.2% atab-pick-alt [89] 6.8% assoc-has-key? [90] 3.6% ??? [160] 2.3% ------------------------------------------------------------------------------------------------------------------ expression-cost [60] 49.2% get-sigs [82] 50.8% [84] 3967(5.2%) 813(1.1%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [91] 72.2% ...sting/src/common.rkt:47:2 [128] 7.3% ------------------------------------------------------------------------------------------------------------------ ??? [105] 11.2% get-sigs [82] 88.8% [85] 2544(3.3%) 285(0.4%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [88] 78.7% get/build-late-neg-projection [108] 10.1% ------------------------------------------------------------------------------------------------------------------ mk-enode! [63] 3.9% get-sigs [82] 3.9% ??? [83] 92.3% [86] 7432(9.7%) 5722(7.5%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [91] 19.1% reverse [159] 3.9% ------------------------------------------------------------------------------------------------------------------ ??? [83] 100.0% [87] 3368(4.4%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [92] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [85] 100.0% [88] 2002(2.6%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [93] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [83] 100.0% [89] 844(1.1%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [94] 33.5% errors [100] 33.4% ??? [105] 33.1% ------------------------------------------------------------------------------------------------------------------ ??? [83] 100.0% [90] 444(0.6%) 0(0.0%) assoc-has-key? ...ts/racket/private/dict.rkt:257:0 assoc [161] 100.0% ------------------------------------------------------------------------------------------------------------------ hash-has-key? [86] 33.2% table-ref [84] 66.8% [91] 4286(5.6%) 2300(3.0%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [96] 39.8% arrow-higher-order:lnp [99] 6.6% ------------------------------------------------------------------------------------------------------------------ atab-add-altns [87] 100.0% [92] 3368(4.4%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [95] 83.1% override-at-pnts [98] 16.9% ------------------------------------------------------------------------------------------------------------------ ??? [88] 100.0% [93] 2002(2.6%) 856(1.1%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [97] 57.2% ------------------------------------------------------------------------------------------------------------------ atab-pick-alt [89] 100.0% [94] 282(0.4%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [125] 100.0% ------------------------------------------------------------------------------------------------------------------ atab-add-altn [92] 100.0% [95] 2799(3.7%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [100] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [91] 100.0% [96] 1704(2.2%) 1138(1.5%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [102] 16.7% ??? [103] 16.5% ------------------------------------------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [93] 100.0% [97] 1146(1.5%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [101] 100.0% ------------------------------------------------------------------------------------------------------------------ atab-add-altn [92] 100.0% [98] 570(0.7%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [100] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [91] 100.0% [99] 282(0.4%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ??? [104] 100.0% ------------------------------------------------------------------------------------------------------------------ composed [145] 5.0% atab-pick-alt [89] 5.0% override-at-pnts [98] 10.1% loop [125] 30.1% best-and-tied-at-points [95] 49.8% [100] 5626(7.4%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [106] 65.3% ??? [105] 14.8% eval-prog [107] 10.1% flonums-between [109] 9.8% ------------------------------------------------------------------------------------------------------------------ ??? [97] 100.0% [101] 1146(1.5%) 286(0.4%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [108] 75.0% ------------------------------------------------------------------------------------------------------------------ ??? [96] 20.0% loop [102] 80.0% [102] 284(0.4%) 284(0.4%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [102] 80.0% ------------------------------------------------------------------------------------------------------------------ ??? [96] 100.0% [103] 282(0.4%) 282(0.4%) ??? ...rivate/unconstrained-domain-arrow.rkt:19:10 ------------------------------------------------------------------------------------------------------------------ arrow-higher-order:lnp [99] 100.0% [104] 282(0.4%) 282(0.4%) ??? ...et/contract/private/arity-checking.rkt:19:2 ------------------------------------------------------------------------------------------------------------------ atab-pick-alt [89] 2.6% f8 [110] 2.7% ??? [40] 2.7% errors [100] 7.9% loop [125] 8.8% loop [111] 37.7% taylor-alt [38] 37.7% [105] 10589(13.9%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:375:33 loop [111] 37.7% approximate [112] 37.7% ->flonum [114] 13.8% real->bigfloat [120] 2.9% sample-multi-bounded [121] 2.7% ??? [85] 2.7% best-alt [122] 2.6% ------------------------------------------------------------------------------------------------------------------ generic-sort/key [19] 2.8% copying-mergesort [22] 5.6% errors [100] 36.4% loop [125] 55.2% [106] 10094(13.2%) 5108(6.7%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 bf* [113] 20.6% ??? [127] 8.8% ??? [117] 6.0% ??? [118] 5.6% ??? [119] 5.3% loop [125] 3.0% ------------------------------------------------------------------------------------------------------------------ errors [100] 49.7% make-exacts* [45] 50.3% [107] 1145(1.5%) 284(0.4%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [116] 27.1% f8 [110] 24.9% body of "/usr/share/racket/collects/racket/contract/private/rand.rkt" [123] 23.1% ------------------------------------------------------------------------------------------------------------------ ??? [124] 11.5% ??? [85] 11.5% ??? [101] 76.9% [108] 1117(1.5%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [115] 88.5% ??? [124] 11.5% ------------------------------------------------------------------------------------------------------------------ errors [100] 100.0% [109] 550(0.7%) 550(0.7%) flonums-between ...te/flonum/flonum-bits.rkt:103:2 ------------------------------------------------------------------------------------------------------------------ eval-prog [107] 1.5% hash-ref! [146] 2.4% eval-const-expr [12] 2.9% loop [125] 24.9% split-table [32] 29.0% simplify [15] 39.2% [110] 9759(12.8%) 5834(7.7%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [125] 59.3% ...sting/src/common.rkt:47:2 [128] 2.9% ??? [105] 1.5% ------------------------------------------------------------------------------------------------------------------ ??? [105] 25.1% loop [111] 74.9% [111] 7978(10.5%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [111] 74.9% ??? [105] 25.1% ------------------------------------------------------------------------------------------------------------------ ??? [105] 100.0% [112] 7978(10.5%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [126] 94.4% taylor [153] 5.6% ------------------------------------------------------------------------------------------------------------------ ??? [106] 100.0% [113] 2082(2.7%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [127] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [105] 100.0% [114] 1456(1.9%) 848(1.1%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 set-member? [129] 22.6% ...sting/src/common.rkt:47:2 [128] 19.3% ------------------------------------------------------------------------------------------------------------------ get/build-late-neg-projection [108] 100.0% [115] 1117(1.5%) 258(0.3%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [131] 51.3% reverse [159] 25.6% ------------------------------------------------------------------------------------------------------------------ eval-prog [107] 35.1% expression-cost [60] 64.9% [116] 886(1.2%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [146] 67.6% reverse [159] 32.4% ------------------------------------------------------------------------------------------------------------------ ??? [106] 100.0% [117] 602(0.8%) 0(0.0%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [130] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [106] 100.0% [118] 570(0.7%) 570(0.7%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------------------------------ ??? [106] 100.0% [119] 538(0.7%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [148] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [105] 100.0% [120] 304(0.4%) 304(0.4%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 ------------------------------------------------------------------------------------------------------------------ ??? [105] 100.0% [121] 286(0.4%) 0(0.0%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [132] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [105] 100.0% [122] 280(0.4%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [133] 100.0% ------------------------------------------------------------------------------------------------------------------ eval-prog [107] 100.0% [123] 265(0.3%) 265(0.3%) body of "/usr/share/racket/collects/racket/contract/private/rand.rkt" ... ------------------------------------------------------------------------------------------------------------------ get/build-late-neg-projection [108] 100.0% [124] 258(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [108] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [106] 0.0% set-precompute! [6] 0.3% loop [44] 0.3% iterate-egraph! [50] 0.5% point-best-alt [94] 0.7% option-on-expr [3] 1.1% ??? [162] 1.6% taylor [153] 2.0% loop! [134] 2.3% match-e [56] 6.9% f8 [110] 11.9% loop [125] 72.4% [125] 21662(28.4%) 236(0.3%) loop .../private/map.rkt:40:19 loop [125] 72.4% f8 [110] 8.8% step [136] 3.8% foldl [139] 3.1% option-on-expr [3] 2.4% loop! [134] 2.3% composed [140] 2.0% errors [100] 1.7% hash-ref! [146] 1.6% simplify* [143] 0.7% set-precompute! [6] 0.5% ??? [106] 0.3% setfindf [138] 0.2% ??? [142] 0.1% ??? [105] 0.0% ------------------------------------------------------------------------------------------------------------------ approximate [112] 100.0% [126] 7534(9.9%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [146] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [106] 29.9% bf* [113] 70.1% [127] 2972(3.9%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [135] 100.0% ------------------------------------------------------------------------------------------------------------------ ->flonum [114] 19.5% f8 [110] 19.9% expression-cost [60] 20.1% table-ref [84] 20.1% get-sigs [82] 20.3% [128] 1440(1.9%) 290(0.4%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [137] 60.4% ??? [160] 19.5% ------------------------------------------------------------------------------------------------------------------ ->flonum [114] 36.6% one-iter [53] 63.4% [129] 898(1.2%) 898(1.2%) set-member? ...ts/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------------------------------------ ??? [117] 100.0% [130] 602(0.8%) 282(0.4%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ^TYPE? [144] 53.1% ------------------------------------------------------------------------------------------------------------------ contract-struct-name [141] 25.0% ??? [115] 75.0% [131] 573(0.8%) 0(0.0%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [141] 100.0% ------------------------------------------------------------------------------------------------------------------ sample-multi-bounded [121] 100.0% [132] 286(0.4%) 286(0.4%) random-exp ...bie/alt-testing/src/common.rkt:253:0 ------------------------------------------------------------------------------------------------------------------ best-alt [122] 100.0% [133] 280(0.4%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [145] 100.0% ------------------------------------------------------------------------------------------------------------------ merge-egraph-nodes! [57] 15.9% loop [125] 34.1% one-iter [53] 49.9% [134] 5399(7.1%) 576(0.8%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [147] 34.4% loop [125] 34.1% ??? [150] 10.6% make-immutable-set [151] 10.2% update-custom-set-table [154] 2.6% ------------------------------------------------------------------------------------------------------------------ ??? [127] 100.0% [135] 2972(3.9%) 1818(2.4%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [149] 38.8% ------------------------------------------------------------------------------------------------------------------ loop [125] 100.0% [136] 1106(1.5%) 862(1.1%) step .../racket/collects/racket/function.rkt:145:9 sort [156] 22.1% ------------------------------------------------------------------------------------------------------------------ ??? [148] 33.4% ...sting/src/common.rkt:47:2 [128] 66.6% [137] 870(1.1%) 287(0.4%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [148] 66.6% ??? [160] 16.8% ------------------------------------------------------------------------------------------------------------------ loop [125] 100.0% [138] 856(1.1%) 856(1.1%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 ------------------------------------------------------------------------------------------------------------------ loop [125] 100.0% [139] 855(1.1%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 check-fold [152] 66.9% merge2 [155] 33.1% ------------------------------------------------------------------------------------------------------------------ ??? [4] 39.1% loop [125] 60.9% [140] 728(1.0%) 284(0.4%) composed ...ollects/racket/private/list.rkt:341:16 taylor [153] 60.9% ------------------------------------------------------------------------------------------------------------------ build-compound-type-name [131] 100.0% [141] 573(0.8%) 287(0.4%) contract-struct-name ...ract/private/prop.rkt:98:0 reverse [159] 49.9% build-compound-type-name [131] 25.0% ------------------------------------------------------------------------------------------------------------------ err-lsts->split-indices [13] 49.8% loop [125] 50.2% [142] 568(0.7%) 568(0.7%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------------------------------------ simplify [15] 49.6% loop [125] 50.4% [143] 566(0.7%) 281(0.4%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [146] 50.4% ------------------------------------------------------------------------------------------------------------------ ??? [130] 100.0% [144] 320(0.4%) 320(0.4%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------------------------------------ argmins [133] 100.0% [145] 280(0.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [100] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [2] 0.8% simplify* [143] 1.1% localize-error [42] 2.8% compile [116] 3.0% loop [125] 4.2% ??? [4] 5.0% ??? [9] 8.9% ??? [157] 20.9% ??? [126] 20.9% ??? [158] 32.3% [146] 8369(11.0%) 574(0.8%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [158] 32.3% ??? [157] 20.9% simplify [15] 14.3% ??? [2] 9.7% ??? [4] 5.8% ??? [5] 5.8% ??? [162] 4.2% f8 [110] 2.8% bigfloat-hash [165] 1.9% ------------------------------------------------------------------------------------------------------------------ loop! [134] 100.0% [147] 2283(3.0%) 1708(2.2%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [163] 25.2% ------------------------------------------------------------------------------------------------------------------ ??? [119] 38.2% ??? [137] 61.8% [148] 1408(1.8%) 547(0.7%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [137] 41.2% ??? [160] 20.0% ------------------------------------------------------------------------------------------------------------------ bfmul [135] 100.0% [149] 1154(1.5%) 1154(1.5%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------------------------------------ loop! [134] 100.0% [150] 1148(1.5%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 reverse [159] 75.2% update-en-expr [164] 24.8% ------------------------------------------------------------------------------------------------------------------ loop! [134] 100.0% [151] 1106(1.5%) 1106(1.5%) make-immutable-set .../private/set-types.rkt:948:0 ------------------------------------------------------------------------------------------------------------------ foldl [139] 100.0% [152] 572(0.8%) 572(0.8%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------------------------------------ composed [140] 25.0% approximate [112] 25.0% taylor [153] 50.0% [153] 444(0.6%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [153] 50.0% loop [125] 25.0% taylor-invert [7] 25.0% ------------------------------------------------------------------------------------------------------------------ loop! [134] 100.0% [154] 285(0.4%) 285(0.4%) update-custom-set-table ...ate/set-types.rkt:339:0 ------------------------------------------------------------------------------------------------------------------ foldl [139] 100.0% [155] 283(0.4%) 0(0.0%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [161] 100.0% ------------------------------------------------------------------------------------------------------------------ step [136] 100.0% [156] 244(0.3%) 244(0.3%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------------------------------------------ hash-ref! [146] 100.0% [157] 7534(9.9%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [146] 100.0% ------------------------------------------------------------------------------------------------------------------ hash-ref! [146] 100.0% [158] 7249(9.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [146] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [79] 7.4% contract-struct-name [141] 7.7% ??? [115] 7.7% compile [116] 7.7% hash-has-key? [86] 7.8% one-iter [53] 15.5% match-e [56] 22.7% ??? [150] 23.4% [159] 3698(4.8%) 3698(4.8%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------------------------------------ ...sting/src/common.rkt:47:2 [128] 24.6% ??? [148] 24.7% ??? [83] 25.0% ??? [137] 25.7% [160] 1140(1.5%) 281(0.4%) ??? ...ects/racket/contract/private/guts.rkt:794:8 dict? [166] 49.6% contract? [168] 25.7% ------------------------------------------------------------------------------------------------------------------ merge2 [155] 39.0% assoc-has-key? [90] 61.0% [161] 726(1.0%) 726(1.0%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------------------------------------ hash-ref! [146] 100.0% [162] 599(0.8%) 0(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [125] 100.0% ------------------------------------------------------------------------------------------------------------------ custom-set-union [147] 100.0% [163] 576(0.8%) 576(0.8%) choose-immutable ...et/private/set-types.rkt:151:0 ------------------------------------------------------------------------------------------------------------------ ??? [150] 49.8% ??? [79] 50.2% [164] 571(0.7%) 571(0.7%) update-en-expr ...esting/src/core/egraph.rkt:212:0 ------------------------------------------------------------------------------------------------------------------ hash-ref! [146] 100.0% [165] 310(0.4%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [167] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [160] 100.0% [166] 566(0.7%) 566(0.7%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------------------------------------------ bigfloat-hash [165] 100.0% [167] 310(0.4%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [169] 100.0% ------------------------------------------------------------------------------------------------------------------ ??? [160] 100.0% [168] 293(0.4%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [170] 100.0% ------------------------------------------------------------------------------------------------------------------ bfcanonicalize [167] 100.0% [169] 310(0.4%) 310(0.4%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------------------------------------ contract? [168] 100.0% [170] 293(0.4%) 293(0.4%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------------------------------------