Profiling results ----------------- Total cpu time observed: 1271824ms (out of 1277455ms) Number of samples taken: 4455 (once every 285ms) (Hiding functions with self<1.0% and local<2.0%: 21 of 282 hidden) ============================================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================================= [1] 1271824(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [13] 100.0% --------------------------------------------------------------------------------------------- loop [222] 100.0% [2] 105620(8.3%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [14] 82.8% loop [222] 7.6% sort-context-on-expr [15] 6.3% err-lsts->split-indices [16] 2.7% pick-errors [19] 0.5% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [3] 17040(1.3%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 ??? [182] 62.0% hash-ref! [186] 38.0% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [4] 13491(1.1%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [171] 84.7% hash-ref! [186] 15.3% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [5] 9996(0.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [186] 58.0% ??? [182] 42.0% --------------------------------------------------------------------------------------------- loop [222] 100.0% [6] 7740(0.6%) 868(0.1%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [222] 59.1% eval-const-expr [18] 14.8% ??? [84] 3.8% compose [20] 3.7% simple-compose [21] 3.7% make-sequence [246] 3.6% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [7] 5016(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 hash-ref! [186] 82.1% simplify [199] 17.9% --------------------------------------------------------------------------------------------- loop [222] 49.4% gather-additive-terms [237] 50.6% [8] 1766(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [17] 100.0% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [9] 1174(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:357:30 hash-ref! [186] 75.4% ??? [182] 24.6% --------------------------------------------------------------------------------------------- taylor [213] 100.0% [10] 292(0.0%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [199] 100.0% --------------------------------------------------------------------------------------------- taylor [213] 100.0% [11] 288(0.0%) 0(0.0%) taylor-exp ...lt-testing/src/core/taylor.rkt:386:0 simplify [199] 100.0% --------------------------------------------------------------------------------------------- f53 [203] 100.0% [12] 284(0.0%) 0(0.0%) exprs-to-branch-on ...ng/src/core/regimes.rkt:42:0 all-critical-subexpressions [22] 100.0% --------------------------------------------------------------------------------------------- ??? [1] 100.0% [13] 1271824(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [23] 100.0% --------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [14] 87469(6.9%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [24] 100.0% --------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [15] 6631(0.5%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [25] 95.5% eval-prog [143] 4.5% --------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [16] 2883(0.2%) 1434(0.1%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [67] 40.4% check-list [247] 9.9% --------------------------------------------------------------------------------------------- make-multiplication-node [8] 100.0% [17] 1766(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubnode [26] 83.5% group-by [27] 16.5% --------------------------------------------------------------------------------------------- set-precompute! [6] 100.0% [18] 1144(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f53 [203] 100.0% --------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [19] 578(0.0%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [200] 100.0% --------------------------------------------------------------------------------------------- set-precompute! [6] 100.0% [20] 289(0.0%) 0(0.0%) compose ...collects/racket/private/list.rkt:404:12 procedure-keywords [144] 100.0% --------------------------------------------------------------------------------------------- set-precompute! [6] 100.0% [21] 288(0.0%) 288(0.0%) simple-compose ...s/racket/private/list.rkt:426:10 --------------------------------------------------------------------------------------------- exprs-to-branch-on [12] 100.0% [22] 284(0.0%) 0(0.0%) all-critical-subexpressions ...re/regimes.rkt:58:0 f53 [203] 100.0% --------------------------------------------------------------------------------------------- profile-thunk [13] 100.0% [23] 1271824(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [28] 100.0% --------------------------------------------------------------------------------------------- sindices->spoints [14] 47.9% loop [24] 52.1% [24] 87469(6.9%) 0(0.0%) loop .../private/map.rkt:54:19 loop [24] 52.1% sidx->spoint [29] 47.9% --------------------------------------------------------------------------------------------- sort-context-on-expr [15] 100.0% [25] 6336(0.5%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [30] 100.0% --------------------------------------------------------------------------------------------- make-multiplication-subnode [17] 100.0% [26] 1474(0.1%) 298(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 mterm->expr [36] 39.9% make-multiplication-subsubsubnode [31] 20.2% partition [32] 19.6% --------------------------------------------------------------------------------------------- make-multiplication-subnode [17] 100.0% [27] 292(0.0%) 0(0.0%) group-by .../racket/collects/racket/list.rkt:816:0 sort [251] 100.0% --------------------------------------------------------------------------------------------- ??? [23] 100.0% [28] 1271824(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [33] 98.7% prepare-points [44] 1.3% --------------------------------------------------------------------------------------------- loop [24] 100.0% [29] 87469(6.9%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [34] 100.0% --------------------------------------------------------------------------------------------- ??? [25] 100.0% [30] 6336(0.5%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [35] 81.6% ...row-higher-order.rkt:375:33 [149] 9.3% ??? [204] 9.1% --------------------------------------------------------------------------------------------- make-multiplication-subsubnode [26] 100.0% [31] 298(0.0%) 0(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 mterm->expr [36] 100.0% --------------------------------------------------------------------------------------------- make-multiplication-subsubnode [26] 100.0% [32] 290(0.0%) 290(0.0%) partition ...racket/collects/racket/list.rkt:556:0 --------------------------------------------------------------------------------------------- ??? [28] 100.0% [33] 1255673(98.7%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [37] 91.4% get-final-combination [38] 8.6% setup-alt-simplified [41] 0.0% --------------------------------------------------------------------------------------------- sidx->spoint [29] 100.0% [34] 87469(6.9%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [39] 100.0% --------------------------------------------------------------------------------------------- generic-sort/key [30] 33.9% copying-mergesort [35] 66.1% [35] 5171(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [35] 66.1% ??? [204] 31.5% ...row-higher-order.rkt:375:33 [149] 2.4% --------------------------------------------------------------------------------------------- make-multiplication-subsubsubnode [31] 33.6% make-multiplication-subsubnode [26] 66.4% [36] 886(0.1%) 0(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 ...sting/src/common.rkt:47:2 [170] 67.2% expression->type [40] 32.8% --------------------------------------------------------------------------------------------- run-improve [33] 100.0% [37] 1147158(90.2%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [42] 94.9% finalize-iter! [45] 2.2% gen-series! [46] 1.9% choose-best-alt! [47] 0.5% localize! [48] 0.4% gen-rewrites! [49] 0.1% --------------------------------------------------------------------------------------------- run-improve [33] 100.0% [38] 107363(8.4%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [43] 99.5% loop [222] 0.5% --------------------------------------------------------------------------------------------- binary-search-floats [34] 100.0% [39] 87469(6.9%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [44] 73.7% errors [131] 26.0% ...row-higher-order.rkt:375:33 [149] 0.3% --------------------------------------------------------------------------------------------- mterm->expr [36] 49.5% loop [210] 50.5% [40] 587(0.0%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 f53 [203] 50.5% ??? [106] 49.5% --------------------------------------------------------------------------------------------- run-improve [33] 100.0% [41] 568(0.0%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [50] 100.0% --------------------------------------------------------------------------------------------- run-iter! [37] 100.0% [42] 1088215(85.6%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [51] 100.0% --------------------------------------------------------------------------------------------- get-final-combination [38] 100.0% [43] 106775(8.4%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f53 [203] 99.2% ??? [106] 0.8% --------------------------------------------------------------------------------------------- ??? [28] 19.9% pred [39] 79.4% [44] 81202(6.4%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 make-exacts* [57] 58.6% loop [58] 32.0% make-exacts [53] 7.2% debug-print [227] 0.7% debug [208] 0.4% reverse [187] 0.4% --------------------------------------------------------------------------------------------- run-iter! [37] 100.0% [45] 25200(2.0%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [106] 100.0% --------------------------------------------------------------------------------------------- run-iter! [37] 100.0% [46] 22242(1.7%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [52] 100.0% --------------------------------------------------------------------------------------------- run-iter! [37] 100.0% [47] 5707(0.4%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [106] 100.0% --------------------------------------------------------------------------------------------- run-iter! [37] 100.0% [48] 4339(0.3%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [54] 100.0% --------------------------------------------------------------------------------------------- run-iter! [37] 100.0% [49] 1456(0.1%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [55] 100.0% --------------------------------------------------------------------------------------------- setup-alt-simplified [41] 100.0% [50] 568(0.0%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [56] 100.0% --------------------------------------------------------------------------------------------- simplify! [42] 100.0% [51] 1088215(85.6%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [56] 100.0% --------------------------------------------------------------------------------------------- gen-series! [46] 100.0% [52] 22242(1.7%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [149] 100.0% --------------------------------------------------------------------------------------------- prepare-points [44] 100.0% [53] 5846(0.5%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [58] 80.1% make-exacts* [57] 19.9% --------------------------------------------------------------------------------------------- localize! [48] 100.0% [54] 4339(0.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [186] 100.0% --------------------------------------------------------------------------------------------- gen-rewrites! [49] 100.0% [55] 1456(0.1%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [59] 100.0% --------------------------------------------------------------------------------------------- simplify-alt [50] 0.1% ??? [51] 99.9% [56] 1088783(85.6%) 288(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [60] 99.9% *simplify-rules* [63] 0.1% --------------------------------------------------------------------------------------------- make-exacts [53] 2.4% prepare-points [44] 97.6% [57] 48750(3.8%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [143] 100.0% --------------------------------------------------------------------------------------------- make-exacts [53] 15.3% prepare-points [44] 84.7% [58] 30694(2.4%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [222] 100.0% --------------------------------------------------------------------------------------------- alt-rewrite-rm [55] 21.7% matcher [61] 78.3% [59] 1456(0.1%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [61] 78.3% *rules* [62] 21.7% --------------------------------------------------------------------------------------------- simplify [56] 100.0% [60] 1087330(85.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [64] 97.1% loop [65] 2.8% mk-egraph [68] 0.1% --------------------------------------------------------------------------------------------- matcher [61] 50.0% rewriter [59] 50.0% [61] 1456(0.1%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [61] 50.0% rewriter [59] 50.0% --------------------------------------------------------------------------------------------- rewriter [59] 100.0% [62] 1456(0.1%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [66] 40.0% reverse [187] 20.2% ??? [67] 20.0% list-member? [74] 19.8% --------------------------------------------------------------------------------------------- simplify [56] 100.0% [63] 1164(0.1%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [66] 100.0% --------------------------------------------------------------------------------------------- ??? [60] 100.0% [64] 1055964(83.0%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [69] 99.3% loop [222] 0.7% --------------------------------------------------------------------------------------------- ??? [60] 100.0% [65] 30510(2.4%) 866(0.1%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 loop [70] 55.8% mk-min [71] 37.6% reverse [187] 1.9% filter [188] 0.9% make-sequence [246] 0.9% --------------------------------------------------------------------------------------------- *rules* [62] 33.3% *simplify-rules* [63] 66.7% [66] 1747(0.1%) 1452(0.1%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [183] 16.9% --------------------------------------------------------------------------------------------- *rules* [62] 20.0% err-lsts->split-indices [16] 80.0% [67] 1455(0.1%) 1455(0.1%) ??? ...e/racket/collects/racket/function.rkt:93:12 --------------------------------------------------------------------------------------------- ??? [60] 100.0% [68] 857(0.1%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [72] 100.0% --------------------------------------------------------------------------------------------- iterate-egraph! [64] 100.0% [69] 1048224(82.4%) 8364(0.7%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 merge-egraph-nodes! [73] 43.3% list-member? [74] 27.9% match-e [75] 13.1% loop! [80] 6.1% mk-enode! [82] 3.2% substitute-e [77] 2.5% custom-set-member? [78] 2.3% filter [188] 0.2% in-set [225] 0.2% reverse [187] 0.1% ??? [86] 0.1% update-leader! [81] 0.1% pack-leader [109] 0.1% --------------------------------------------------------------------------------------------- loop [65] 100.0% [70] 17028(1.3%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [76] 100.0% --------------------------------------------------------------------------------------------- loop [65] 100.0% [71] 11466(0.9%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [76] 100.0% --------------------------------------------------------------------------------------------- mk-egraph [68] 32.4% loop [222] 67.6% [72] 857(0.1%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [222] 100.0% --------------------------------------------------------------------------------------------- merge-egraph-nodes! [73] 34.1% one-iter [69] 65.9% [73] 453776(35.7%) 866(0.1%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [81] 40.4% merge-egraph-nodes! [73] 34.1% loop! [80] 25.0% make-sequence [246] 0.2% enode-merge! [87] 0.2% --------------------------------------------------------------------------------------------- *rules* [62] 0.1% one-iter [69] 99.9% [74] 292624(23.0%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [79] 100.0% --------------------------------------------------------------------------------------------- match-e [75] 28.8% one-iter [69] 71.2% [75] 137610(10.8%) 43301(3.4%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [75] 28.8% loop [222] 8.5% ??? [84] 6.6% reverse [187] 6.2% ??? [106] 5.9% variable? [83] 4.3% make-sequence [246] 3.7% do-procedure-reduce-keyword-arity [94] 2.7% list-cartesian-product [85] 2.2% in-set [225] 2.0% ??? [86] 1.2% pack-leader [109] 1.0% check-list [247] 0.9% custom-in-set [261] 0.6% filter [188] 0.4% make-curried [88] 0.4% --------------------------------------------------------------------------------------------- mk-min [71] 40.2% loop [70] 59.8% [76] 28493(2.2%) 1141(0.1%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [107] 57.6% ...sting/src/common.rkt:47:2 [170] 23.1% compile [150] 13.2% second [89] 2.0% --------------------------------------------------------------------------------------------- substitute-e [77] 10.8% one-iter [69] 89.2% [77] 26222(2.1%) 286(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [82] 82.5% substitute-e [77] 10.8% ??? [106] 3.1% variable? [83] 2.4% assoc [257] 0.9% --------------------------------------------------------------------------------------------- one-iter [69] 100.0% [78] 23804(1.9%) 23804(1.9%) custom-set-member? ...t/private/set-types.rkt:45:0 --------------------------------------------------------------------------------------------- list-member? [74] 100.0% [79] 292624(23.0%) 292624(23.0%) member ...collects/racket/private/member.rkt:13:21 --------------------------------------------------------------------------------------------- one-iter [69] 15.6% loop [222] 27.2% merge-egraph-nodes! [73] 57.2% [80] 290354(22.8%) 31090(2.4%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [99] 44.8% loop [222] 28.7% make-immutable-set [91] 11.5% ??? [93] 7.8% in-set [225] 0.4% --------------------------------------------------------------------------------------------- one-iter [69] 0.4% merge-egraph-nodes! [73] 99.6% [81] 225467(17.7%) 102108(8.0%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [90] 46.0% update-en-expr [103] 5.8% reverse [187] 2.4% hash-ref! [186] 0.1% make-sequence [246] 0.1% --------------------------------------------------------------------------------------------- loop [222] 1.5% substitute-e [77] 38.9% one-iter [69] 59.6% [82] 55600(4.4%) 5143(0.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [92] 88.7% hash-has-key? [111] 2.0% --------------------------------------------------------------------------------------------- f53 [203] 1.6% free-variables [241] 4.7% substitute-e [77] 9.3% match-e [75] 84.4% [83] 18348(1.4%) 1156(0.1%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [106] 93.7% --------------------------------------------------------------------------------------------- set-precompute! [6] 2.6% match-e [75] 97.4% [84] 11505(0.9%) 298(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [95] 54.8% do-procedure-reduce-keyword-arity [94] 42.6% --------------------------------------------------------------------------------------------- list-cartesian-product [85] 28.7% match-e [75] 71.3% [85] 4046(0.3%) 2612(0.2%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [85] 28.7% make-sequence [246] 21.4% reverse [187] 6.9% --------------------------------------------------------------------------------------------- one-iter [69] 33.3% match-e [75] 66.7% [86] 2608(0.2%) 578(0.0%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 make-sequence [246] 22.2% ??? [106] 22.0% custom-in-set [261] 11.3% in-set [225] 11.2% pack-leader [109] 11.2% --------------------------------------------------------------------------------------------- merge-egraph-nodes! [73] 100.0% [87] 871(0.1%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 adopt-enode! [96] 66.1% custom-set-intersect! [97] 33.9% --------------------------------------------------------------------------------------------- match-e [75] 100.0% [88] 856(0.1%) 0(0.0%) make-curried ...collects/racket/function.rkt:130:9 make-keyword-procedure [135] 66.0% partially-applied-procedure-arity-mask [98] 34.0% --------------------------------------------------------------------------------------------- expression-cost [76] 100.0% [89] 578(0.0%) 578(0.0%) second ...are/racket/collects/racket/list.rkt:85:0 --------------------------------------------------------------------------------------------- update-leader! [81] 100.0% [90] 103804(8.2%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [100] 100.0% --------------------------------------------------------------------------------------------- loop! [80] 100.0% [91] 66507(5.2%) 64274(5.1%) make-immutable-set .../private/set-types.rkt:948:0 stream? [102] 3.4% --------------------------------------------------------------------------------------------- mk-enode! [82] 100.0% [92] 49319(3.9%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [101] 99.4% --------------------------------------------------------------------------------------------- loop! [80] 100.0% [93] 45569(3.6%) 2808(0.2%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [103] 60.8% reverse [187] 33.0% --------------------------------------------------------------------------------------------- match-e [75] 46.7% ??? [84] 53.3% [94] 9200(0.7%) 6595(0.5%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [144] 28.3% --------------------------------------------------------------------------------------------- ??? [84] 100.0% [95] 6302(0.5%) 4876(0.4%) do-curry ...cket/collects/racket/function.rkt:71:2 procedure-keywords [144] 18.1% make-keyword-procedure [135] 4.6% --------------------------------------------------------------------------------------------- enode-merge! [87] 100.0% [96] 576(0.0%) 282(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 custom-set-union [99] 51.0% --------------------------------------------------------------------------------------------- enode-merge! [87] 100.0% [97] 295(0.0%) 0(0.0%) custom-set-intersect! ...ivate/set-types.rkt:269:0 set-check-compatible [110] 100.0% --------------------------------------------------------------------------------------------- make-curried [88] 100.0% [98] 291(0.0%) 291(0.0%) partially-applied-procedure-arity-mask ...rkt:58:2 --------------------------------------------------------------------------------------------- adopt-enode! [96] 0.2% loop! [80] 99.8% [99] 137732(10.8%) 115830(9.1%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [105] 13.5% check-list [247] 2.4% --------------------------------------------------------------------------------------------- do-hash-update [90] 100.0% [100] 103804(8.2%) 90446(7.1%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [103] 9.2% reverse [187] 3.7% --------------------------------------------------------------------------------------------- new-enode [92] 100.0% [101] 49030(3.9%) 580(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [104] 98.2% f53 [203] 0.6% --------------------------------------------------------------------------------------------- make-immutable-set [91] 100.0% [102] 2232(0.2%) 2232(0.2%) stream? ...t/collects/racket/private/for.rkt:493:2 --------------------------------------------------------------------------------------------- ??? [100] 18.9% update-leader! [81] 25.9% ??? [93] 55.2% [103] 50214(3.9%) 33884(2.7%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [246] 18.5% pack-leader [109] 14.1% --------------------------------------------------------------------------------------------- f53 [203] 0.6% type-of-enode-expr [101] 99.4% [104] 48458(3.8%) 564(0.0%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [107] 37.3% ??? [108] 22.5% ...sting/src/common.rkt:47:2 [170] 20.8% ??? [106] 16.6% hash-has-key? [111] 1.8% --------------------------------------------------------------------------------------------- custom-set-union [99] 100.0% [105] 18591(1.5%) 14452(1.1%) choose-immutable ...et/private/set-types.rkt:151:0 set-check-compatible [110] 11.8% check-list [247] 10.4% --------------------------------------------------------------------------------------------- expression->type [40] 0.3% ??? [86] 0.7% split-table [43] 1.0% f53 [203] 1.0% substitute-e [77] 2.4% ??? [223] 5.1% choose-best-alt! [47] 6.8% get-sigs [104] 9.6% variable? [83] 20.6% match-e [75] 20.9% finalize-iter! [45] 30.0% [106] 83488(6.6%) 2304(0.2%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [111] 58.7% atab-add-altns [112] 30.0% atab-pick-alt [114] 6.8% split-atab [115] 1.0% ??? [223] 0.7% --------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [149] 12.6% expression-cost [76] 41.6% get-sigs [104] 45.8% [107] 39452(3.1%) 9218(0.7%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [116] 67.1% return/no-unsupplied [183] 2.9% in-set [225] 1.5% reverse [187] 1.5% ...sting/src/common.rkt:47:2 [170] 1.4% check-list [247] 0.7% --------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [149] 2.4% f53 [203] 2.5% ->bf [166] 2.5% get-sigs [104] 92.7% [108] 11748(0.9%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [113] 73.1% handle-the-hash [123] 19.5% arrow-higher-order:lnp [127] 2.5% ??? [122] 2.5% get/build-late-neg-projection [145] 2.4% --------------------------------------------------------------------------------------------- ??? [86] 3.1% one-iter [69] 6.2% match-e [75] 15.3% update-en-expr [103] 75.5% [109] 9364(0.7%) 9364(0.7%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 --------------------------------------------------------------------------------------------- custom-set-intersect! [97] 11.8% choose-immutable [105] 88.2% [110] 2497(0.2%) 2497(0.2%) set-check-compatible ...rivate/set-types.rkt:531:0 --------------------------------------------------------------------------------------------- get-sigs [104] 1.7% mk-enode! [82] 2.2% ??? [106] 96.1% [111] 51124(4.0%) 37600(3.0%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [116] 25.9% reverse [187] 0.6% --------------------------------------------------------------------------------------------- ??? [106] 100.0% [112] 25200(2.0%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [117] 100.0% --------------------------------------------------------------------------------------------- ??? [108] 100.0% [113] 8592(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [118] 100.0% --------------------------------------------------------------------------------------------- ??? [106] 100.0% [114] 5707(0.4%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [119] 59.6% ...row-higher-order.rkt:375:33 [149] 25.2% write-json* [120] 15.2% --------------------------------------------------------------------------------------------- ??? [106] 100.0% [115] 871(0.1%) 0(0.0%) split-atab ...testing/src/core/alt-table.rkt:105:0 filter [188] 100.0% --------------------------------------------------------------------------------------------- hash-has-key? [111] 33.3% table-ref [107] 66.7% [116] 39723(3.1%) 18727(1.5%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [122] 29.0% handle-the-hash [123] 15.2% successfully-got-the-right-kind-of-function [126] 3.6% ??? [185] 2.2% arrow-higher-order:lnp [127] 1.5% check-list [247] 0.7% ??? [181] 0.7% --------------------------------------------------------------------------------------------- atab-add-altns [112] 100.0% [117] 25200(2.0%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [121] 87.5% override-at-pnts [125] 10.3% minimize-alts [130] 1.1% --------------------------------------------------------------------------------------------- ??? [113] 100.0% [118] 8592(0.7%) 3721(0.3%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [124] 50.1% ??? [129] 6.6% --------------------------------------------------------------------------------------------- atab-pick-alt [114] 100.0% [119] 3404(0.3%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [222] 100.0% --------------------------------------------------------------------------------------------- atab-pick-alt [114] 100.0% [120] 868(0.1%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [128] 100.0% --------------------------------------------------------------------------------------------- atab-add-altn [117] 100.0% [121] 22044(1.7%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [131] 98.7% reverse [187] 1.3% --------------------------------------------------------------------------------------------- ??? [108] 2.4% ??? [116] 97.6% [122] 11820(0.9%) 5178(0.4%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 loop [133] 27.0% blame-add-missing-party [134] 16.9% make-keyword-procedure [135] 4.9% update-the-info [138] 4.9% ??? [140] 2.4% --------------------------------------------------------------------------------------------- ??? [177] 3.3% ??? [108] 26.7% ??? [116] 70.0% [123] 8604(0.7%) 2874(0.2%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [181] 66.6% --------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [118] 100.0% [124] 4304(0.3%) 286(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [132] 80.0% do-blame-add-context [136] 13.3% --------------------------------------------------------------------------------------------- atab-add-altn [117] 100.0% [125] 2592(0.2%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [131] 100.0% --------------------------------------------------------------------------------------------- ??? [116] 100.0% [126] 1416(0.1%) 870(0.1%) successfully-got-the-right-kind-of-function ...5:4 popular-chaperone-key-id42 [139] 20.4% val-has-arrow-collapsible-support? [142] 18.2% --------------------------------------------------------------------------------------------- ??? [108] 33.1% ??? [116] 66.9% [127] 876(0.1%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ??? [137] 100.0% --------------------------------------------------------------------------------------------- write-json* [120] 25.0% loop [128] 75.0% [128] 868(0.1%) 868(0.1%) loop .../share/racket/collects/json/main.rkt:132:2 loop [128] 75.0% --------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [118] 100.0% [129] 566(0.0%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:34 do-blame-add-context [136] 100.0% --------------------------------------------------------------------------------------------- atab-add-altn [117] 100.0% [130] 278(0.0%) 0(0.0%) minimize-alts ...ting/src/core/alt-table.rkt:193:0 rm-alts [141] 100.0% --------------------------------------------------------------------------------------------- composed [216] 3.4% override-at-pnts [125] 4.3% loop [222] 17.8% best-and-tied-at-points [121] 36.4% pred [39] 38.0% [131] 59697(4.7%) 284(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [204] 49.9% eval-prog [143] 47.2% ...row-higher-order.rkt:375:33 [149] 1.0% ulp-difference [146] 1.0% flonums-between [147] 0.5% --------------------------------------------------------------------------------------------- ??? [124] 100.0% [132] 3444(0.3%) 566(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [145] 83.6% --------------------------------------------------------------------------------------------- ??? [122] 42.2% loop [133] 57.8% [133] 3192(0.3%) 3192(0.3%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [133] 57.8% --------------------------------------------------------------------------------------------- ??? [122] 100.0% [134] 2002(0.2%) 2002(0.2%) blame-add-missing-party ...private/blame.rkt:382:0 --------------------------------------------------------------------------------------------- do-curry [95] 20.1% make-curried [88] 39.3% ??? [122] 40.6% [135] 1436(0.1%) 1436(0.1%) make-keyword-procedure ...ket/private/kw.rkt:448:4 --------------------------------------------------------------------------------------------- ??? [129] 49.6% ??? [124] 50.4% [136] 1140(0.1%) 1140(0.1%) do-blame-add-context ...ct/private/blame.rkt:192:0 --------------------------------------------------------------------------------------------- arrow-higher-order:lnp [127] 100.0% [137] 876(0.1%) 586(0.0%) ??? ...et/contract/private/arity-checking.rkt:19:2 procedure-keywords [144] 33.1% --------------------------------------------------------------------------------------------- ??? [122] 100.0% [138] 579(0.0%) 579(0.0%) update-the-info ...ontract/private/blame.rkt:318:0 --------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [126]100.0% [139] 288(0.0%) 288(0.0%) popular-chaperone-key-id42 ...igher-order.rkt:50:6 --------------------------------------------------------------------------------------------- ??? [122] 100.0% [140] 288(0.0%) 288(0.0%) ??? ...rivate/unconstrained-domain-arrow.rkt:19:10 --------------------------------------------------------------------------------------------- minimize-alts [130] 100.0% [141] 278(0.0%) 0(0.0%) rm-alts ...lt-testing/src/core/alt-table.rkt:222:0 loop [148] 100.0% --------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [126]100.0% [142] 258(0.0%) 258(0.0%) val-has-arrow-collapsible-support? ...le.rkt:116:0 --------------------------------------------------------------------------------------------- sort-context-on-expr [15] 0.4% ??? [195] 4.6% errors [131] 34.8% make-exacts* [57] 60.2% [143] 80958(6.4%) 39761(3.1%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [150] 32.2% f53 [203] 16.2% ??? [152] 0.7% parse-app [153] 0.7% ...row-higher-order.rkt:375:33 [149] 0.4% parse-lambda [156] 0.3% go [157] 0.3% --------------------------------------------------------------------------------------------- compose [20] 6.7% ??? [137] 6.7% do-curry [95] 26.3% do-procedure-reduce-keyword-arity [94] 60.3% [144] 4322(0.3%) 4322(0.3%) procedure-keywords .../racket/private/kw.rkt:534:2 --------------------------------------------------------------------------------------------- ??? [108] 9.0% ??? [132] 91.0% [145] 3160(0.2%) 283(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [151] 81.6% contract-struct-late-neg-projection [154] 9.4% --------------------------------------------------------------------------------------------- errors [131] 100.0% [146] 573(0.0%) 290(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [183] 49.3% --------------------------------------------------------------------------------------------- errors [131] 100.0% [147] 289(0.0%) 0(0.0%) flonums-between ...te/flonum/flonum-bits.rkt:103:2 flonum->ordinal [155] 100.0% --------------------------------------------------------------------------------------------- rm-alts [141] 1.4% loop [148] 98.6% [148] 278(0.0%) 278(0.0%) loop ...are/racket/collects/racket/list.rkt:435:28 loop [148] 98.6% --------------------------------------------------------------------------------------------- pred [39] 0.6% eval-prog [143] 0.6% copying-mergesort [35] 1.1% errors [131] 1.2% generic-sort/key [30] 1.2% atab-pick-alt [114] 3.0% loop [222] 21.4% loop [158] 23.0% taylor-alt [52] 23.0% f53 [203] 23.6% [149] 48277(3.8%) 882(0.1%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 loop [158] 23.0% approximate [159] 23.0% ->flonum [160] 15.5% table-ref [107] 10.3% ??? [223] 8.5% real->bigfloat [161] 7.6% ...sting/src/common.rkt:47:2 [170] 4.2% best-alt [163] 3.0% sample-multi-bounded [164] 1.2% ->bf [166] 0.6% ??? [108] 0.6% --------------------------------------------------------------------------------------------- expression-cost [76] 12.6% eval-prog [143] 87.4% [150] 29846(2.3%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [186] 100.0% --------------------------------------------------------------------------------------------- get/build-late-neg-projection [145] 100.0% [151] 2580(0.2%) 569(0.0%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [162] 78.0% --------------------------------------------------------------------------------------------- eval-prog [143] 100.0% [152] 577(0.0%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [165] 100.0% --------------------------------------------------------------------------------------------- eval-prog [143] 100.0% [153] 564(0.0%) 290(0.0%) parse-app ...collects/racket/private/kw.rkt:1207:2 identifier? [168] 48.7% --------------------------------------------------------------------------------------------- get/build-late-neg-projection [145] 100.0% [154] 297(0.0%) 297(0.0%) contract-struct-late-neg-projection ...p.rkt:121:0 --------------------------------------------------------------------------------------------- flonums-between [147] 100.0% [155] 289(0.0%) 289(0.0%) flonum->ordinal ...ate/flonum/flonum-bits.rkt:68:0 --------------------------------------------------------------------------------------------- eval-prog [143] 100.0% [156] 279(0.0%) 0(0.0%) parse-lambda ...llects/racket/private/kw.rkt:659:2 simple-args? [167] 100.0% --------------------------------------------------------------------------------------------- eval-prog [143] 100.0% [157] 272(0.0%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [169] 100.0% --------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [149] 12.4% loop [158] 87.6% [158] 22242(1.7%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [158] 87.6% ...row-higher-order.rkt:375:33 [149] 12.4% --------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [149] 100.0% [159] 22242(1.7%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [186] 60.7% ??? [171] 23.7% taylor-sqrt [172] 9.0% taylor [213] 6.6% --------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [149] 100.0% [160] 7490(0.6%) 4242(0.3%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [183] 27.2% ...sting/src/common.rkt:47:2 [170] 16.1% --------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [149] 100.0% [161] 3688(0.3%) 1500(0.1%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [248] 51.4% ??? [176] 7.9% --------------------------------------------------------------------------------------------- contract-struct-name [174] 21.3% ??? [151] 78.7% [162] 2012(0.2%) 856(0.1%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [174] 78.7% --------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [149] 100.0% [163] 1436(0.1%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [173] 100.0% --------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [149] 100.0% [164] 586(0.0%) 294(0.0%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [175] 50.0% --------------------------------------------------------------------------------------------- ??? [152] 100.0% [165] 577(0.0%) 577(0.0%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 --------------------------------------------------------------------------------------------- ...row-higher-order.rkt:375:33 [149] 100.0% [166] 290(0.0%) 0(0.0%) ->bf ...s/herbie/alt-testing/src/programs.rkt:53:0 ??? [108] 100.0% --------------------------------------------------------------------------------------------- parse-lambda [156] 100.0% [167] 279(0.0%) 279(0.0%) simple-args? ...llects/racket/private/kw.rkt:572:2 --------------------------------------------------------------------------------------------- parse-app [153] 100.0% [168] 275(0.0%) 275(0.0%) identifier? ...ollects/racket/private/stx.rkt:13:4 --------------------------------------------------------------------------------------------- go [157] 20.0% loop [169] 80.0% [169] 272(0.0%) 272(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [169] 80.0% --------------------------------------------------------------------------------------------- f53 [203] 1.3% ??? [214] 1.3% table-ref [107] 2.6% mterm->expr [36] 2.8% ??? [178] 3.9% ->flonum [160] 5.6% ...row-higher-order.rkt:375:33 [149] 9.5% expression-cost [76] 29.8% get-sigs [104] 43.2% [170] 21632(1.7%) 3188(0.3%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [177] 46.4% ??? [178] 37.4% ??? [223] 2.7% --------------------------------------------------------------------------------------------- approximate [159] 28.1% ??? [4] 71.9% [171] 18766(1.5%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [186] 100.0% --------------------------------------------------------------------------------------------- f53 [203] 10.0% composed [239] 20.3% approximate [159] 69.6% [172] 2889(0.2%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 hash-ref! [186] 60.2% simplify [199] 29.7% normalize-series [179] 10.0% --------------------------------------------------------------------------------------------- extract-alt [242] 29.1% best-alt [163] 70.9% [173] 2024(0.2%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [216] 100.0% --------------------------------------------------------------------------------------------- build-compound-type-name [162] 100.0% [174] 2012(0.2%) 580(0.0%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [162] 42.5% reverse [187] 28.7% --------------------------------------------------------------------------------------------- sample-multi-bounded [164] 100.0% [175] 293(0.0%) 293(0.0%) random-exp ...bie/alt-testing/src/common.rkt:253:0 --------------------------------------------------------------------------------------------- real->bigfloat [161] 100.0% [176] 292(0.0%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [180] 100.0% --------------------------------------------------------------------------------------------- ??? [181] 24.3% ...sting/src/common.rkt:47:2 [170] 75.7% [177] 10036(0.8%) 4292(0.3%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [181] 38.5% ??? [223] 18.6% ??? [185] 2.9% handle-the-hash [123] 2.9% --------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [170] 100.0% [178] 8942(0.7%) 3474(0.3%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 return/no-unsupplied [183] 26.0% ...sting/src/common.rkt:47:2 [170] 18.9% assoc-ref [184] 16.2% --------------------------------------------------------------------------------------------- taylor-sqrt [172] 25.5% taylor [213] 74.5% [179] 1138(0.1%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [186] 74.5% ??? [182] 25.5% --------------------------------------------------------------------------------------------- ??? [176] 100.0% [180] 292(0.0%) 292(0.0%) assq ...et/collects/racket/private/list.rkt:187:13 --------------------------------------------------------------------------------------------- ??? [116] 2.2% handle-the-hash [123] 46.6% ??? [177] 51.2% [181] 12308(1.0%) 2564(0.2%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [177] 39.6% ??? [189] 37.4% ??? [211] 2.2% --------------------------------------------------------------------------------------------- ??? [9] 2.4% normalize-series [179] 2.4% ??? [5] 30.4% ??? [3] 64.8% [182] 12046(0.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [186] 100.0% --------------------------------------------------------------------------------------------- ulp-difference [146] 4.2% flag-set? [66] 4.4% ??? [214] 8.7% table-ref [107] 17.3% ->flonum [160] 30.5% ??? [178] 34.8% [183] 6680(0.5%) 2610(0.2%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [188] 39.0% reverse [187] 21.9% --------------------------------------------------------------------------------------------- ??? [178] 100.0% [184] 1450(0.1%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [257] 100.0% --------------------------------------------------------------------------------------------- ??? [177] 25.1% ??? [116] 74.9% [185] 1180(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [190] 100.0% --------------------------------------------------------------------------------------------- composed [239] 0.2% ??? [195] 0.2% ??? [9] 0.2% update-leader! [81] 0.5% taylor-sqrt [172] 0.8% ??? [7] 0.8% normalize-series [179] 1.2% ??? [4] 1.6% ??? [5] 1.9% ??? [194] 2.0% ??? [3] 2.4% approximate [159] 4.6% ??? [182] 6.1% ??? [171] 6.8% localize-error [54] 7.0% ??? [193] 7.1% compile [150] 24.4% loop [222] 29.1% [186] 55286(4.3%) 6692(0.5%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [192] 29.4% bigfloat-hash [191] 20.5% ??? [193] 8.3% ??? [195] 7.0% simplify [199] 6.6% ??? [4] 6.2% ??? [3] 5.8% ??? [5] 4.3% ??? [194] 2.0% ??? [7] 1.1% taylor [213] 0.7% f53 [203] 0.6% ??? [9] 0.3% --------------------------------------------------------------------------------------------- list-cartesian-product [85] 0.7% hash-has-key? [111] 0.7% best-and-tied-at-points [121] 0.7% prepare-points [44] 0.7% *rules* [62] 0.7% table-ref [107] 1.4% contract-struct-name [174] 1.4% loop [65] 1.4% one-iter [69] 3.6% return/no-unsupplied [183] 3.6% ??? [100] 9.5% update-leader! [81] 13.4% match-e [75] 24.7% ??? [93] 37.3% [187] 40394(3.2%) 40394(3.2%) reverse ...collects/racket/private/reverse.rkt:6:4 --------------------------------------------------------------------------------------------- loop [65] 4.2% match-e [75] 8.3% split-atab [115] 12.6% one-iter [69] 37.2% return/no-unsupplied [183] 37.7% [188] 6910(0.5%) 6040(0.5%) filter ...t/collects/racket/private/list.rkt:275:2 ??? [197] 12.6% --------------------------------------------------------------------------------------------- ??? [181] 100.0% [189] 4599(0.4%) 1744(0.1%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [211] 55.8% check-list [247] 6.3% --------------------------------------------------------------------------------------------- ??? [185] 100.0% [190] 1180(0.1%) 294(0.0%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [196] 75.1% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [191] 24919(2.0%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [198] 93.1% sig+exp->bigfloat [201] 3.4% bigfloat-signbit [202] 2.3% bigfloat->sig+exp [207] 1.2% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [192] 23768(1.9%) 289(0.0%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [222] 99.8% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [193] 15820(1.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [186] 95.7% simplify [199] 4.3% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [194] 5258(0.4%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [186] 100.0% --------------------------------------------------------------------------------------------- hash-ref! [186] 100.0% [195] 4339(0.3%) 0(0.0%) ??? ...bie/alt-testing/src/core/localize.rkt:22:13 eval-prog [143] 86.6% hash-ref! [186] 6.7% ??? [204] 6.7% --------------------------------------------------------------------------------------------- check-hash/c [190] 100.0% [196] 886(0.1%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [249] 100.0% --------------------------------------------------------------------------------------------- filter [188] 100.0% [197] 871(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:302:4 ??? [200] 100.0% --------------------------------------------------------------------------------------------- bigfloat-hash [191] 100.0% [198] 23196(1.8%) 291(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [205] 96.2% bigfloat->sig+exp [207] 2.5% --------------------------------------------------------------------------------------------- taylor-exp [11] 1.3% taylor-invert [10] 1.4% loop [222] 1.4% taylor-sqrt [172] 4.0% ??? [193] 4.0% ??? [7] 4.1% hash-ref! [186] 83.8% [199] 21652(1.7%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f53 [203] 85.1% debug-print [227] 5.4% simplify-node [206] 2.7% loop [210] 2.7% debug [208] 2.7% --------------------------------------------------------------------------------------------- loop [222] 16.7% pick-errors [19] 33.2% ??? [197] 50.0% [200] 1740(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [204] 100.0% --------------------------------------------------------------------------------------------- bigfloat-hash [191] 100.0% [201] 858(0.1%) 0(0.0%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:404:0 integer->mpz [209] 100.0% --------------------------------------------------------------------------------------------- bigfloat-hash [191] 100.0% [202] 572(0.0%) 287(0.0%) bigfloat-signbit ...rivate/bigfloat/mpfr.rkt:379:0 ^TYPE? [235] 49.8% --------------------------------------------------------------------------------------------- all-critical-subexpressions [22] 0.0% composed [216] 0.1% type-of-enode-expr [101] 0.2% taylor [213] 0.2% expression->type [40] 0.2% hash-ref! [186] 0.5% eval-const-expr [18] 0.9% f53 [203] 2.0% eval-prog [143] 2.6% simplify [199] 6.1% loop [222] 12.1% split-table [43] 75.1% [203] 128963(10.1%) 14012(1.1%) f53 ...t/collects/racket/match/compiler.rkt:548:40 loop [222] 89.3% ...row-higher-order.rkt:375:33 [149] 2.3% f53 [203] 2.0% taylor [213] 0.5% get-sigs [104] 0.2% ??? [221] 0.2% ??? [108] 0.2% ...sting/src/common.rkt:47:2 [170] 0.2% ??? [106] 0.2% taylor-sqrt [172] 0.1% composed [216] 0.1% exprs-to-branch-on [12] 0.0% variable? [83] 0.0% --------------------------------------------------------------------------------------------- ??? [195] 0.4% generic-sort/key [30] 0.9% ??? [200] 2.6% copying-mergesort [35] 6.9% errors [131] 44.3% loop [222] 45.0% [204] 67375(5.3%) 39241(3.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [222] 13.5% bf* [212] 6.6% ??? [224] 6.5% ??? [214] 3.9% ??? [211] 3.9% ??? [215] 3.4% ??? [217] 3.0% --------------------------------------------------------------------------------------------- bfcanonicalize [198] 100.0% [205] 22323(1.8%) 22323(1.8%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 --------------------------------------------------------------------------------------------- gather-additive-terms [237] 9.8% simplify [199] 29.9% loop [222] 60.4% [206] 1480(0.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 gather-additive-terms [237] 70.1% gather-multiplicative-terms [243] 29.9% --------------------------------------------------------------------------------------------- bigfloat-hash [191] 33.5% bfcanonicalize [198] 66.5% [207] 874(0.1%) 0(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:389:0 new-mpz [218] 66.4% mpz->integer [220] 33.6% --------------------------------------------------------------------------------------------- prepare-points [44] 34.1% simplify [199] 65.9% [208] 872(0.1%) 298(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 cur-debug-level [219] 65.9% --------------------------------------------------------------------------------------------- sig+exp->bigfloat [201] 100.0% [209] 858(0.1%) 0(0.0%) integer->mpz ...math/private/bigfloat/gmp.rkt:87:0 new-mpz [218] 100.0% --------------------------------------------------------------------------------------------- simplify [199] 41.8% loop [210] 58.2% [210] 586(0.0%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 loop [210] 58.2% expression->type [40] 25.3% free-variables [241] 16.5% --------------------------------------------------------------------------------------------- ??? [181] 5.1% ??? [189] 47.1% ??? [204] 47.8% [211] 5442(0.4%) 2298(0.2%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [226] 52.7% ??? [229] 5.1% --------------------------------------------------------------------------------------------- ??? [204] 100.0% [212] 4464(0.4%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [224] 100.0% --------------------------------------------------------------------------------------------- composed [239] 0.8% loop [222] 4.2% f53 [203] 15.0% hash-ref! [186] 20.6% approximate [159] 23.6% taylor [213] 35.6% [213] 2900(0.2%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [213] 35.6% loop [222] 20.3% debug-print [227] 20.3% normalize-series [179] 10.4% f53 [203] 5.0% taylor-exp [11] 5.0% taylor-invert [10] 2.5% --------------------------------------------------------------------------------------------- ??? [204] 100.0% [214] 2604(0.2%) 1732(0.1%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [183] 22.3% ...sting/src/common.rkt:47:2 [170] 11.1% --------------------------------------------------------------------------------------------- ??? [204] 100.0% [215] 2315(0.2%) 2315(0.2%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 --------------------------------------------------------------------------------------------- f53 [203] 12.5% argmins [173] 87.5% [216] 2314(0.2%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [131] 87.5% f53 [203] 12.5% --------------------------------------------------------------------------------------------- ??? [204] 100.0% [217] 2036(0.2%) 1166(0.1%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [235] 42.7% --------------------------------------------------------------------------------------------- bigfloat->sig+exp [207] 40.4% integer->mpz [209] 59.6% [218] 1440(0.1%) 1440(0.1%) new-mpz ...-lib/math/private/bigfloat/gmp.rkt:73:0 --------------------------------------------------------------------------------------------- debug [208] 100.0% [219] 575(0.0%) 288(0.0%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 in-set [225] 49.8% --------------------------------------------------------------------------------------------- bigfloat->sig+exp [207] 100.0% [220] 294(0.0%) 0(0.0%) mpz->integer ...ath/private/bigfloat/gmp.rkt:115:0 size+limbs->integer [228] 100.0% --------------------------------------------------------------------------------------------- f53 [203] 100.0% [221] 289(0.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:363:46 ??? [223] 100.0% --------------------------------------------------------------------------------------------- gather-multiplicative-terms [243] 0.0% get-final-combination [38] 0.1% set-precompute! [6] 0.1% gather-additive-terms [237] 0.1% iterate-egraph! [64] 0.2% mk-enode-rec! [72] 0.2% option-on-expr [2] 0.2% taylor [213] 0.2% loop [58] 0.3% point-best-alt [119] 0.3% loop! [80] 0.8% ??? [204] 0.8% ??? [192] 1.9% match-e [75] 2.5% f53 [203] 8.1% loop [222] 84.0% [222] 336675(26.5%) 11139(0.9%) loop .../private/map.rkt:40:19 loop [222] 84.0% option-on-expr [2] 3.8% f53 [203] 3.7% hash-ref! [186] 1.9% step [231] 1.0% loop! [80] 0.7% ...row-higher-order.rkt:375:33 [149] 0.7% errors [131] 0.5% foldl [232] 0.4% ??? [204] 0.3% set-precompute! [6] 0.2% composed [239] 0.1% mk-enode-rec! [72] 0.1% gather-additive-terms [237] 0.1% make-multiplication-node [8] 0.1% rloop [244] 0.1% taylor [213] 0.1% extract-alt [242] 0.1% simplify-node [206] 0.1% free-variables [241] 0.1% mk-enode! [82] 0.1% gather-multiplicative-terms [243] 0.0% keyword-apply [240] 0.0% simplify [199] 0.0% ??? [200] 0.0% --------------------------------------------------------------------------------------------- ??? [221] 3.0% ??? [106] 6.0% ...sting/src/common.rkt:47:2 [170] 9.1% ??? [177] 39.1% ...row-higher-order.rkt:375:33 [149] 42.8% [223] 9534(0.7%) 1144(0.1%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ??? [106] 45.8% contract? [233] 27.1% dict? [236] 15.1% --------------------------------------------------------------------------------------------- ??? [204] 49.5% bf* [212] 50.5% [224] 8834(0.7%) 289(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [230] 83.4% bfsqrt [238] 13.4% --------------------------------------------------------------------------------------------- cur-debug-level [219] 3.4% ??? [86] 3.5% table-ref [107] 7.1% one-iter [69] 20.7% loop! [80] 27.2% match-e [75] 38.1% [225] 8367(0.7%) 8367(0.7%) in-set ...ollects/racket/private/generic.rkt:472:9 --------------------------------------------------------------------------------------------- ??? [211] 100.0% [226] 2868(0.2%) 590(0.0%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [234] 69.4% ^TYPE? [235] 10.0% --------------------------------------------------------------------------------------------- prepare-points [44] 24.9% taylor [213] 25.0% simplify [199] 50.1% [227] 2352(0.2%) 2352(0.2%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 --------------------------------------------------------------------------------------------- mpz->integer [220] 100.0% [228] 294(0.0%) 294(0.0%) size+limbs->integer ...vate/bigfloat/gmp.rkt:103:0 --------------------------------------------------------------------------------------------- ??? [211] 100.0% [229] 276(0.0%) 0(0.0%) ??? ...lects/racket/contract/private/orc.rkt:117:8 eqables-pred [245] 100.0% --------------------------------------------------------------------------------------------- ??? [224] 100.0% [230] 7364(0.6%) 3241(0.3%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [248] 43.8% ??? [252] 12.2% --------------------------------------------------------------------------------------------- loop [222] 100.0% [231] 4265(0.3%) 3408(0.3%) step .../racket/collects/racket/function.rkt:145:9 sort [251] 20.1% --------------------------------------------------------------------------------------------- loop [222] 100.0% [232] 3156(0.2%) 581(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [250] 81.6% --------------------------------------------------------------------------------------------- ??? [223] 100.0% [233] 2582(0.2%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [249] 89.0% coerce-contract/f [255] 11.0% --------------------------------------------------------------------------------------------- ??? [226] 100.0% [234] 1991(0.2%) 1437(0.1%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [247] 27.8% --------------------------------------------------------------------------------------------- bigfloat-signbit [202] 19.8% ??? [226] 19.9% ??? [217] 60.3% [235] 1441(0.1%) 1441(0.1%) ^TYPE? .../ffi/unsafe.rkt:1621:20 --------------------------------------------------------------------------------------------- ??? [223] 100.0% [236] 1440(0.1%) 871(0.1%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [253] 39.5% --------------------------------------------------------------------------------------------- gather-additive-terms [237] 29.4% loop [222] 35.1% simplify-node [206] 35.5% [237] 1182(0.1%) 0(0.0%) gather-additive-terms .../src/core/reduce.rkt:72:0 loop [222] 35.1% gather-additive-terms [237] 29.4% make-multiplication-node [8] 29.4% simplify-node [206] 6.1% --------------------------------------------------------------------------------------------- ??? [224] 100.0% [238] 1180(0.1%) 0(0.0%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [248] 100.0% --------------------------------------------------------------------------------------------- loop [222] 100.0% [239] 1174(0.1%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 taylor-sqrt [172] 50.0% taylor [213] 25.1% hash-ref! [186] 24.9% --------------------------------------------------------------------------------------------- loop [222] 100.0% [240] 1119(0.1%) 840(0.1%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [256] 24.9% --------------------------------------------------------------------------------------------- loop [210] 33.5% loop [222] 66.5% [241] 864(0.1%) 0(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 variable? [83] 100.0% --------------------------------------------------------------------------------------------- loop [222] 100.0% [242] 588(0.0%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [173] 100.0% --------------------------------------------------------------------------------------------- gather-multiplicative-terms [243] 25.4% loop [222] 37.3% simplify-node [206] 37.3% [243] 587(0.0%) 289(0.0%) gather-multiplicative-terms ...re/reduce.rkt:116:0 loop [222] 37.3% gather-multiplicative-terms [243] 25.4% ??? [254] 12.7% --------------------------------------------------------------------------------------------- loop [222] 1.3% rloop [244] 98.7% [244] 287(0.0%) 287(0.0%) rloop ...ket/collects/racket/private/list.rkt:88:4 rloop [244] 98.7% --------------------------------------------------------------------------------------------- ??? [229] 100.0% [245] 276(0.0%) 276(0.0%) eqables-pred ...et/contract/private/orc.rkt:100:10 --------------------------------------------------------------------------------------------- set-precompute! [6] 1.4% update-leader! [81] 1.4% loop [65] 1.5% ??? [86] 2.9% merge-egraph-nodes! [73] 4.5% list-cartesian-product [85] 5.9% match-e [75] 32.1% update-en-expr [103] 47.3% [246] 19596(1.5%) 17890(1.4%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [258] 7.3% ??? [260] 1.4% --------------------------------------------------------------------------------------------- ??? [116] 3.4% err-lsts->split-indices [16] 3.4% table-ref [107] 3.4% ??? [189] 3.4% ??? [234] 6.6% match-e [75] 17.3% choose-immutable [105] 23.1% custom-set-union [99] 39.4% [247] 8394(0.7%) 8394(0.7%) check-list ...ollects/racket/private/for.rkt:690:2 --------------------------------------------------------------------------------------------- bfsqrt [238] 18.7% real->bigfloat [161] 30.1% bfmul [230] 51.2% [248] 6304(0.5%) 6304(0.5%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 --------------------------------------------------------------------------------------------- flat-contract? [196] 27.8% contract? [233] 72.2% [249] 3184(0.3%) 3184(0.3%) simple-flat-contract? ...ct/private/guts.rkt:141:0 --------------------------------------------------------------------------------------------- foldl [232] 100.0% [250] 2574(0.2%) 1148(0.1%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [257] 55.4% --------------------------------------------------------------------------------------------- group-by [27] 25.4% step [231] 74.6% [251] 1149(0.1%) 1149(0.1%) sort ...cket/collects/racket/private/list.rkt:43:2 --------------------------------------------------------------------------------------------- bfmul [230] 100.0% [252] 896(0.1%) 896(0.1%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 --------------------------------------------------------------------------------------------- dict? [236] 100.0% [253] 568(0.0%) 568(0.0%) assoc? ...et/collects/racket/private/dict.rkt:13:0 --------------------------------------------------------------------------------------------- gather-multiplicative-terms [243] 100.0% [254] 298(0.0%) 298(0.0%) ??? .../racket/collects/racket/function.rkt:101:10 --------------------------------------------------------------------------------------------- contract? [233] 100.0% [255] 284(0.0%) 0(0.0%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [259] 100.0% --------------------------------------------------------------------------------------------- keyword-apply [240] 100.0% [256] 279(0.0%) 279(0.0%) loop ...cket/collects/racket/private/kw.rkt:518:13 --------------------------------------------------------------------------------------------- substitute-e [77] 16.4% merge2 [250] 41.4% assoc-ref [184] 42.1% [257] 3442(0.3%) 3442(0.3%) assoc ...t/collects/racket/private/list.rkt:196:13 --------------------------------------------------------------------------------------------- make-sequence [246] 100.0% [258] 1428(0.1%) 1428(0.1%) :hash-gen ...collects/racket/private/for.rkt:781:4 --------------------------------------------------------------------------------------------- coerce-contract/f [255] 100.0% [259] 284(0.0%) 284(0.0%) coerce-simple-value ...ract/private/guts.rkt:385:0 --------------------------------------------------------------------------------------------- make-sequence [246] 100.0% [260] 278(0.0%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:477:7 custom-in-set [261] 100.0% --------------------------------------------------------------------------------------------- ??? [260] 19.4% ??? [86] 20.6% match-e [75] 60.0% [261] 1433(0.1%) 1433(0.1%) custom-in-set ...acket/private/set-types.rkt:580:0 ---------------------------------------------------------------------------------------------