Profiling results ----------------- Total cpu time observed: 111407ms (out of 111839ms) Number of samples taken: 393 (once every 283ms) (Hiding functions with self<1.0% and local<2.0%: 10 of 196 hidden) ========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================== [1] 111407(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [7] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [150] 100.0% [2] 10894(9.8%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [150] 94.9% ??? [10] 5.1% ------------------------------------------------------------------------------------------ loop [132] 100.0% [3] 2819(2.5%) 567(0.5%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [132] 40.0% eval-const-expr [9] 30.0% compose [12] 10.0% ------------------------------------------------------------------------------------------ loop [132] 100.0% [4] 1694(1.5%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sort-context-on-expr [8] 66.8% err-lsts->split-indices [11] 16.6% loop [132] 16.6% ------------------------------------------------------------------------------------------ hash-ref! [150] 100.0% [5] 561(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 simplify [66] 100.0% ------------------------------------------------------------------------------------------ loop [6] 50.0% loop [132] 50.0% [6] 280(0.3%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:40:19 loop [6] 50.0% ??? [41] 50.0% ------------------------------------------------------------------------------------------ ??? [1] 100.0% [7] 111407(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [13] 100.0% ------------------------------------------------------------------------------------------ option-on-expr [4] 100.0% [8] 1132(1.0%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [14] 100.0% ------------------------------------------------------------------------------------------ set-precompute! [3] 100.0% [9] 844(0.8%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 kw-chaperone [15] 67.4% f53 [125] 32.6% ------------------------------------------------------------------------------------------ ??? [2] 100.0% [10] 558(0.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------ option-on-expr [4] 100.0% [11] 282(0.3%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [16] 100.0% ------------------------------------------------------------------------------------------ set-precompute! [3] 100.0% [12] 281(0.3%) 281(0.3%) compose ...collects/racket/private/list.rkt:404:12 ------------------------------------------------------------------------------------------ profile-thunk [7] 100.0% [13] 111407(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [17] 100.0% ------------------------------------------------------------------------------------------ sort-context-on-expr [8] 100.0% [14] 1132(1.0%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [18] 100.0% ------------------------------------------------------------------------------------------ eval-const-expr [9] 100.0% [15] 570(0.5%) 0(0.0%) kw-chaperone ...ects/racket/private/kw.rkt:2036:33 ...row-higher-order.rkt:387:44 [19] 100.0% ------------------------------------------------------------------------------------------ err-lsts->split-indices [11] 100.0% [16] 282(0.3%) 282(0.3%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------------ ??? [13] 100.0% [17] 111407(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [20] 86.7% prepare-points [29] 13.3% ------------------------------------------------------------------------------------------ ??? [14] 100.0% [18] 1132(1.0%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [21] 75.1% ??? [120] 24.9% ------------------------------------------------------------------------------------------ kw-chaperone [15] 100.0% [19] 570(0.5%) 284(0.3%) ...row-higher-order.rkt:387:44 ...order.rkt:387:44 successfully-got-the-right-kind-of-function [22] 50.0% ------------------------------------------------------------------------------------------ ??? [17] 100.0% [20] 96534(86.7%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [23] 97.4% get-final-combination [24] 1.8% setup-prog! [25] 0.6% ??? [92] 0.3% ------------------------------------------------------------------------------------------ generic-sort/key [18] 50.0% copying-mergesort [21] 50.0% [21] 850(0.8%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [21] 50.0% ??? [120] 50.0% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:387:44 [19] 100.0% [22] 285(0.3%) 0(0.0%) successfully-got-the-right-kind-of-function ...5:4 popular-chaperone-key-id42 [26] 100.0% ------------------------------------------------------------------------------------------ run-improve [20] 100.0% [23] 93996(84.4%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [27] 69.1% gen-series! [28] 22.6% finalize-iter! [30] 7.1% choose-best-alt! [32] 0.6% localize! [33] 0.3% gen-rewrites! [34] 0.3% ------------------------------------------------------------------------------------------ run-improve [20] 100.0% [24] 1694(1.5%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [31] 100.0% ------------------------------------------------------------------------------------------ run-improve [20] 100.0% [25] 569(0.5%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [29] 100.0% ------------------------------------------------------------------------------------------ successfully-got-the-right-kind-of-function [22]100.0% [26] 285(0.3%) 285(0.3%) popular-chaperone-key-id42 ...igher-order.rkt:50:6 ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [27] 64932(58.3%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [35] 100.0% ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [28] 21244(19.1%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [36] 100.0% ------------------------------------------------------------------------------------------ setup-prog! [25] 3.7% ??? [17] 96.3% [29] 15442(13.9%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [42] 65.9% make-exacts [37] 32.2% ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [30] 6717(6.0%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [92] 100.0% ------------------------------------------------------------------------------------------ get-final-combination [24] 100.0% [31] 1694(1.5%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f53 [125] 100.0% ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [32] 544(0.5%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [92] 100.0% ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [33] 280(0.3%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [38] 100.0% ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [34] 279(0.3%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [39] 100.0% ------------------------------------------------------------------------------------------ simplify! [27] 100.0% [35] 64932(58.3%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [40] 100.0% ------------------------------------------------------------------------------------------ gen-series! [28] 100.0% [36] 21244(19.1%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [41] 100.0% ------------------------------------------------------------------------------------------ prepare-points [29] 100.0% [37] 4973(4.5%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [42] 94.2% make-exacts* [43] 5.8% ------------------------------------------------------------------------------------------ localize! [33] 100.0% [38] 280(0.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------ gen-rewrites! [34] 100.0% [39] 279(0.3%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [44] 100.0% ------------------------------------------------------------------------------------------ ??? [35] 100.0% [40] 64932(58.3%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [45] 99.6% *simplify-rules* [50] 0.4% ------------------------------------------------------------------------------------------ f53 [125] 1.1% loop [6] 1.1% loop [132] 16.4% loop [46] 40.7% taylor-alt [36] 40.7% [41] 26072(23.4%) 319(0.3%) ??? ...tract/private/arrow-higher-order.rkt:375:33 loop [46] 40.7% approximate [47] 40.7% ->flonum [48] 9.0% real->bigfloat [49] 7.2% ...sting/src/common.rkt:47:2 [133] 1.1% ------------------------------------------------------------------------------------------ make-exacts [37] 31.5% prepare-points [29] 68.5% [42] 14870(13.3%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [132] 100.0% ------------------------------------------------------------------------------------------ make-exacts [37] 100.0% [43] 287(0.3%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [121] 100.0% ------------------------------------------------------------------------------------------ alt-rewrite-rm [39] 100.0% [44] 279(0.3%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 *rules* [51] 100.0% ------------------------------------------------------------------------------------------ simplify [40] 100.0% [45] 64645(58.0%) 0(0.0%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [52] 91.3% loop [54] 7.8% has-nan? [57] 0.4% mk-egraph [59] 0.4% ------------------------------------------------------------------------------------------ ??? [41] 13.6% loop [46] 86.4% [46] 21244(19.1%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [46] 86.4% ??? [41] 13.6% ------------------------------------------------------------------------------------------ ??? [41] 100.0% [47] 21244(19.1%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 ??? [53] 97.4% taylor [55] 2.6% ------------------------------------------------------------------------------------------ ??? [41] 100.0% [48] 2360(2.1%) 1506(1.4%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 ...sting/src/common.rkt:47:2 [133] 24.3% ??? [58] 11.9% ------------------------------------------------------------------------------------------ ??? [41] 100.0% [49] 1872(1.7%) 896(0.8%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [138] 52.1% ------------------------------------------------------------------------------------------ simplify [40] 100.0% [50] 286(0.3%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [56] 100.0% ------------------------------------------------------------------------------------------ rewriter [44] 100.0% [51] 279(0.3%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 list-member? [71] 100.0% ------------------------------------------------------------------------------------------ ??? [45] 100.0% [52] 59034(53.0%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [60] 95.2% loop [132] 4.8% ------------------------------------------------------------------------------------------ approximate [47] 98.6% [53] 20972(18.8%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [150] 98.6% ------------------------------------------------------------------------------------------ ??? [45] 100.0% [54] 5050(4.5%) 0(0.0%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 loop [61] 77.8% mk-min [62] 22.2% ------------------------------------------------------------------------------------------ approximate [47] 100.0% [55] 557(0.5%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 loop [132] 50.6% taylor-sqrt [63] 49.4% ------------------------------------------------------------------------------------------ *simplify-rules* [50] 100.0% [56] 286(0.3%) 286(0.3%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 ------------------------------------------------------------------------------------------ has-nan? [57] 50.0% ??? [45] 50.0% [57] 282(0.3%) 282(0.3%) has-nan? ...alt-testing/src/core/simplify.rkt:92:0 has-nan? [57] 50.0% ------------------------------------------------------------------------------------------ ->flonum [48] 100.0% [58] 281(0.3%) 281(0.3%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 ------------------------------------------------------------------------------------------ ??? [45] 100.0% [59] 278(0.2%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [64] 100.0% ------------------------------------------------------------------------------------------ iterate-egraph! [52] 100.0% [60] 56215(50.5%) 1128(1.0%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [65] 41.9% mk-enode! [72] 14.4% merge-egraph-nodes! [67] 13.3% custom-set-member? [68] 12.4% substitute-e [70] 7.4% loop! [137] 3.4% list-member? [71] 2.5% filter [171] 1.0% set-member? [98] 1.0% ------------------------------------------------------------------------------------------ loop [54] 100.0% [61] 3930(3.5%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [69] 100.0% ------------------------------------------------------------------------------------------ loop [54] 100.0% [62] 1120(1.0%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [69] 100.0% ------------------------------------------------------------------------------------------ taylor [55] 49.4% composed [146] 50.6% [63] 557(0.5%) 0(0.0%) taylor-sqrt ...t-testing/src/core/taylor.rkt:346:0 simplify [66] 100.0% ------------------------------------------------------------------------------------------ mk-egraph [59] 100.0% [64] 278(0.2%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [132] 100.0% ------------------------------------------------------------------------------------------ match-e [65] 25.7% one-iter [60] 74.3% [65] 23570(21.2%) 7290(6.5%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [65] 25.7% loop [132] 10.6% reverse [167] 8.1% ??? [92] 6.4% make-sequence [153] 5.2% do-procedure-reduce-keyword-arity [83] 3.6% variable? [74] 3.2% list-cartesian-product [76] 3.0% custom-in-set [77] 2.4% check-list [169] 1.8% ??? [78] 1.8% set-member? [98] 1.2% ------------------------------------------------------------------------------------------ taylor-sqrt [63] 2.6% ??? [5] 2.6% hash-ref! [150] 94.7% [66] 21244(19.1%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f53 [125] 96.1% simplify* [141] 1.3% make-multiplication-node [80] 1.3% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [67] 11.7% one-iter [60] 88.3% [67] 7500(6.7%) 0(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [73] 62.1% loop! [137] 22.3% merge-egraph-nodes! [67] 11.7% enode-merge! [79] 3.8% ------------------------------------------------------------------------------------------ one-iter [60] 100.0% [68] 6970(6.3%) 6970(6.3%) custom-set-member? ...t/private/set-types.rkt:45:0 ------------------------------------------------------------------------------------------ mk-min [62] 22.2% loop [61] 77.8% [69] 5050(4.5%) 276(0.2%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [93] 61.3% compile [127] 16.7% ...sting/src/common.rkt:47:2 [133] 16.6% ------------------------------------------------------------------------------------------ substitute-e [70] 13.4% one-iter [60] 86.6% [70] 4186(3.8%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [72] 79.9% substitute-e [70] 13.4% variable? [74] 4.5% ??? [92] 2.2% ------------------------------------------------------------------------------------------ *rules* [51] 16.5% one-iter [60] 83.5% [71] 1692(1.5%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [75] 100.0% ------------------------------------------------------------------------------------------ loop [132] 2.4% substitute-e [70] 28.5% one-iter [60] 69.1% [72] 11743(10.5%) 846(0.8%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [81] 90.5% hash-has-key? [95] 2.3% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [67] 100.0% [73] 5256(4.7%) 1422(1.3%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [82] 67.7% reverse [167] 5.3% ------------------------------------------------------------------------------------------ substitute-e [70] 22.1% match-e [65] 77.9% [74] 2532(2.3%) 0(0.0%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [92] 100.0% ------------------------------------------------------------------------------------------ list-member? [71] 100.0% [75] 1692(1.5%) 1692(1.5%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------------ list-cartesian-product [76] 33.1% match-e [65] 66.9% [76] 842(0.8%) 842(0.8%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [76] 33.1% ------------------------------------------------------------------------------------------ match-e [65] 100.0% [77] 565(0.5%) 565(0.5%) custom-in-set ...acket/private/set-types.rkt:580:0 ------------------------------------------------------------------------------------------ match-e [65] 100.0% [78] 558(0.5%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-procedure-reduce-keyword-arity [83] 100.0% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [67] 100.0% [79] 288(0.3%) 0(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [84] 100.0% ------------------------------------------------------------------------------------------ simplify [66] 100.0% [80] 275(0.2%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [85] 100.0% ------------------------------------------------------------------------------------------ mk-enode! [72] 100.0% [81] 10622(9.5%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [86] 100.0% ------------------------------------------------------------------------------------------ update-leader! [73] 100.0% [82] 3556(3.2%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [87] 100.0% ------------------------------------------------------------------------------------------ ??? [78] 33.1% match-e [65] 66.9% [83] 1688(1.5%) 1399(1.3%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [88] 17.1% ------------------------------------------------------------------------------------------ enode-merge! [79] 100.0% [84] 288(0.3%) 288(0.3%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ------------------------------------------------------------------------------------------ make-multiplication-node [80] 100.0% [85] 275(0.2%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 group-by [89] 100.0% ------------------------------------------------------------------------------------------ new-enode [81] 100.0% [86] 10622(9.5%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [90] 100.0% ------------------------------------------------------------------------------------------ do-hash-update [82] 100.0% [87] 3556(3.2%) 3004(2.7%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 reverse [167] 7.8% update-en-expr [170] 7.8% ------------------------------------------------------------------------------------------ do-procedure-reduce-keyword-arity [83] 100.0% [88] 289(0.3%) 289(0.3%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------------ make-multiplication-subnode [85] 100.0% [89] 275(0.2%) 0(0.0%) group-by .../racket/collects/racket/list.rkt:816:0 sort [91] 100.0% ------------------------------------------------------------------------------------------ type-of-enode-expr [86] 100.0% [90] 10622(9.5%) 840(0.8%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [93] 36.8% ??? [94] 21.2% ...sting/src/common.rkt:47:2 [133] 18.3% ??? [92] 15.8% ------------------------------------------------------------------------------------------ group-by [89] 100.0% [91] 275(0.2%) 275(0.2%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------------------ run-improve [20] 1.8% substitute-e [70] 1.8% choose-best-alt! [32] 3.5% get-sigs [90] 10.9% variable? [74] 16.4% match-e [65] 22.0% finalize-iter! [30] 43.6% [92] 15406(13.8%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [95] 51.1% atab-add-altns [96] 45.4% atab-pick-alt [99] 3.5% ------------------------------------------------------------------------------------------ expression-cost [69] 44.2% get-sigs [90] 55.8% [93] 7006(6.3%) 1681(1.5%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [101] 64.0% set-member? [98] 12.0% ------------------------------------------------------------------------------------------ get-sigs [90] 100.0% [94] 2249(2.0%) 0(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [97] 87.3% handle-the-hash [106] 12.7% ------------------------------------------------------------------------------------------ mk-enode! [72] 3.4% ??? [92] 96.6% [95] 8144(7.3%) 6180(5.5%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [101] 24.1% ------------------------------------------------------------------------------------------ ??? [92] 100.0% [96] 6992(6.3%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [100] 100.0% ------------------------------------------------------------------------------------------ ??? [94] 100.0% [97] 1964(1.8%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [102] 100.0% ------------------------------------------------------------------------------------------ match-e [65] 16.7% one-iter [60] 33.4% table-ref [93] 49.9% [98] 1688(1.5%) 1688(1.5%) set-member? ...ts/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------------ ??? [92] 100.0% [99] 544(0.5%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [103] 50.6% errors [111] 49.4% ------------------------------------------------------------------------------------------ atab-add-altns [96] 100.0% [100] 6992(6.3%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [104] 96.1% override-at-pnts [110] 3.9% ------------------------------------------------------------------------------------------ hash-has-key? [95] 30.5% table-ref [93] 69.5% [101] 6446(5.8%) 2495(2.2%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [105] 35.2% handle-the-hash [106] 13.0% ??? [108] 8.6% arrow-higher-order:lnp [109] 4.5% ------------------------------------------------------------------------------------------ ??? [97] 100.0% [102] 1964(1.8%) 844(0.8%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [107] 57.0% ------------------------------------------------------------------------------------------ atab-pick-alt [99] 100.0% [103] 276(0.2%) 276(0.2%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 ------------------------------------------------------------------------------------------ atab-add-altn [100] 100.0% [104] 6716(6.0%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [111] 95.7% ??? [117] 4.3% ------------------------------------------------------------------------------------------ ??? [101] 100.0% [105] 2266(2.0%) 851(0.8%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 blame-add-missing-party [113] 24.8% ??? [116] 12.7% loop [118] 12.5% make-keyword-procedure [119] 12.4% ------------------------------------------------------------------------------------------ ??? [94] 25.4% ??? [101] 74.6% [106] 1124(1.0%) 0(0.0%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [151] 100.0% ------------------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [102] 100.0% [107] 1119(1.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [112] 100.0% ------------------------------------------------------------------------------------------ ??? [101] 100.0% [108] 556(0.5%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [114] 100.0% ------------------------------------------------------------------------------------------ ??? [101] 100.0% [109] 290(0.3%) 0(0.0%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ??? [115] 100.0% ------------------------------------------------------------------------------------------ atab-add-altn [100] 100.0% [110] 276(0.2%) 0(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [111] 100.0% ------------------------------------------------------------------------------------------ atab-pick-alt [99] 3.7% override-at-pnts [110] 3.8% loop [132] 3.9% best-and-tied-at-points [104] 88.6% [111] 7254(6.5%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [120] 65.4% eval-prog [121] 23.2% ulp-difference [123] 11.4% ------------------------------------------------------------------------------------------ ??? [107] 100.0% [112] 1119(1.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [122] 100.0% ------------------------------------------------------------------------------------------ ??? [105] 100.0% [113] 562(0.5%) 562(0.5%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------------ ??? [108] 100.0% [114] 556(0.5%) 277(0.2%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [124] 50.2% ------------------------------------------------------------------------------------------ arrow-higher-order:lnp [109] 100.0% [115] 290(0.3%) 290(0.3%) ??? ...et/contract/private/arity-checking.rkt:19:2 ------------------------------------------------------------------------------------------ ??? [105] 100.0% [116] 288(0.3%) 288(0.3%) ??? ...rivate/unconstrained-domain-arrow.rkt:19:10 ------------------------------------------------------------------------------------------ best-and-tied-at-points [104] 100.0% [117] 287(0.3%) 287(0.3%) ??? ...ket/collects/racket/private/for.rkt:1280:14 ------------------------------------------------------------------------------------------ ??? [105] 33.3% loop [118] 66.7% [118] 284(0.3%) 284(0.3%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [118] 66.7% ------------------------------------------------------------------------------------------ ??? [105] 100.0% [119] 282(0.3%) 282(0.3%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------------ generic-sort/key [18] 1.5% copying-mergesort [21] 4.5% errors [111] 25.1% loop [132] 69.0% [120] 18948(17.0%) 9157(8.2%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 ??? [126] 23.0% loop [132] 13.0% ??? [129] 4.6% ??? [176] 3.3% ??? [130] 3.2% ??? [131] 2.9% ------------------------------------------------------------------------------------------ make-exacts* [43] 14.6% errors [111] 85.4% [121] 1968(1.8%) 1404(1.3%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [127] 14.6% f53 [125] 14.1% ------------------------------------------------------------------------------------------ ??? [112] 100.0% [122] 1119(1.0%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [128] 100.0% ------------------------------------------------------------------------------------------ errors [111] 100.0% [123] 826(0.7%) 276(0.2%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 ...sting/src/common.rkt:47:2 [133] 34.0% return/no-unsupplied [158] 32.5% ------------------------------------------------------------------------------------------ check-hash/c [114] 100.0% [124] 279(0.3%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [181] 100.0% ------------------------------------------------------------------------------------------ eval-prog [121] 0.2% eval-const-expr [9] 1.2% hash-ref! [150] 1.2% split-table [31] 7.4% simplify [66] 36.1% loop [132] 53.9% [125] 22944(20.6%) 19022(17.1%) f53 ...t/collects/racket/match/compiler.rkt:548:40 loop [132] 63.8% ...sting/src/common.rkt:47:2 [133] 1.2% ??? [41] 0.2% ------------------------------------------------------------------------------------------ ??? [120] 100.0% [126] 4358(3.9%) 288(0.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [134] 51.4% bfneg [135] 42.0% ------------------------------------------------------------------------------------------ eval-prog [121] 25.4% expression-cost [69] 74.6% [127] 1128(1.0%) 279(0.3%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [150] 75.3% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [122] 100.0% [128] 1119(1.0%) 280(0.3%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [136] 75.0% ------------------------------------------------------------------------------------------ ??? [120] 100.0% [129] 876(0.8%) 876(0.8%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------ ??? [120] 100.0% [130] 612(0.5%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [151] 51.4% ??? [168] 48.6% ------------------------------------------------------------------------------------------ ??? [120] 100.0% [131] 556(0.5%) 278(0.2%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 ...sting/src/common.rkt:47:2 [133] 50.0% ------------------------------------------------------------------------------------------ set-precompute! [3] 0.1% option-on-expr [4] 0.1% iterate-egraph! [52] 0.3% loop! [137] 0.3% loop [42] 0.4% mk-enode-rec! [64] 0.6% taylor [55] 0.6% ??? [120] 0.7% match-e [65] 5.9% f53 [125] 24.7% loop [132] 66.3% [132] 43396(39.0%) 2224(2.0%) loop .../private/map.rkt:40:19 loop [132] 66.3% f53 [125] 23.5% keyword-apply [142] 1.3% option-on-expr [4] 1.0% foldl [145] 0.7% ??? [41] 0.7% composed [146] 0.7% mk-enode! [72] 0.6% ??? [120] 0.3% loop! [137] 0.3% set-precompute! [3] 0.3% simplify* [141] 0.2% errors [111] 0.1% simplify-node [149] 0.1% setfindf [144] 0.0% loop [6] 0.0% ------------------------------------------------------------------------------------------ f53 [125] 6.2% ??? [41] 6.2% ??? [131] 6.2% ulp-difference [123] 6.3% ->flonum [48] 12.8% expression-cost [69] 18.7% get-sigs [90] 43.6% [133] 4469(4.0%) 1406(1.3%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [139] 50.1% ??? [143] 18.4% ------------------------------------------------------------------------------------------ ??? [126] 100.0% [134] 2240(2.0%) 900(0.8%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [138] 59.8% ------------------------------------------------------------------------------------------ ??? [126] 100.0% [135] 1830(1.6%) 590(0.5%) bfneg ...-lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [138] 33.4% ??? [147] 18.4% ??? [148] 15.8% ------------------------------------------------------------------------------------------ contract-struct-name [140] 33.1% ??? [128] 66.9% [136] 840(0.8%) 556(0.5%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [140] 66.9% ------------------------------------------------------------------------------------------ loop [132] 25.1% merge-egraph-nodes! [67] 36.2% one-iter [60] 38.7% [137] 3862(3.5%) 0(0.0%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [152] 49.9% loop [132] 25.1% make-immutable-set [154] 14.5% ??? [156] 10.5% ------------------------------------------------------------------------------------------ bfneg [135] 20.9% real->bigfloat [49] 33.3% bfsub [134] 45.8% [138] 2928(2.6%) 2928(2.6%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------------ ??? [151] 43.7% ...sting/src/common.rkt:47:2 [133] 56.3% [139] 2241(2.0%) 566(0.5%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [151] 43.7% ??? [168] 37.4% ------------------------------------------------------------------------------------------ build-compound-type-name [136] 100.0% [140] 840(0.8%) 0(0.0%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [136] 66.3% reverse [167] 33.7% ------------------------------------------------------------------------------------------ simplify [66] 33.1% loop [132] 66.9% [141] 833(0.7%) 0(0.0%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 get-evaluator [157] 66.9% hash-ref! [150] 33.1% ------------------------------------------------------------------------------------------ loop [132] 100.0% [142] 832(0.7%) 0(0.0%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [155] 100.0% ------------------------------------------------------------------------------------------ ...sting/src/common.rkt:47:2 [133] 100.0% [143] 822(0.7%) 283(0.3%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 assoc-ref [163] 33.7% return/no-unsupplied [158] 31.8% ------------------------------------------------------------------------------------------ loop [132] 100.0% [144] 571(0.5%) 288(0.3%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 make-sequence [153] 49.5% ------------------------------------------------------------------------------------------ loop [132] 100.0% [145] 562(0.5%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 check-fold [161] 50.2% merge2 [162] 49.8% ------------------------------------------------------------------------------------------ loop [132] 100.0% [146] 562(0.5%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 taylor-sqrt [63] 50.2% hash-ref! [150] 49.8% ------------------------------------------------------------------------------------------ bfneg [135] 100.0% [147] 338(0.3%) 338(0.3%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ------------------------------------------------------------------------------------------ bfneg [135] 100.0% [148] 290(0.3%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [159] 100.0% ------------------------------------------------------------------------------------------ loop [132] 100.0% [149] 284(0.3%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 gather-multiplicative-terms [160] 100.0% ------------------------------------------------------------------------------------------ simplify* [141] 0.2% localize-error [38] 0.4% ??? [10] 0.7% composed [146] 0.9% compile [127] 3.9% ??? [2] 10.5% ??? [166] 11.8% ??? [164] 21.5% ??? [53] 21.5% ??? [165] 27.4% [150] 21816(19.6%) 838(0.8%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [165] 27.4% ??? [164] 21.5% simplify [66] 21.2% ??? [166] 11.8% ??? [2] 11.3% bigfloat-hash [175] 1.3% f53 [125] 1.3% ??? [5] 0.3% ------------------------------------------------------------------------------------------ ??? [130] 9.3% handle-the-hash [106] 33.1% ??? [139] 57.7% [151] 3400(3.1%) 280(0.3%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [139] 57.7% ??? [172] 16.6% ??? [168] 9.3% check-list [169] 8.2% ------------------------------------------------------------------------------------------ loop! [137] 100.0% [152] 1926(1.7%) 1644(1.5%) custom-set-union ...et/private/set-types.rkt:168:0 check-list [169] 14.7% ------------------------------------------------------------------------------------------ setfindf [144] 16.8% match-e [65] 83.2% [153] 1686(1.5%) 1399(1.3%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [174] 17.0% ------------------------------------------------------------------------------------------ loop! [137] 100.0% [154] 1122(1.0%) 1122(1.0%) make-immutable-set .../private/set-types.rkt:948:0 ------------------------------------------------------------------------------------------ keyword-apply [142] 100.0% [155] 832(0.7%) 832(0.7%) loop ...cket/collects/racket/private/kw.rkt:518:13 ------------------------------------------------------------------------------------------ loop! [137] 100.0% [156] 814(0.7%) 0(0.0%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [170] 100.0% ------------------------------------------------------------------------------------------ simplify* [141] 100.0% [157] 557(0.5%) 557(0.5%) get-evaluator ...src/function-definitions.rkt:61:0 ------------------------------------------------------------------------------------------ ??? [143] 49.3% ulp-difference [123] 50.7% [158] 530(0.5%) 0(0.0%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 reverse [167] 50.7% filter [171] 49.3% ------------------------------------------------------------------------------------------ ??? [148] 100.0% [159] 290(0.3%) 290(0.3%) assq ...et/collects/racket/private/list.rkt:187:13 ------------------------------------------------------------------------------------------ simplify-node [149] 100.0% [160] 284(0.3%) 284(0.3%) gather-multiplicative-terms ...re/reduce.rkt:116:0 ------------------------------------------------------------------------------------------ foldl [145] 100.0% [161] 282(0.3%) 282(0.3%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------------ foldl [145] 100.0% [162] 280(0.3%) 0(0.0%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [173] 100.0% ------------------------------------------------------------------------------------------ ??? [143] 100.0% [163] 277(0.2%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [173] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [150] 100.0% [164] 20688(18.6%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [150] 100.0% [165] 18450(16.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [150] 100.0% [166] 13998(12.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [150] 100.0% ------------------------------------------------------------------------------------------ return/no-unsupplied [158] 8.0% ??? [87] 8.3% update-leader! [73] 8.3% contract-struct-name [140] 8.5% match-e [65] 66.9% [167] 3342(3.0%) 3342(3.0%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------------ ??? [130] 13.0% ??? [151] 13.7% ??? [139] 73.2% [168] 2288(2.1%) 562(0.5%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [177] 48.7% ^TYPE? [184] 26.8% ------------------------------------------------------------------------------------------ ??? [151] 24.8% custom-set-union [152] 25.1% match-e [65] 50.1% [169] 1128(1.0%) 1128(1.0%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------------ ??? [87] 25.3% ??? [156] 74.7% [170] 1091(1.0%) 816(0.7%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [179] 25.2% ------------------------------------------------------------------------------------------ return/no-unsupplied [158] 31.4% one-iter [60] 68.6% [171] 834(0.7%) 834(0.7%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------------ ??? [151] 100.0% [172] 565(0.5%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [176] 100.0% ------------------------------------------------------------------------------------------ assoc-ref [163] 49.7% merge2 [162] 50.3% [173] 557(0.5%) 557(0.5%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------------ make-sequence [153] 100.0% [174] 288(0.3%) 288(0.3%) :hash-gen ...collects/racket/private/for.rkt:781:4 ------------------------------------------------------------------------------------------ hash-ref! [150] 100.0% [175] 287(0.3%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [178] 100.0% ------------------------------------------------------------------------------------------ ??? [172] 47.2% ??? [120] 52.8% [176] 1196(1.1%) 0(0.0%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [180] 100.0% ------------------------------------------------------------------------------------------ ??? [168] 100.0% [177] 1114(1.0%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [181] 74.6% coerce-contract/f [183] 25.4% ------------------------------------------------------------------------------------------ bigfloat-hash [175] 100.0% [178] 287(0.3%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [182] 100.0% ------------------------------------------------------------------------------------------ update-en-expr [170] 100.0% [179] 275(0.2%) 275(0.2%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ------------------------------------------------------------------------------------------ ??? [176] 100.0% [180] 1196(1.1%) 286(0.3%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [185] 47.2% ^TYPE? [184] 28.8% ------------------------------------------------------------------------------------------ flat-contract? [124] 25.1% contract? [177] 74.9% [181] 1110(1.0%) 1110(1.0%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------------ bfcanonicalize [178] 100.0% [182] 287(0.3%) 287(0.3%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------------ contract? [177] 100.0% [183] 283(0.3%) 0(0.0%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [186] 100.0% ------------------------------------------------------------------------------------------ ??? [180] 36.0% ??? [168] 64.0% [184] 956(0.9%) 956(0.9%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------------ ??? [180] 100.0% [185] 565(0.5%) 565(0.5%) ??? ...ects/racket/contract/private/list.rkt:163:5 ------------------------------------------------------------------------------------------ coerce-contract/f [183] 100.0% [186] 283(0.3%) 283(0.3%) coerce-simple-value ...ract/private/guts.rkt:385:0 ------------------------------------------------------------------------------------------