Profiling results ----------------- Total cpu time observed: 754130ms (out of 756202ms) Number of samples taken: 2670 (once every 282ms) (Hiding functions with self<1.0% and local<2.0%: 31 of 279 hidden) ========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================== [1] 754130(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [13] 100.0% ------------------------------------------------------------------------------------------ loop [219] 100.0% [2] 24986(3.3%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 loop [219] 51.1% sort-context-on-expr [14] 36.7% pick-errors [16] 6.6% err-lsts->split-indices [17] 4.4% ------------------------------------------------------------------------------------------ hash-ref! [193] 100.0% [3] 13745(1.8%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 ??? [156] 57.6% hash-ref! [193] 42.4% ------------------------------------------------------------------------------------------ hash-ref! [193] 100.0% [4] 12382(1.6%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [193] 95.3% ??? [18] 4.7% ------------------------------------------------------------------------------------------ loop [219] 100.0% [5] 11019(1.5%) 5073(0.7%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [219] 22.9% eval-const-expr [15] 18.2% simple-compose [19] 5.2% ??? [179] 5.1% make-sequence [235] 2.6% ------------------------------------------------------------------------------------------ loop [219] 100.0% [6] 2864(0.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [193] 81.7% taylor [215] 18.3% ------------------------------------------------------------------------------------------ hash-ref! [193] 100.0% [7] 2490(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [193] 74.2% simplify [177] 22.1% ??? [18] 3.6% ------------------------------------------------------------------------------------------ f8 [212] 20.8% taylor [215] 79.2% [8] 1401(0.2%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 normalize-series [171] 58.7% simplify [177] 41.3% ------------------------------------------------------------------------------------------ taylor [215] 100.0% [9] 1101(0.1%) 0(0.0%) taylor-exact ...-testing/src/core/taylor.rkt:252:0 loop [219] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [193] 48.1% taylor [215] 51.9% [10] 554(0.1%) 0(0.0%) taylor-exp ...lt-testing/src/core/taylor.rkt:386:0 simplify [177] 100.0% ------------------------------------------------------------------------------------------ loop [219] 100.0% [11] 291(0.0%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 combine-mterms [20] 100.0% ------------------------------------------------------------------------------------------ loop [12] 50.0% loop [219] 50.0% [12] 268(0.0%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:40:19 loop [12] 50.0% ...row-higher-order.rkt:375:33 [131] 50.0% ------------------------------------------------------------------------------------------ ??? [1] 100.0% [13] 754130(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [21] 100.0% ------------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [14] 9178(1.2%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [22] 97.0% eval-prog [132] 3.0% ------------------------------------------------------------------------------------------ set-precompute! [5] 100.0% [15] 2002(0.3%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f8 [212] 100.0% ------------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [16] 1654(0.2%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [23] 82.2% point->alt [24] 17.8% ------------------------------------------------------------------------------------------ option-on-expr [2] 100.0% [17] 1110(0.1%) 281(0.0%) err-lsts->split-indices .../core/regimes.rkt:239:0 loop [25] 25.3% loop [218] 25.2% ??? [230] 24.1% ------------------------------------------------------------------------------------------ ??? [7] 32.1% ??? [4] 67.9% [18] 848(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------ set-precompute! [5] 100.0% [19] 574(0.1%) 574(0.1%) simple-compose ...s/racket/private/list.rkt:426:10 ------------------------------------------------------------------------------------------ simplify-node [11] 100.0% [20] 291(0.0%) 0(0.0%) combine-mterms ...esting/src/core/reduce.rkt:191:0 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------ profile-thunk [13] 100.0% [21] 754130(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [26] 100.0% ------------------------------------------------------------------------------------------ group-by [208] 2.7% step [226] 3.0% sort-context-on-expr [14] 94.3% [22] 9442(1.3%) 536(0.1%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [27] 94.3% ------------------------------------------------------------------------------------------ loop [219] 45.2% pick-errors [16] 54.8% [23] 2478(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [130] 100.0% ------------------------------------------------------------------------------------------ pick-errors [16] 100.0% [24] 295(0.0%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [132] 100.0% ------------------------------------------------------------------------------------------ err-lsts->split-indices [17] 4.8% loop [25] 95.2% [25] 282(0.0%) 282(0.0%) loop ...hare/racket/collects/racket/list.rkt:158:2 loop [25] 95.2% ------------------------------------------------------------------------------------------ ??? [21] 100.0% [26] 754130(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [28] 84.1% prepare-points [35] 15.9% ------------------------------------------------------------------------------------------ ??? [22] 100.0% [27] 8907(1.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [29] 90.6% ??? [130] 9.4% ------------------------------------------------------------------------------------------ ??? [26] 100.0% [28] 633904(84.1%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [30] 94.8% get-final-combination [31] 4.0% setup-prog! [32] 0.8% setup-alt-simplified [33] 0.3% ??? [98] 0.0% ------------------------------------------------------------------------------------------ generic-sort/key [27] 49.1% copying-mergesort [29] 50.9% [29] 8073(1.1%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [29] 50.9% ??? [130] 44.8% ...row-higher-order.rkt:375:33 [131] 4.3% ------------------------------------------------------------------------------------------ run-improve [28] 100.0% [30] 601246(79.7%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [34] 85.1% finalize-iter! [36] 9.4% gen-series! [38] 3.7% choose-best-alt! [39] 0.9% gen-rewrites! [40] 0.6% localize! [41] 0.4% ------------------------------------------------------------------------------------------ run-improve [28] 100.0% [31] 25552(3.4%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [37] 97.8% extract-alt [43] 2.2% ------------------------------------------------------------------------------------------ run-improve [28] 100.0% [32] 5054(0.7%) 0(0.0%) setup-prog! ...e/alt-testing/src/mainloop.rkt:72:0 prepare-points [35] 95.0% setup-prog [44] 5.0% ------------------------------------------------------------------------------------------ run-improve [28] 100.0% [33] 1800(0.2%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [42] 100.0% ------------------------------------------------------------------------------------------ run-iter! [30] 100.0% [34] 511400(67.8%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [45] 99.9% debug-print [221] 0.1% ------------------------------------------------------------------------------------------ setup-prog! [32] 3.8% ??? [26] 96.2% [35] 125024(16.6%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [52] 58.2% make-exacts [46] 36.7% ??? [48] 4.0% make-exacts* [53] 1.1% ------------------------------------------------------------------------------------------ run-iter! [30] 100.0% [36] 56446(7.5%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [98] 100.0% ------------------------------------------------------------------------------------------ get-final-combination [31] 100.0% [37] 24986(3.3%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f8 [212] 100.0% ------------------------------------------------------------------------------------------ run-iter! [30] 100.0% [38] 22479(3.0%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [47] 100.0% ------------------------------------------------------------------------------------------ run-iter! [30] 100.0% [39] 5122(0.7%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [98] 100.0% ------------------------------------------------------------------------------------------ run-iter! [30] 100.0% [40] 3458(0.5%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [49] 100.0% ------------------------------------------------------------------------------------------ run-iter! [30] 100.0% [41] 2341(0.3%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [50] 100.0% ------------------------------------------------------------------------------------------ setup-alt-simplified [33] 100.0% [42] 1800(0.2%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [51] 100.0% ------------------------------------------------------------------------------------------ get-final-combination [31] 100.0% [43] 566(0.1%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [162] 100.0% ------------------------------------------------------------------------------------------ setup-prog! [32] 100.0% [44] 255(0.0%) 0(0.0%) setup-prog ...herbie/alt-testing/src/glue.rkt:40:0 ??? [98] 100.0% ------------------------------------------------------------------------------------------ simplify! [34] 100.0% [45] 511126(67.8%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [51] 99.9% ------------------------------------------------------------------------------------------ prepare-points [35] 100.0% [46] 45836(6.1%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [52] 89.8% make-exacts* [53] 10.2% ------------------------------------------------------------------------------------------ gen-series! [38] 100.0% [47] 22479(3.0%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ...row-higher-order.rkt:375:33 [131] 100.0% ------------------------------------------------------------------------------------------ prepare-points [35] 100.0% [48] 4973(0.7%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ...row-higher-order.rkt:375:33 [131] 83.3% range-table-ref [55] 11.2% ??? [156] 5.5% ------------------------------------------------------------------------------------------ gen-rewrites! [40] 100.0% [49] 3458(0.5%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [54] 100.0% ------------------------------------------------------------------------------------------ localize! [41] 100.0% [50] 2341(0.3%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------ simplify-alt [42] 0.4% ??? [45] 99.6% [51] 512666(68.0%) 276(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [56] 99.7% *simplify-rules* [59] 0.1% kw-chaperone [60] 0.1% debug-print [221] 0.1% ------------------------------------------------------------------------------------------ make-exacts [46] 36.1% prepare-points [35] 63.9% [52] 113958(15.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [219] 99.7% ------------------------------------------------------------------------------------------ prepare-points [35] 23.2% make-exacts [46] 76.8% [53] 6094(0.8%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [132] 100.0% ------------------------------------------------------------------------------------------ alt-rewrite-rm [49] 30.4% matcher [57] 69.6% [54] 3458(0.5%) 256(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [57] 70.8% *rules* [58] 18.5% expression->type [211] 4.1% f8 [212] 3.6% ------------------------------------------------------------------------------------------ ??? [48] 100.0% [55] 556(0.1%) 556(0.1%) range-table-ref ...ng/src/range-analysis.rkt:182:0 ------------------------------------------------------------------------------------------ simplify [51] 100.0% [56] 511268(67.8%) 578(0.1%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [61] 88.1% loop [62] 10.9% mk-egraph [63] 0.9% ------------------------------------------------------------------------------------------ matcher [57] 50.0% rewriter [54] 50.0% [57] 3458(0.5%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [57] 50.0% rewriter [54] 49.4% pattern-match [66] 0.6% ------------------------------------------------------------------------------------------ rewriter [54] 100.0% [58] 2166(0.3%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [64] 75.1% set-member? [157] 13.1% ??? [179] 11.8% ------------------------------------------------------------------------------------------ simplify [51] 100.0% [59] 552(0.1%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 flag-set? [64] 100.0% ------------------------------------------------------------------------------------------ simplify [51] 100.0% [60] 288(0.0%) 0(0.0%) kw-chaperone ...ects/racket/private/kw.rkt:2036:33 ??? [65] 100.0% ------------------------------------------------------------------------------------------ ??? [56] 100.0% [61] 450310(59.7%) 277(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [67] 97.4% loop [219] 2.5% debug-print [221] 0.1% ------------------------------------------------------------------------------------------ ??? [56] 100.0% [62] 55894(7.4%) 3050(0.4%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [68] 49.6% loop [69] 42.5% make-sequence [235] 1.5% reverse [242] 0.9% ------------------------------------------------------------------------------------------ ??? [56] 100.0% [63] 4486(0.6%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [70] 100.0% ------------------------------------------------------------------------------------------ *simplify-rules* [59] 25.3% *rules* [58] 74.7% [64] 2178(0.3%) 1650(0.2%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [236] 12.3% dict-ref-contract [155] 11.9% ------------------------------------------------------------------------------------------ kw-chaperone [60] 100.0% [65] 288(0.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:387:44 ??? [178] 100.0% ------------------------------------------------------------------------------------------ pattern-match [66] 50.0% matcher [57] 50.0% [66] 253(0.0%) 0(0.0%) pattern-match ...testing/src/core/matcher.rkt:48:0 pattern-match [66] 50.0% ??? [98] 50.0% ------------------------------------------------------------------------------------------ iterate-egraph! [61] 100.0% [67] 438442(58.1%) 16692(2.2%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [71] 37.1% custom-set-member? [72] 14.9% loop! [78] 11.3% merge-egraph-nodes! [74] 11.1% mk-enode! [77] 10.2% substitute-e [75] 7.6% filter [243] 1.1% list-member? [159] 0.8% set-member? [157] 0.7% reverse [242] 0.6% pack-leader [101] 0.3% update-leader! [79] 0.1% loop [76] 0.1% make-sequence [235] 0.1% ------------------------------------------------------------------------------------------ loop [62] 100.0% [68] 27736(3.7%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [73] 100.0% ------------------------------------------------------------------------------------------ loop [62] 100.0% [69] 23728(3.1%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [73] 100.0% ------------------------------------------------------------------------------------------ mk-egraph [63] 42.0% loop [219] 58.0% [70] 4486(0.6%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [219] 100.0% ------------------------------------------------------------------------------------------ match-e [71] 21.5% one-iter [67] 78.5% [71] 162608(21.6%) 50788(6.7%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [71] 21.5% make-sequence [235] 7.1% ??? [179] 7.1% ??? [98] 7.0% reverse [242] 4.5% list-cartesian-product [81] 4.4% loop [219] 4.3% variable? [80] 4.3% do-procedure-reduce-keyword-arity [184] 2.4% set-member? [157] 2.0% custom-in-set [248] 2.0% ??? [83] 1.4% pack-leader [101] 1.1% check-list [213] 0.9% filter [243] 0.9% make-curried [84] 0.8% ------------------------------------------------------------------------------------------ one-iter [67] 100.0% [72] 65504(8.7%) 63832(8.5%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [85] 2.6% ------------------------------------------------------------------------------------------ loop [69] 46.1% mk-min [68] 53.9% [73] 51464(6.8%) 1399(0.2%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [99] 62.7% dict-ref-contract [155] 19.5% compile [143] 14.1% ??? [100] 0.5% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [74] 9.9% one-iter [67] 90.1% [74] 48450(6.4%) 519(0.1%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [79] 64.6% loop! [78] 17.5% merge-egraph-nodes! [74] 9.9% enode-merge! [82] 6.5% make-sequence [235] 0.3% ------------------------------------------------------------------------------------------ substitute-e [75] 11.9% one-iter [67] 88.1% [75] 33376(4.4%) 294(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [77] 79.2% substitute-e [75] 11.9% variable? [80] 3.6% ??? [98] 2.6% reverse [242] 1.2% make-sequence [235] 0.9% ------------------------------------------------------------------------------------------ one-iter [67] 4.5% loop [76] 95.5% [76] 287(0.0%) 287(0.0%) loop ...cket/collects/racket/private/hash.rkt:25:8 loop [76] 95.5% ------------------------------------------------------------------------------------------ loop [219] 5.9% substitute-e [75] 35.0% one-iter [67] 59.1% [77] 75554(10.0%) 5546(0.7%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [86] 89.4% hash-has-key? [102] 2.6% set-member? [157] 0.3% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [74] 12.8% loop [219] 29.9% one-iter [67] 57.4% [78] 60398(8.0%) 6720(0.9%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [87] 35.2% loop [219] 32.6% make-immutable-set [92] 16.7% ??? [89] 8.1% set-member? [157] 0.2% ------------------------------------------------------------------------------------------ one-iter [67] 0.9% merge-egraph-nodes! [74] 99.1% [79] 33654(4.5%) 11266(1.5%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [88] 55.0% update-en-expr [96] 6.5% make-sequence [235] 1.7% reverse [242] 1.7% hash-ref! [193] 0.8% ------------------------------------------------------------------------------------------ free-variables [231] 2.5% substitute-e [75] 15.6% match-e [71] 81.9% [80] 21430(2.8%) 830(0.1%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [98] 96.1% ------------------------------------------------------------------------------------------ list-cartesian-product [81] 20.7% match-e [71] 79.3% [81] 8060(1.1%) 5543(0.7%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [235] 27.9% list-cartesian-product [81] 20.7% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [74] 100.0% [82] 3294(0.4%) 268(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [90] 91.9% ------------------------------------------------------------------------------------------ match-e [71] 100.0% [83] 2214(0.3%) 541(0.1%) ??? ...herbie/alt-testing/src/core/ematch.rkt:50:5 ??? [98] 37.9% custom-in-set [248] 25.6% pack-leader [101] 12.1% ------------------------------------------------------------------------------------------ match-e [71] 100.0% [84] 1680(0.2%) 546(0.1%) make-curried ...collects/racket/function.rkt:130:9 make-keyword-procedure [195] 67.5% ------------------------------------------------------------------------------------------ custom-set-member? [72] 100.0% [85] 1672(0.2%) 1672(0.2%) set-check-elem ...cket/private/set-types.rkt:329:0 ------------------------------------------------------------------------------------------ mk-enode! [77] 100.0% [86] 67518(9.0%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [91] 99.2% make-immutable-set [92] 0.8% ------------------------------------------------------------------------------------------ loop! [78] 100.0% [87] 22918(3.0%) 17110(2.3%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [94] 18.2% check-list [213] 7.1% ------------------------------------------------------------------------------------------ update-leader! [79] 100.0% [88] 18508(2.5%) 286(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [93] 98.5% ------------------------------------------------------------------------------------------ loop! [78] 100.0% [89] 10010(1.3%) 1082(0.1%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 update-en-expr [96] 61.6% reverse [242] 27.6% ------------------------------------------------------------------------------------------ enode-merge! [82] 100.0% [90] 3026(0.4%) 2762(0.4%) custom-set-intersect! ...ivate/set-types.rkt:269:0 set-check-compatible [97] 8.7% ------------------------------------------------------------------------------------------ new-enode [86] 100.0% [91] 66953(8.9%) 2180(0.3%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [95] 95.5% reverse [242] 0.4% make-sequence [235] 0.4% ------------------------------------------------------------------------------------------ new-enode [86] 2.9% loop! [78] 97.1% [92] 19156(2.5%) 19156(2.5%) make-immutable-set .../private/set-types.rkt:948:0 ------------------------------------------------------------------------------------------ do-hash-update [88] 100.0% [93] 18222(2.4%) 15186(2.0%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 reverse [242] 6.1% update-en-expr [96] 6.0% make-sequence [235] 4.5% ------------------------------------------------------------------------------------------ custom-set-union [87] 100.0% [94] 4178(0.6%) 2488(0.3%) choose-immutable ...et/private/set-types.rkt:151:0 check-list [213] 26.8% set-check-compatible [97] 13.7% ------------------------------------------------------------------------------------------ f8 [212] 0.9% type-of-enode-expr [91] 99.1% [95] 64488(8.6%) 574(0.1%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [99] 38.5% ??? [100] 28.3% ??? [98] 18.9% dict-ref-contract [155] 12.5% hash-has-key? [102] 0.8% ------------------------------------------------------------------------------------------ ??? [93] 11.7% update-leader! [79] 23.1% ??? [89] 65.3% [96] 9444(1.3%) 5285(0.7%) update-en-expr ...esting/src/core/egraph.rkt:212:0 pack-leader [101] 26.4% make-sequence [235] 17.6% ------------------------------------------------------------------------------------------ custom-set-intersect! [90] 31.7% choose-immutable [94] 68.3% [97] 836(0.1%) 836(0.1%) set-check-compatible ...rivate/set-types.rkt:531:0 ------------------------------------------------------------------------------------------ pattern-match [66] 0.2% run-improve [28] 0.2% setup-prog [44] 0.2% free-variables [231] 0.2% taylor [215] 0.2% f8 [212] 0.7% ??? [83] 0.7% ??? [220] 0.9% substitute-e [75] 1.8% choose-best-alt! [39] 4.2% get-sigs [95] 10.1% match-e [71] 16.7% variable? [80] 17.1% finalize-iter! [36] 46.6% [98] 120524(16.0%) 2514(0.3%) ??? ...contract/private/arrow-val-first.rkt:486:18 atab-add-altns [103] 46.8% hash-has-key? [102] 46.2% atab-pick-alt [105] 4.2% ??? [220] 0.4% ------------------------------------------------------------------------------------------ f8 [212] 0.5% ...row-higher-order.rkt:375:33 [131] 2.3% get-sigs [95] 42.3% expression-cost [73] 54.9% [99] 58754(7.8%) 10143(1.3%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [107] 75.2% reverse [242] 2.3% check-list [213] 1.0% dict-ref-contract [155] 1.0% set-member? [157] 1.0% return/no-unsupplied [236] 0.9% dict? [228] 0.5% ------------------------------------------------------------------------------------------ expression-cost [73] 1.4% ...row-higher-order.rkt:375:33 [131] 1.5% f8 [212] 3.0% get-sigs [95] 94.1% [100] 19395(2.6%) 852(0.1%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [104] 69.6% handle-the-hash [114] 14.5% get/build-late-neg-projection [133] 10.0% ??? [106] 1.5% ------------------------------------------------------------------------------------------ ??? [83] 4.6% one-iter [67] 19.6% match-e [71] 33.0% update-en-expr [96] 42.8% [101] 5834(0.8%) 5834(0.8%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 ------------------------------------------------------------------------------------------ get-sigs [95] 0.9% mk-enode! [77] 3.4% ??? [98] 95.7% [102] 58448(7.8%) 40572(5.4%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [107] 30.1% reverse [242] 0.5% ------------------------------------------------------------------------------------------ ??? [98] 100.0% [103] 56700(7.5%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [108] 100.0% ------------------------------------------------------------------------------------------ ??? [100] 100.0% [104] 13496(1.8%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [109] 100.0% ------------------------------------------------------------------------------------------ ??? [98] 100.0% [105] 5122(0.7%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [110] 47.8% write-json* [111] 41.0% ...row-higher-order.rkt:375:33 [131] 11.2% ------------------------------------------------------------------------------------------ ??? [100] 100.0% [106] 294(0.0%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:69:2 do-blame-add-context [134] 100.0% ------------------------------------------------------------------------------------------ hash-has-key? [102] 28.5% table-ref [99] 71.5% [107] 61769(8.2%) 30913(4.1%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [113] 28.3% handle-the-hash [114] 12.5% successfully-got-the-right-kind-of-function [116] 3.7% ??? [178] 1.8% check-list [213] 1.4% ??? [182] 0.5% ------------------------------------------------------------------------------------------ atab-add-altns [103] 100.0% [108] 56700(7.5%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [112] 97.6% minimize-alts [119] 0.5% ------------------------------------------------------------------------------------------ ??? [104] 100.0% [109] 13496(1.8%) 4120(0.5%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [115] 67.3% ??? [118] 2.2% ------------------------------------------------------------------------------------------ atab-pick-alt [105] 100.0% [110] 2448(0.3%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [219] 100.0% ------------------------------------------------------------------------------------------ atab-pick-alt [105] 100.0% [111] 2100(0.3%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [117] 100.0% ------------------------------------------------------------------------------------------ atab-add-altn [108] 100.0% [112] 55336(7.3%) 572(0.1%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [120] 99.0% ------------------------------------------------------------------------------------------ ??? [107] 100.0% [113] 17487(2.3%) 7776(1.0%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 blame-add-missing-party [122] 22.3% loop [123] 20.7% update-the-info [125] 6.0% ??? [126] 3.4% make-keyword-procedure [195] 3.1% ------------------------------------------------------------------------------------------ ??? [100] 26.7% ??? [107] 73.3% [114] 10543(1.4%) 3279(0.4%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [178] 66.2% ??? [194] 2.7% ------------------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [109] 100.0% [115] 9080(1.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [121] 93.7% do-blame-add-context [134] 6.3% ------------------------------------------------------------------------------------------ ??? [107] 100.0% [116] 2270(0.3%) 561(0.1%) successfully-got-the-right-kind-of-function ...5:4 val-has-arrow-collapsible-support? [124] 50.9% arity-checking-wrapper [127] 12.7% popular-chaperone-key-id42 [129] 11.7% ------------------------------------------------------------------------------------------ write-json* [111] 25.0% loop [117] 75.0% [117] 2100(0.3%) 2100(0.3%) loop .../share/racket/collects/json/main.rkt:132:2 loop [117] 75.0% ------------------------------------------------------------------------------------------ contract-pos/neg-doubling/proc [109] 100.0% [118] 296(0.0%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:44 do-blame-add-context [134] 100.0% ------------------------------------------------------------------------------------------ atab-add-altn [108] 100.0% [119] 278(0.0%) 0(0.0%) minimize-alts ...ting/src/core/alt-table.rkt:193:0 rm-alts [128] 100.0% ------------------------------------------------------------------------------------------ composed [216] 1.6% loop [219] 19.2% best-and-tied-at-points [112] 77.7% [120] 70514(9.4%) 0(0.0%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [130] 74.3% eval-prog [132] 19.8% ...row-higher-order.rkt:375:33 [131] 3.5% ------------------------------------------------------------------------------------------ ??? [115] 100.0% [121] 8506(1.1%) 778(0.1%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [133] 71.9% do-blame-add-context [134] 12.7% blame-add-context [135] 6.2% ------------------------------------------------------------------------------------------ ??? [113] 100.0% [122] 3896(0.5%) 3896(0.5%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------------ ??? [113] 46.4% loop [123] 53.6% [123] 3628(0.5%) 3628(0.5%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [123] 53.6% ------------------------------------------------------------------------------------------ successfully-got-the-right-kind-of-function [116]100.0% [124] 1156(0.2%) 1156(0.2%) val-has-arrow-collapsible-support? ...le.rkt:116:0 ------------------------------------------------------------------------------------------ ??? [113] 100.0% [125] 1052(0.1%) 1052(0.1%) update-the-info ...ontract/private/blame.rkt:318:0 ------------------------------------------------------------------------------------------ ??? [113] 100.0% [126] 588(0.1%) 588(0.1%) ??? ...rivate/unconstrained-domain-arrow.rkt:19:10 ------------------------------------------------------------------------------------------ successfully-got-the-right-kind-of-function [116]100.0% [127] 288(0.0%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:443:0 matches-arity-exactly? [136] 100.0% ------------------------------------------------------------------------------------------ minimize-alts [119] 100.0% [128] 278(0.0%) 0(0.0%) rm-alts ...lt-testing/src/core/alt-table.rkt:222:0 loop [137] 100.0% ------------------------------------------------------------------------------------------ successfully-got-the-right-kind-of-function [116]100.0% [129] 266(0.0%) 266(0.0%) popular-chaperone-key-id42 ...igher-order.rkt:50:6 ------------------------------------------------------------------------------------------ generic-sort/key [27] 0.5% ??? [23] 1.4% copying-mergesort [29] 4.3% errors [120] 30.1% loop [219] 63.7% [130] 174150(23.1%) 70681(9.4%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [219] 25.7% ??? [154] 12.9% ??? [142] 7.3% bf* [144] 4.2% ??? [194] 3.4% ??? [146] 2.1% ??? [147] 2.0% ??? [149] 1.8% ------------------------------------------------------------------------------------------ loop [12] 0.3% copying-mergesort [29] 0.7% atab-pick-alt [105] 0.7% errors [120] 3.1% f8 [212] 3.2% ??? [48] 5.3% loop [139] 14.3% taylor-alt [47] 14.3% loop [219] 58.1% [131] 78658(10.4%) 4750(0.6%) ...row-higher-order.rkt:375:33 ...order.rkt:375:33 real->bigfloat [138] 28.8% ->flonum [141] 24.6% loop [139] 14.3% approximate [140] 14.3% sample-multi-bounded [148] 4.0% ??? [220] 3.4% table-ref [99] 1.7% ??? [194] 1.0% best-alt [151] 0.7% ??? [100] 0.4% ------------------------------------------------------------------------------------------ sort-context-on-expr [14] 1.3% point->alt [24] 1.4% make-exacts* [53] 29.1% errors [120] 66.8% [132] 20927(2.8%) 13584(1.8%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 compile [143] 19.3% f8 [212] 13.2% go [152] 1.3% ??? [153] 1.3% ------------------------------------------------------------------------------------------ ??? [150] 11.4% ??? [100] 11.4% ??? [121] 76.0% [133] 8047(1.1%) 544(0.1%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [145] 79.4% ??? [150] 11.4% ------------------------------------------------------------------------------------------ ??? [106] 13.1% ??? [118] 13.2% ??? [115] 25.5% ??? [121] 48.2% [134] 2248(0.3%) 2248(0.3%) do-blame-add-context ...ct/private/blame.rkt:192:0 ------------------------------------------------------------------------------------------ ??? [121] 100.0% [135] 530(0.1%) 530(0.1%) blame-add-context ...tract/private/blame.rkt:170:0 ------------------------------------------------------------------------------------------ arity-checking-wrapper [127] 100.0% [136] 288(0.0%) 288(0.0%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ------------------------------------------------------------------------------------------ rm-alts [128] 1.5% loop [137] 98.5% [137] 278(0.0%) 278(0.0%) loop ...are/racket/collects/racket/list.rkt:435:28 loop [137] 98.5% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [131] 100.0% [138] 22669(3.0%) 8064(1.1%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [176] 63.2% ??? [183] 1.3% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [131] 20.4% loop [139] 79.6% [139] 22479(3.0%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [139] 79.6% ...row-higher-order.rkt:375:33 [131] 20.4% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [131] 100.0% [140] 22479(3.0%) 0(0.0%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [193] 61.1% f8 [212] 20.4% ??? [156] 11.3% taylor [215] 4.7% taylor-quotient [160] 2.5% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [131] 100.0% [141] 19321(2.6%) 9377(1.2%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 dict-ref-contract [155] 25.4% return/no-unsupplied [236] 15.8% ??? [163] 4.5% set-member? [157] 4.2% list-member? [159] 1.6% ------------------------------------------------------------------------------------------ ??? [130] 100.0% [142] 12784(1.7%) 5702(0.8%) ??? ...ie/alt-testing/src/syntax/syntax.rkt:156:17 return/no-unsupplied [236] 29.1% dict-ref-contract [155] 17.5% list-member? [159] 6.6% set-member? [157] 2.2% ------------------------------------------------------------------------------------------ eval-prog [132] 35.8% expression-cost [73] 64.2% [143] 11291(1.5%) 281(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [193] 92.7% reverse [242] 4.9% ------------------------------------------------------------------------------------------ ??? [130] 100.0% [144] 7273(1.0%) 331(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [154] 95.4% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [133] 100.0% [145] 7212(1.0%) 1368(0.2%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [158] 73.3% reverse [242] 7.8% ------------------------------------------------------------------------------------------ ??? [130] 100.0% [146] 3668(0.5%) 3668(0.5%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------ ??? [130] 100.0% [147] 3464(0.5%) 350(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [178] 89.9% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [131] 100.0% [148] 3162(0.4%) 1710(0.2%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [161] 45.9% ------------------------------------------------------------------------------------------ ??? [130] 100.0% [149] 3110(0.4%) 2182(0.3%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [225] 29.8% ------------------------------------------------------------------------------------------ get/build-late-neg-projection [133] 100.0% [150] 1932(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [133] 100.0% ------------------------------------------------------------------------------------------ ...row-higher-order.rkt:375:33 [131] 100.0% [151] 574(0.1%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [162] 100.0% ------------------------------------------------------------------------------------------ eval-prog [132] 100.0% [152] 271(0.0%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [164] 100.0% ------------------------------------------------------------------------------------------ eval-prog [132] 100.0% [153] 270(0.0%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 check-for-duplicates [165] 100.0% ------------------------------------------------------------------------------------------ bf* [144] 23.6% ??? [130] 76.4% [154] 29407(3.9%) 1533(0.2%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [166] 68.0% bflog [168] 25.8% ^TYPE? [225] 1.0% ------------------------------------------------------------------------------------------ flag-set? [64] 1.0% ??? [169] 1.0% f8 [212] 1.0% simplify* [187] 1.1% table-ref [99] 2.1% ??? [142] 8.3% ->flonum [141] 18.2% get-sigs [95] 29.4% expression-cost [73] 36.7% [155] 26904(3.6%) 7966(1.1%) dict-ref-contract ...ract/private/arr-i.rkt:976:19 ??? [167] 38.9% ??? [169] 25.2% dict-key-contract [172] 3.1% ??? [220] 2.7% coerce-contract [174] 1.1% ------------------------------------------------------------------------------------------ ??? [48] 1.7% approximate [140] 15.3% ??? [3] 83.0% [156] 16562(2.2%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [193] 98.3% ??? [178] 1.7% ------------------------------------------------------------------------------------------ loop! [78] 2.9% mk-enode! [77] 2.9% ??? [142] 3.1% *rules* [58] 3.2% table-ref [99] 6.2% ->flonum [141] 8.9% one-iter [67] 34.7% match-e [71] 38.1% [157] 8990(1.2%) 8990(1.2%) set-member? ...ts/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------------ contract-struct-name [170] 23.8% ??? [145] 76.2% [158] 5284(0.7%) 1088(0.1%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [170] 74.0% check-list [213] 13.2% ------------------------------------------------------------------------------------------ ->flonum [141] 6.4% ??? [142] 17.5% one-iter [67] 76.1% [159] 4790(0.6%) 292(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 member [224] 93.9% ------------------------------------------------------------------------------------------ hash-ref! [193] 13.5% f8 [212] 14.7% approximate [140] 28.4% taylor [215] 43.4% [160] 1976(0.3%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 simplify [177] 57.7% normalize-series [171] 42.3% ------------------------------------------------------------------------------------------ random-exp [161] 30.2% sample-multi-bounded [148] 69.8% [161] 1453(0.2%) 1453(0.2%) random-exp ...bie/alt-testing/src/common.rkt:253:0 random-exp [161] 30.2% ------------------------------------------------------------------------------------------ extract-alt [43] 49.7% best-alt [151] 50.3% [162] 1140(0.2%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [216] 100.0% ------------------------------------------------------------------------------------------ ->flonum [141] 100.0% [163] 876(0.1%) 282(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 bigfloat->flonum [173] 34.0% ??? [180] 33.8% ------------------------------------------------------------------------------------------ go [152] 6.7% loop [164] 93.3% [164] 271(0.0%) 0(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [164] 93.3% stx-pair? [175] 6.7% ------------------------------------------------------------------------------------------ ??? [153] 100.0% [165] 270(0.0%) 270(0.0%) check-for-duplicates ...rivate/qq-and-or.rkt:12:18 ------------------------------------------------------------------------------------------ ??? [154] 100.0% [166] 19982(2.6%) 7680(1.0%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [176] 43.9% ??? [180] 17.7% ------------------------------------------------------------------------------------------ ??? [178] 23.8% dict-ref-contract [155] 76.2% [167] 10478(1.4%) 2181(0.3%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [178] 55.3% ??? [220] 19.9% ??? [182] 7.9% ------------------------------------------------------------------------------------------ ??? [154] 100.0% [168] 7592(1.0%) 5062(0.7%) bflog ...-lib/math/private/bigfloat/mpfr.rkt:635:4 new-mpfr [176] 28.3% ??? [183] 5.0% ------------------------------------------------------------------------------------------ dict-ref-contract [155] 100.0% [169] 7056(0.9%) 1978(0.3%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 return/no-unsupplied [236] 39.9% assoc-ref [181] 24.2% dict-ref-contract [155] 7.9% ------------------------------------------------------------------------------------------ build-compound-type-name [158] 100.0% [170] 4733(0.6%) 1968(0.3%) contract-struct-name ...ract/private/prop.rkt:98:0 build-compound-type-name [158] 44.0% reverse [242] 23.6% ------------------------------------------------------------------------------------------ taylor-invert [8] 26.8% taylor-quotient [160] 27.2% taylor [215] 46.1% [171] 3076(0.4%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [193] 64.0% simplify [177] 26.8% ??? [179] 9.3% ------------------------------------------------------------------------------------------ dict-ref-contract [155] 100.0% [172] 824(0.1%) 824(0.1%) dict-key-contract ...collects/racket/dict.rkt:71:0 ------------------------------------------------------------------------------------------ ??? [163] 100.0% [173] 298(0.0%) 298(0.0%) bigfloat->flonum ...rivate/bigfloat/mpfr.rkt:480:0 ------------------------------------------------------------------------------------------ dict-ref-contract [155] 100.0% [174] 284(0.0%) 0(0.0%) coerce-contract ...contract/private/guts.rkt:307:0 coerce-contract/f [238] 100.0% ------------------------------------------------------------------------------------------ loop [164] 100.0% [175] 271(0.0%) 271(0.0%) stx-pair? .../collects/racket/private/stx.rkt:40:4 ------------------------------------------------------------------------------------------ bflog [168] 8.5% bfsub [166] 34.8% real->bigfloat [138] 56.7% [176] 25239(3.3%) 25239(3.3%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------------ ??? [201] 1.4% ??? [7] 2.7% taylor-exp [10] 2.7% taylor-invert [8] 2.8% normalize-series [171] 4.0% loop [219] 5.4% taylor-quotient [160] 5.6% hash-ref! [193] 71.4% [177] 20532(2.7%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f8 [212] 76.7% debug-print [221] 12.3% make-multiplication-node [188] 4.2% debug [222] 4.1% loop [191] 1.4% simplify* [187] 1.2% ------------------------------------------------------------------------------------------ ??? [156] 1.4% ??? [65] 1.4% ??? [107] 5.6% ??? [147] 15.5% handle-the-hash [114] 34.8% ??? [167] 41.3% [178] 20069(2.7%) 5658(0.8%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [186] 32.0% ??? [167] 24.8% ??? [220] 10.7% check-list [213] 4.3% ------------------------------------------------------------------------------------------ *rules* [58] 1.8% normalize-series [171] 2.0% set-precompute! [5] 4.0% match-e [71] 92.1% [179] 13970(1.9%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [185] 52.2% do-procedure-reduce-keyword-arity [184] 45.8% procedure-reduce-arity [192] 2.1% ------------------------------------------------------------------------------------------ ??? [163] 7.7% bfsub [166] 92.3% [180] 3824(0.5%) 3824(0.5%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ------------------------------------------------------------------------------------------ ??? [169] 100.0% [181] 1707(0.2%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [245] 100.0% ------------------------------------------------------------------------------------------ ??? [107] 25.1% ??? [167] 74.9% [182] 1111(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [189] 100.0% ------------------------------------------------------------------------------------------ real->bigfloat [138] 43.2% bflog [168] 56.8% [183] 670(0.1%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [190] 100.0% ------------------------------------------------------------------------------------------ match-e [71] 45.4% ??? [179] 54.6% [184] 11708(1.6%) 10306(1.4%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [196] 12.0% ------------------------------------------------------------------------------------------ ??? [179] 100.0% [185] 7290(1.0%) 4744(0.6%) do-curry ...cket/collects/racket/function.rkt:71:2 partially-applied-procedure-arity-mask [198] 15.5% procedure-keywords [196] 11.4% make-keyword-procedure [195] 8.0% ------------------------------------------------------------------------------------------ ??? [178] 100.0% [186] 6426(0.9%) 3066(0.4%) ??? ...ects/racket/contract/private/list.rkt:763:7 check-list [213] 26.5% ??? [194] 25.8% ------------------------------------------------------------------------------------------ simplify [177] 13.0% loop [219] 87.0% [187] 1958(0.3%) 574(0.1%) simplify* .../alt-testing/src/core/reduce.rkt:31:0 hash-ref! [193] 42.3% dict-ref-contract [155] 14.6% get-evaluator [200] 13.7% ------------------------------------------------------------------------------------------ loop [219] 38.6% simplify [177] 61.4% [188] 1407(0.2%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [197] 100.0% ------------------------------------------------------------------------------------------ ??? [182] 100.0% [189] 1111(0.1%) 272(0.0%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [199] 75.6% ------------------------------------------------------------------------------------------ ??? [183] 100.0% [190] 670(0.1%) 670(0.1%) assq ...et/collects/racket/private/list.rkt:187:13 ------------------------------------------------------------------------------------------ simplify [177] 25.0% loop [191] 75.0% [191] 290(0.0%) 0(0.0%) loop ...erbie/alt-testing/src/core/reduce.rkt:18:2 loop [191] 75.0% f8 [212] 25.0% ------------------------------------------------------------------------------------------ ??? [179] 100.0% [192] 286(0.0%) 286(0.0%) procedure-reduce-arity ...t/private/kw.rkt:1823:11 ------------------------------------------------------------------------------------------ combine-mterms [20] 0.2% ??? [18] 0.5% update-leader! [79] 0.9% ??? [7] 1.4% normalize-series [171] 1.6% localize-error [50] 2.3% simplify* [187] 2.6% ??? [203] 3.2% ??? [204] 3.9% composed [6] 5.1% ??? [4] 6.6% approximate [140] 8.2% ??? [201] 8.2% ??? [3] 8.7% ??? [156] 11.4% compile [143] 14.0% loop [219] 19.4% [193] 31328(4.2%) 8092(1.1%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [202] 20.1% ??? [3] 16.9% simplify [177] 10.7% ??? [201] 8.4% f8 [212] 7.9% ??? [4] 7.1% bigfloat-hash [206] 4.7% ??? [204] 3.9% ??? [203] 3.2% ??? [7] 2.1% taylor [215] 1.8% taylor-exp [10] 0.3% taylor-quotient [160] 0.1% ------------------------------------------------------------------------------------------ handle-the-hash [114] 3.3% ...row-higher-order.rkt:375:33 [131] 9.3% ??? [186] 19.0% ??? [130] 68.4% [194] 8722(1.2%) 2822(0.4%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [205] 67.6% ------------------------------------------------------------------------------------------ ??? [113] 24.2% do-curry [185] 25.6% make-curried [84] 50.2% [195] 2262(0.3%) 2262(0.3%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------------ do-curry [185] 37.3% do-procedure-reduce-keyword-arity [184] 62.7% [196] 2235(0.3%) 2235(0.3%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------------ make-multiplication-node [188] 100.0% [197] 1407(0.2%) 286(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 mterm->expr [207] 61.5% group-by [208] 18.2% ------------------------------------------------------------------------------------------ do-curry [185] 100.0% [198] 1132(0.2%) 1132(0.2%) partially-applied-procedure-arity-mask ...rkt:58:2 ------------------------------------------------------------------------------------------ check-hash/c [189] 100.0% [199] 840(0.1%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [237] 100.0% ------------------------------------------------------------------------------------------ simplify* [187] 100.0% [200] 268(0.0%) 268(0.0%) get-evaluator ...src/function-definitions.rkt:61:0 ------------------------------------------------------------------------------------------ hash-ref! [193] 100.0% [201] 10986(1.5%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [193] 97.4% simplify [177] 2.6% ------------------------------------------------------------------------------------------ hash-ref! [193] 100.0% [202] 8750(1.2%) 568(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [219] 97.6% ------------------------------------------------------------------------------------------ hash-ref! [193] 100.0% [203] 7022(0.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [193] 100.0% [204] 6787(0.9%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:338:33 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------ ??? [194] 100.0% [205] 5900(0.8%) 3350(0.4%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [210] 23.3% ^TYPE? [225] 19.9% ------------------------------------------------------------------------------------------ hash-ref! [193] 100.0% [206] 3197(0.4%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [209] 100.0% ------------------------------------------------------------------------------------------ make-multiplication-subnode [197] 100.0% [207] 865(0.1%) 288(0.0%) mterm->expr ...t-testing/src/core/reduce.rkt:270:0 expression->type [211] 66.6% ------------------------------------------------------------------------------------------ make-multiplication-subnode [197] 100.0% [208] 256(0.0%) 0(0.0%) group-by .../racket/collects/racket/list.rkt:816:0 ??? [22] 100.0% ------------------------------------------------------------------------------------------ bigfloat-hash [206] 100.0% [209] 3197(0.4%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [214] 100.0% ------------------------------------------------------------------------------------------ ??? [205] 100.0% [210] 1375(0.2%) 815(0.1%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [213] 40.7% ------------------------------------------------------------------------------------------ rewriter [54] 11.0% expression->type [211] 22.0% mterm->expr [207] 67.0% [211] 860(0.1%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 f8 [212] 78.0% expression->type [211] 22.0% ------------------------------------------------------------------------------------------ composed [216] 0.3% rewriter [54] 0.5% loop [191] 0.6% expression->type [211] 1.0% eval-prog [132] 1.0% taylor [215] 2.2% f8 [212] 2.9% approximate [140] 3.5% eval-const-expr [15] 3.9% hash-ref! [193] 5.1% simplify [177] 11.1% loop [219] 20.8% split-table [37] 47.0% [212] 51240(6.8%) 13399(1.8%) f8 ...et/collects/racket/match/compiler.rkt:548:40 loop [219] 73.6% taylor [215] 5.2% f8 [212] 2.9% ??? [98] 1.2% ??? [100] 1.1% ??? [217] 1.1% ...row-higher-order.rkt:375:33 [131] 0.9% get-sigs [95] 0.8% taylor-quotient [160] 0.6% dict-ref-contract [155] 0.5% table-ref [99] 0.5% composed [216] 0.4% taylor-invert [8] 0.2% loop [218] 0.2% ------------------------------------------------------------------------------------------ ??? [210] 5.7% table-ref [99] 5.8% ??? [107] 8.6% ??? [178] 8.7% build-compound-type-name [158] 11.3% choose-immutable [94] 11.4% match-e [71] 14.6% custom-set-union [87] 16.6% ??? [186] 17.3% [213] 9838(1.3%) 9838(1.3%) check-list ...ollects/racket/private/for.rkt:690:2 ------------------------------------------------------------------------------------------ bfcanonicalize [209] 100.0% [214] 3197(0.4%) 3197(0.4%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------------ loop [219] 0.7% composed [6] 1.3% approximate [140] 7.4% hash-ref! [193] 21.0% taylor [215] 32.3% f8 [212] 37.3% [215] 7566(1.0%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor [215] 32.3% f8 [212] 17.6% taylor-quotient [160] 11.3% normalize-series [171] 11.3% debug-print [221] 6.8% taylor-invert [8] 6.4% taylor-exact [9] 5.6% loop [219] 2.0% taylor-exp [10] 1.9% debug [222] 1.1% ??? [98] 0.7% ------------------------------------------------------------------------------------------ f8 [212] 48.6% argmins [162] 51.4% [216] 2218(0.3%) 0(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [120] 51.4% f8 [212] 35.9% loop [223] 12.7% ------------------------------------------------------------------------------------------ f8 [212] 100.0% [217] 568(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:363:46 ??? [220] 100.0% ------------------------------------------------------------------------------------------ f8 [212] 0.3% err-lsts->split-indices [17] 49.3% loop [218] 50.4% [218] 568(0.1%) 568(0.1%) loop .../private/map.rkt:54:19 loop [218] 50.4% ------------------------------------------------------------------------------------------ set-precompute! [5] 0.1% taylor [215] 0.2% option-on-expr [2] 0.3% taylor-exact [9] 0.3% iterate-egraph! [61] 0.4% point-best-alt [110] 0.5% loop [52] 0.6% mk-enode-rec! [70] 1.4% loop! [78] 1.7% ??? [130] 2.0% ??? [202] 2.8% match-e [71] 3.3% f8 [212] 5.5% loop [219] 80.8% [219] 240546(31.9%) 9442(1.3%) loop .../private/map.rkt:40:19 loop [219] 80.8% f8 [212] 3.9% hash-ref! [193] 2.8% ...row-higher-order.rkt:375:33 [131] 1.9% loop! [78] 1.7% step [226] 1.0% errors [120] 0.8% mk-enode-rec! [70] 0.8% option-on-expr [2] 0.7% mk-enode! [77] 0.6% ??? [130] 0.5% composed [6] 0.5% set-precompute! [5] 0.4% foldl [229] 0.4% simplify [177] 0.3% simplify* [187] 0.2% make-multiplication-node [188] 0.1% free-variables [231] 0.1% taylor [215] 0.1% simplify-node [11] 0.0% ??? [23] 0.0% ??? [230] 0.0% loop [12] 0.0% ------------------------------------------------------------------------------------------ ??? [98] 4.9% ??? [217] 5.2% dict-ref-contract [155] 7.8% ??? [178] 19.7% ...row-higher-order.rkt:375:33 [131] 24.2% ??? [167] 38.1% [220] 10915(1.4%) 4408(0.6%) ??? ...ects/racket/contract/private/guts.rkt:794:8 contract? [227] 20.4% ^TYPE? [225] 13.7% ??? [98] 12.7% dict? [228] 12.7% ------------------------------------------------------------------------------------------ simplify! [34] 6.1% simplify [51] 6.3% iterate-egraph! [61] 6.3% taylor [215] 25.2% simplify [177] 56.2% [221] 4502(0.6%) 4228(0.6%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 write-proc [234] 6.1% ------------------------------------------------------------------------------------------ taylor [215] 23.6% simplify [177] 76.4% [222] 1104(0.1%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 get-setting [232] 52.3% cur-debug-level [233] 47.7% ------------------------------------------------------------------------------------------ composed [216] 33.3% loop [223] 66.7% [223] 282(0.0%) 0(0.0%) loop ...are/racket/collects/racket/list.rkt:418:34 loop [223] 66.7% member [224] 33.3% ------------------------------------------------------------------------------------------ loop [223] 5.9% list-member? [159] 94.1% [224] 4780(0.6%) 4780(0.6%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------------ ??? [154] 7.7% ??? [149] 23.8% ??? [205] 30.1% ??? [220] 38.4% [225] 3902(0.5%) 3902(0.5%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------------ loop [219] 100.0% [226] 2998(0.4%) 2718(0.4%) step .../racket/collects/racket/function.rkt:145:9 ??? [22] 9.3% ------------------------------------------------------------------------------------------ ??? [220] 100.0% [227] 2230(0.3%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 coerce-contract/f [238] 50.2% simple-flat-contract? [237] 49.8% ------------------------------------------------------------------------------------------ table-ref [99] 16.2% ??? [220] 83.8% [228] 1658(0.2%) 1390(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [241] 16.2% ------------------------------------------------------------------------------------------ loop [219] 100.0% [229] 1146(0.2%) 564(0.1%) foldl ...et/collects/racket/private/list.rkt:248:4 check-fold [239] 25.8% merge2 [240] 25.0% ------------------------------------------------------------------------------------------ err-lsts->split-indices [17] 24.4% loop [219] 75.6% [230] 1099(0.1%) 1099(0.1%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------------ loop [219] 100.0% [231] 796(0.1%) 0(0.0%) free-variables ...t-testing/src/programs.rkt:102:0 variable? [80] 67.4% ??? [98] 32.6% ------------------------------------------------------------------------------------------ debug [222] 100.0% [232] 577(0.1%) 577(0.1%) get-setting ...rbie/alt-testing/src/debug.rkt:96:0 ------------------------------------------------------------------------------------------ debug [222] 100.0% [233] 527(0.1%) 261(0.0%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 return/no-unsupplied [236] 50.5% ------------------------------------------------------------------------------------------ debug-print [221] 100.0% [234] 274(0.0%) 274(0.0%) write-proc ...alt-testing/src/alternative.rkt:22:9 ------------------------------------------------------------------------------------------ one-iter [67] 1.3% type-of-enode-expr [91] 1.3% substitute-e [75] 1.3% merge-egraph-nodes! [74] 1.4% set-precompute! [5] 1.4% update-leader! [79] 2.7% ??? [93] 3.9% loop [62] 4.1% update-en-expr [96] 7.9% list-cartesian-product [81] 11.9% match-e [71] 58.8% [235] 21094(2.8%) 15424(2.0%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [244] 25.6% ??? [247] 1.3% ------------------------------------------------------------------------------------------ cur-debug-level [233] 2.5% flag-set? [64] 2.5% table-ref [99] 4.9% ??? [169] 26.4% ->flonum [141] 28.7% ??? [142] 34.9% [236] 10649(1.4%) 3804(0.5%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [243] 40.9% reverse [242] 23.4% ------------------------------------------------------------------------------------------ flat-contract? [199] 43.1% contract? [227] 56.9% [237] 1949(0.3%) 1949(0.3%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------------ coerce-contract [174] 20.2% contract? [227] 79.8% [238] 1404(0.2%) 0(0.0%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [246] 100.0% ------------------------------------------------------------------------------------------ foldl [229] 100.0% [239] 296(0.0%) 296(0.0%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------------ foldl [229] 100.0% [240] 287(0.0%) 0(0.0%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [245] 100.0% ------------------------------------------------------------------------------------------ dict? [228] 100.0% [241] 268(0.0%) 268(0.0%) assoc? ...et/collects/racket/private/dict.rkt:13:0 ------------------------------------------------------------------------------------------ type-of-enode-expr [91] 1.2% hash-has-key? [102] 1.2% loop [62] 2.2% substitute-e [75] 2.2% compile [143] 2.3% ??? [145] 2.3% update-leader! [79] 2.4% ??? [93] 4.6% contract-struct-name [170] 4.7% table-ref [99] 5.8% return/no-unsupplied [236] 10.4% ??? [89] 11.5% one-iter [67] 11.7% match-e [71] 37.5% [242] 23937(3.2%) 23937(3.2%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------------ match-e [71] 13.3% return/no-unsupplied [236] 41.1% one-iter [67] 45.7% [243] 10600(1.4%) 10600(1.4%) filter ...t/collects/racket/private/list.rkt:275:2 ------------------------------------------------------------------------------------------ make-sequence [235] 100.0% [244] 5403(0.7%) 5403(0.7%) :hash-gen ...collects/racket/private/for.rkt:781:4 ------------------------------------------------------------------------------------------ merge2 [240] 14.4% assoc-ref [181] 85.6% [245] 1994(0.3%) 1994(0.3%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------------ coerce-contract/f [238] 100.0% [246] 1404(0.2%) 1404(0.2%) coerce-simple-value ...ract/private/guts.rkt:385:0 ------------------------------------------------------------------------------------------ make-sequence [235] 100.0% [247] 266(0.0%) 0(0.0%) ??? ...acket/collects/racket/private/for.rkt:477:7 custom-in-set [248] 100.0% ------------------------------------------------------------------------------------------ ??? [247] 6.0% ??? [83] 12.7% match-e [71] 81.4% [248] 4478(0.6%) 4478(0.6%) custom-in-set ...acket/private/set-types.rkt:580:0 ------------------------------------------------------------------------------------------