Profiling results ----------------- Total cpu time observed: 584820ms (out of 586094ms) Number of samples taken: 2001 (once every 292ms) (Hiding functions with self<1.0% and local<2.0%: 22 of 282 hidden) =========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================================== [1] 584820(100.0%) 0(0.0%) ??? ...are/racket/collects/racket/engine.rkt:42:24 profile-thunk [9] 100.0% ------------------------------------------------------------------------------------------- loop [206] 100.0% [2] 170100(29.1%) 0(0.0%) option-on-expr ...esting/src/core/regimes.rkt:83:0 sindices->spoints [10] 53.0% loop [206] 30.8% sort-context-on-expr [11] 11.0% err-lsts->split-indices [12] 3.6% pick-errors [14] 1.2% point->alt [19] 0.5% ------------------------------------------------------------------------------------------- hash-ref! [193] 100.0% [3] 15012(2.6%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:67:15 hash-ref! [193] 58.2% ??? [149] 41.8% ------------------------------------------------------------------------------------------- hash-ref! [193] 100.0% [4] 9704(1.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:285:26 hash-ref! [193] 73.3% ??? [13] 17.7% simplify [166] 9.0% ------------------------------------------------------------------------------------------- loop [206] 100.0% [5] 4640(0.8%) 584(0.1%) set-precompute! ...ing/src/core/simplify.rkt:193:0 loop [206] 62.4% simple-compose [189] 18.7% eval-const-expr [15] 6.3% ------------------------------------------------------------------------------------------- hash-ref! [193] 100.0% [6] 1470(0.3%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:322:33 simplify [166] 59.9% hash-ref! [193] 40.1% ------------------------------------------------------------------------------------------- f138 [175] 100.0% [7] 290(0.0%) 0(0.0%) exprs-to-branch-on ...ng/src/core/regimes.rkt:42:0 all-critical-subexpressions [16] 100.0% ------------------------------------------------------------------------------------------- loop [8] 50.0% loop [206] 50.0% [8] 278(0.0%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:40:19 loop [8] 50.0% ??? [127] 50.0% ------------------------------------------------------------------------------------------- ??? [1] 100.0% [9] 584820(100.0%) 0(0.0%) profile-thunk ...ket/pkgs/profile-lib/main.rkt:9:0 ??? [17] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [10] 90079(15.4%) 0(0.0%) sindices->spoints ...ng/src/core/regimes.rkt:136:0 loop [18] 99.7% eval-prog [123] 0.3% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [11] 18638(3.2%) 0(0.0%) sort-context-on-expr ...sting/src/points.rkt:115:0 ??? [47] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [12] 6100(1.0%) 3184(0.5%) err-lsts->split-indices .../core/regimes.rkt:239:0 ??? [218] 33.8% loop [20] 4.7% loop [206] 4.7% check-list [260] 4.6% ------------------------------------------------------------------------------------------- ??? [198] 9.1% ??? [4] 90.9% [13] 3244(0.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:288:19 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------- option-on-expr [2] 100.0% [14] 2000(0.3%) 0(0.0%) pick-errors ...-testing/src/core/regimes.rkt:201:0 ??? [202] 57.2% point->alt [19] 42.8% ------------------------------------------------------------------------------------------- set-precompute! [5] 100.0% [15] 294(0.1%) 0(0.0%) eval-const-expr ...-testing/src/programs.rkt:168:0 f138 [175] 100.0% ------------------------------------------------------------------------------------------- exprs-to-branch-on [7] 100.0% [16] 290(0.0%) 0(0.0%) all-critical-subexpressions ...re/regimes.rkt:58:0 f138 [175] 100.0% ------------------------------------------------------------------------------------------- profile-thunk [9] 100.0% [17] 584820(100.0%) 0(0.0%) ??? ...hare/racket/pkgs/profile-lib/main.rkt:40:10 ??? [21] 100.0% ------------------------------------------------------------------------------------------- f138 [175] 0.0% loop [18] 30.0% sindices->spoints [10] 70.0% [18] 90076(15.4%) 0(0.0%) loop .../private/map.rkt:54:19 sidx->spoint [22] 70.0% loop [18] 30.0% ??? [127] 0.0% ------------------------------------------------------------------------------------------- option-on-expr [2] 49.9% pick-errors [14] 50.1% [19] 1707(0.3%) 0(0.0%) point->alt ...t-testing/src/core/regimes.rkt:188:0 eval-prog [123] 100.0% ------------------------------------------------------------------------------------------- err-lsts->split-indices [12] 0.7% loop [20] 99.3% [20] 285(0.0%) 285(0.0%) loop ...hare/racket/collects/racket/list.rkt:158:2 loop [20] 99.3% ------------------------------------------------------------------------------------------- ??? [17] 100.0% [21] 584820(100.0%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/sandbox.rkt:49:6 run-improve [23] 91.3% prepare-points [31] 8.7% ------------------------------------------------------------------------------------------- loop [18] 100.0% [22] 89791(15.4%) 0(0.0%) sidx->spoint ...testing/src/core/regimes.rkt:146:2 binary-search-floats [24] 100.0% ------------------------------------------------------------------------------------------- ??? [21] 100.0% [23] 533772(91.3%) 0(0.0%) run-improve .../alt-testing/src/mainloop.rkt:225:0 run-iter! [25] 66.9% get-final-combination [26] 32.4% setup-alt-simplified [28] 0.3% ------------------------------------------------------------------------------------------- sidx->spoint [22] 100.0% [24] 89791(15.4%) 0(0.0%) binary-search-floats ...src/core/regimes.rkt:125:0 pred [27] 100.0% ------------------------------------------------------------------------------------------- run-improve [23] 100.0% [25] 357296(61.1%) 0(0.0%) run-iter! ...ie/alt-testing/src/mainloop.rkt:206:0 simplify! [29] 80.4% finalize-iter! [32] 8.3% gen-series! [33] 6.1% choose-best-alt! [34] 4.5% gen-rewrites! [36] 0.4% localize! [37] 0.3% ------------------------------------------------------------------------------------------- run-improve [23] 100.0% [26] 172960(29.6%) 0(0.0%) get-final-combination ...ng/src/mainloop.rkt:255:0 split-table [30] 99.0% loop [206] 1.0% ------------------------------------------------------------------------------------------- binary-search-floats [24] 100.0% [27] 89791(15.4%) 0(0.0%) pred ...ie/alt-testing/src/core/regimes.rkt:151:17 prepare-points [31] 79.6% errors [119] 20.4% ------------------------------------------------------------------------------------------- run-improve [23] 100.0% [28] 1771(0.3%) 0(0.0%) setup-alt-simplified ...-testing/src/glue.rkt:49:0 simplify-alt [35] 100.0% ------------------------------------------------------------------------------------------- run-iter! [25] 100.0% [29] 287111(49.1%) 0(0.0%) simplify! ...ie/alt-testing/src/mainloop.rkt:146:0 ??? [38] 100.0% ------------------------------------------------------------------------------------------- get-final-combination [26] 100.0% [30] 171246(29.3%) 0(0.0%) split-table ...rbie/alt-testing/src/glue.rkt:162:0 f138 [175] 99.5% ??? [100] 0.5% ------------------------------------------------------------------------------------------- ??? [21] 41.1% pred [27] 57.5% [31] 124282(21.3%) 0(0.0%) prepare-points ...alt-testing/src/points.rkt:214:0 loop [45] 44.1% make-exacts* [46] 36.9% make-exacts [40] 14.7% ??? [41] 3.8% reverse [255] 0.2% debug [180] 0.2% ------------------------------------------------------------------------------------------- run-iter! [25] 100.0% [32] 29693(5.1%) 0(0.0%) finalize-iter! ...t-testing/src/mainloop.rkt:160:0 ??? [100] 100.0% ------------------------------------------------------------------------------------------- run-iter! [25] 100.0% [33] 21798(3.7%) 0(0.0%) gen-series! .../alt-testing/src/mainloop.rkt:120:0 taylor-alt [39] 100.0% ------------------------------------------------------------------------------------------- run-iter! [25] 100.0% [34] 16088(2.8%) 0(0.0%) choose-best-alt! ...testing/src/mainloop.rkt:106:0 ??? [100] 100.0% ------------------------------------------------------------------------------------------- setup-alt-simplified [28] 100.0% [35] 1771(0.3%) 0(0.0%) simplify-alt ...rbie/alt-testing/src/glue.rkt:76:0 simplify [44] 100.0% ------------------------------------------------------------------------------------------- run-iter! [25] 100.0% [36] 1450(0.2%) 0(0.0%) gen-rewrites! ...lt-testing/src/mainloop.rkt:133:0 alt-rewrite-rm [42] 100.0% ------------------------------------------------------------------------------------------- run-iter! [25] 100.0% [37] 1156(0.2%) 0(0.0%) localize! ...ie/alt-testing/src/mainloop.rkt:115:0 localize-error [43] 100.0% ------------------------------------------------------------------------------------------- simplify! [29] 100.0% [38] 287111(49.1%) 0(0.0%) ??? ...s/herbie/alt-testing/src/mainloop.rkt:152:8 simplify [44] 100.0% ------------------------------------------------------------------------------------------- gen-series! [33] 100.0% [39] 21798(3.7%) 0(0.0%) taylor-alt ...erbie/alt-testing/src/glue.rkt:134:0 ??? [127] 100.0% ------------------------------------------------------------------------------------------- prepare-points [31] 100.0% [40] 18268(3.1%) 0(0.0%) make-exacts ...ie/alt-testing/src/points.rkt:156:0 loop [45] 88.8% make-exacts* [46] 9.6% debug-print [178] 1.6% ------------------------------------------------------------------------------------------- prepare-points [31] 100.0% [41] 4731(0.8%) 0(0.0%) ??? ...ies/herbie/alt-testing/src/points.rkt:230:7 ??? [127] 100.0% ------------------------------------------------------------------------------------------- gen-rewrites! [36] 100.0% [42] 1450(0.2%) 0(0.0%) alt-rewrite-rm ...testing/src/alternative.rkt:88:0 rewriter [48] 100.0% ------------------------------------------------------------------------------------------- localize! [37] 100.0% [43] 1156(0.2%) 0(0.0%) localize-error ...sting/src/core/localize.rkt:47:0 hash-ref! [193] 74.0% ??? [47] 26.0% ------------------------------------------------------------------------------------------- simplify-alt [35] 0.6% ??? [38] 99.4% [44] 288882(49.4%) 0(0.0%) simplify ...alt-testing/src/core/simplify.rkt:43:0 ??? [49] 99.8% *simplify-rules* [53] 0.2% ------------------------------------------------------------------------------------------- make-exacts [40] 22.8% prepare-points [31] 77.2% [45] 71022(12.1%) 0(0.0%) loop ...es/herbie/alt-testing/src/points.rkt:141:4 loop [206] 99.2% gen-andmap [54] 0.4% debug [180] 0.4% ------------------------------------------------------------------------------------------- make-exacts [40] 3.7% prepare-points [31] 96.3% [46] 47664(8.2%) 0(0.0%) make-exacts* ...e/alt-testing/src/points.rkt:138:0 eval-prog [123] 100.0% ------------------------------------------------------------------------------------------- step [216] 1.5% localize-error [43] 1.6% sort-context-on-expr [11] 97.0% [47] 19224(3.3%) 285(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [50] 98.5% ------------------------------------------------------------------------------------------- alt-rewrite-rm [42] 31.6% matcher [51] 68.4% [48] 1450(0.2%) 0(0.0%) rewriter ...alt-testing/src/core/matcher.rkt:131:2 matcher [51] 68.4% *rules* [52] 21.8% expression->type [55] 9.7% ------------------------------------------------------------------------------------------- simplify [44] 100.0% [49] 288302(49.3%) 294(0.1%) ??? ...rbie/alt-testing/src/core/simplify.rkt:77:0 iterate-egraph! [56] 82.6% loop [57] 16.8% mk-egraph [59] 0.4% ------------------------------------------------------------------------------------------- ??? [47] 100.0% [50] 18940(3.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [58] 77.2% ??? [204] 22.8% ------------------------------------------------------------------------------------------- matcher [51] 50.0% rewriter [48] 50.0% [51] 1450(0.2%) 0(0.0%) matcher .../alt-testing/src/core/matcher.rkt:167:2 matcher [51] 50.0% rewriter [48] 50.0% ------------------------------------------------------------------------------------------- rewriter [48] 100.0% [52] 1168(0.2%) 0(0.0%) *rules* .../alt-testing/src/syntax/rules.rkt:565:0 flag-set? [60] 75.3% set-member? [160] 24.7% ------------------------------------------------------------------------------------------- simplify [44] 100.0% [53] 580(0.1%) 0(0.0%) *simplify-rules* ...ing/src/syntax/rules.rkt:570:0 ??? [77] 100.0% ------------------------------------------------------------------------------------------- loop [45] 100.0% [54] 289(0.0%) 0(0.0%) gen-andmap ...ollects/racket/private/map.rkt:275:2 check-args [61] 100.0% ------------------------------------------------------------------------------------------- expression->type [55] 50.0% rewriter [48] 50.0% [55] 282(0.0%) 0(0.0%) expression->type ...esting/src/type-check.rkt:45:0 expression->type [55] 50.0% return/no-unsupplied [176] 50.0% ------------------------------------------------------------------------------------------- ??? [49] 100.0% [56] 238140(40.7%) 0(0.0%) iterate-egraph! ...ing/src/core/simplify.rkt:105:0 one-iter [62] 97.9% loop [206] 2.1% ------------------------------------------------------------------------------------------- ??? [49] 100.0% [57] 48460(8.3%) 1162(0.2%) loop ...ie/alt-testing/src/core/simplify.rkt:237:2 mk-min [63] 49.8% loop [64] 46.6% make-sequence [228] 1.2% ------------------------------------------------------------------------------------------- generic-sort/key [50] 35.6% copying-mergesort [58] 64.4% [58] 14614(2.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [58] 64.4% ??? [204] 32.2% errors-score [116] 2.1% ??? [127] 1.4% ------------------------------------------------------------------------------------------- ??? [49] 100.0% [59] 1166(0.2%) 0(0.0%) mk-egraph ...alt-testing/src/core/egraph.rkt:131:0 mk-enode-rec! [65] 100.0% ------------------------------------------------------------------------------------------- *rules* [52] 100.0% [60] 880(0.2%) 584(0.1%) flag-set? ...erbie/alt-testing/src/config.rkt:34:0 return/no-unsupplied [176] 33.5% ------------------------------------------------------------------------------------------- gen-andmap [54] 100.0% [61] 289(0.0%) 289(0.0%) check-args ...ollects/racket/private/map.rkt:180:2 ------------------------------------------------------------------------------------------- iterate-egraph! [56] 100.0% [62] 233208(39.9%) 10410(1.8%) one-iter ...lt-testing/src/core/simplify.rkt:116:0 match-e [67] 42.7% substitute-e [69] 11.2% mk-enode! [73] 11.0% merge-egraph-nodes! [70] 10.2% custom-set-member? [71] 10.0% loop! [74] 7.7% filter [187] 0.8% set-member? [160] 0.6% list-member? [152] 0.5% reduce-to-single! [72] 0.5% reverse [255] 0.2% update-leader! [76] 0.1% ------------------------------------------------------------------------------------------- loop [57] 100.0% [63] 24150(4.1%) 0(0.0%) mk-min ...re/racket/collects/racket/list.rkt:786:0 expression-cost [68] 100.0% ------------------------------------------------------------------------------------------- loop [57] 100.0% [64] 22573(3.9%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:796:4 expression-cost [68] 100.0% ------------------------------------------------------------------------------------------- loop [206] 41.9% mk-egraph [59] 58.1% [65] 1166(0.2%) 0(0.0%) mk-enode-rec! ...testing/src/core/egraph.rkt:122:0 loop [206] 100.0% ------------------------------------------------------------------------------------------- loop [66] 98.6% [66] 241(0.0%) 241(0.0%) loop ...cket/collects/racket/private/hash.rkt:25:8 loop [66] 98.6% ------------------------------------------------------------------------------------------- match-e [67] 27.2% one-iter [62] 72.8% [67] 99535(17.0%) 25016(4.3%) match-e ...ie/alt-testing/src/core/ematch.rkt:46:0 match-e [67] 27.2% loop [206] 11.8% ??? [77] 7.0% variable? [75] 6.1% reverse [255] 4.6% ??? [100] 4.5% list-cartesian-product [78] 4.1% make-sequence [228] 3.5% do-procedure-reduce-keyword-arity [84] 3.2% pack-leader [102] 1.3% make-curried [80] 1.2% filter [187] 1.0% set-member? [160] 1.0% check-list [260] 0.4% constant? [234] 0.1% ------------------------------------------------------------------------------------------- loop [64] 48.3% mk-min [63] 51.7% [68] 46722(8.0%) 1737(0.3%) expression-cost ...-testing/src/programs.rkt:209:0 table-ref [148] 60.0% ...sting/src/common.rkt:47:2 [159] 25.1% compile [128] 10.5% ??? [101] 0.6% ------------------------------------------------------------------------------------------- substitute-e [69] 14.8% one-iter [62] 85.2% [69] 26104(4.5%) 0(0.0%) substitute-e ...t-testing/src/core/ematch.rkt:71:0 mk-enode! [73] 74.5% substitute-e [69] 14.8% variable? [75] 6.3% ??? [100] 3.3% reverse [255] 0.6% assoc [242] 0.6% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [70] 3.1% one-iter [62] 96.9% [70] 23810(4.1%) 283(0.0%) merge-egraph-nodes! ...g/src/core/egraph.rkt:153:0 update-leader! [76] 67.6% loop! [74] 18.3% enode-merge! [79] 8.5% merge-egraph-nodes! [70] 3.1% update-en-expr [99] 1.2% ------------------------------------------------------------------------------------------- one-iter [62] 100.0% [71] 23396(4.0%) 22818(3.9%) custom-set-member? ...t/private/set-types.rkt:45:0 set-check-elem [81] 2.5% ------------------------------------------------------------------------------------------- one-iter [62] 100.0% [72] 1156(0.2%) 866(0.1%) reduce-to-single! ...ing/src/core/egraph.rkt:325:0 pack-leader [102] 25.1% ------------------------------------------------------------------------------------------- loop [206] 2.5% substitute-e [69] 42.1% one-iter [62] 55.4% [73] 46174(7.9%) 2626(0.4%) mk-enode! ...alt-testing/src/core/egraph.rkt:102:0 new-enode [82] 92.4% hash-has-key? [103] 1.9% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [70] 14.1% loop [206] 31.8% one-iter [62] 54.0% [74] 22643(3.9%) 3494(0.6%) loop! ...rbie/alt-testing/src/core/enode.rkt:192:2 custom-set-union [83] 37.2% loop [206] 33.1% make-immutable-set [86] 15.5% ??? [88] 5.8% ------------------------------------------------------------------------------------------- f138 [175] 2.9% substitute-e [69] 19.9% match-e [67] 74.3% [75] 20360(3.5%) 582(0.1%) variable? ...t-testing/src/syntax/syntax.rkt:665:0 ??? [100] 97.1% ------------------------------------------------------------------------------------------- one-iter [62] 1.7% merge-egraph-nodes! [70] 98.3% [76] 16838(2.9%) 6433(1.1%) update-leader! ...esting/src/core/egraph.rkt:218:0 do-hash-update [85] 41.1% update-en-expr [99] 5.2% make-sequence [228] 5.2% custom-set-union! [90] 3.5% hash-ref! [193] 3.4% reverse [255] 1.7% ------------------------------------------------------------------------------------------- *simplify-rules* [53] 6.4% match-e [67] 93.6% [77] 9030(1.5%) 0(0.0%) ??? ...e/racket/collects/racket/function.rkt:182:4 do-curry [87] 64.5% do-procedure-reduce-keyword-arity [84] 32.3% procedure-reduce-arity [93] 3.2% ------------------------------------------------------------------------------------------- list-cartesian-product [78] 19.5% match-e [67] 80.5% [78] 5286(0.9%) 3237(0.6%) list-cartesian-product ...src/core/ematch.rkt:20:0 make-sequence [228] 22.2% list-cartesian-product [78] 19.5% reverse [255] 5.5% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [70] 100.0% [79] 2034(0.3%) 286(0.0%) enode-merge! ...t-testing/src/core/enode.rkt:129:0 custom-set-intersect! [89] 71.6% adopt-enode! [92] 14.4% ------------------------------------------------------------------------------------------- match-e [67] 100.0% [80] 1438(0.2%) 575(0.1%) make-curried ...collects/racket/function.rkt:130:9 partially-applied-procedure-arity-mask [91] 39.4% make-keyword-procedure [182] 20.6% ------------------------------------------------------------------------------------------- custom-set-member? [71] 100.0% [81] 578(0.1%) 578(0.1%) set-check-elem ...cket/private/set-types.rkt:329:0 ------------------------------------------------------------------------------------------- mk-enode! [73] 100.0% [82] 42672(7.3%) 0(0.0%) new-enode ...e/alt-testing/src/core/enode.rkt:97:0 type-of-enode-expr [94] 100.0% ------------------------------------------------------------------------------------------- loop! [74] 100.0% [83] 9598(1.6%) 8444(1.4%) custom-set-union ...et/private/set-types.rkt:168:0 choose-immutable [96] 9.0% check-list [260] 3.0% ------------------------------------------------------------------------------------------- ??? [77] 41.7% match-e [67] 58.3% [84] 6986(1.2%) 6419(1.1%) do-procedure-reduce-keyword-arity ...kw.rkt:1689:2 procedure-keywords [194] 8.1% ------------------------------------------------------------------------------------------- update-leader! [76] 100.0% [85] 6914(1.2%) 0(0.0%) do-hash-update ...et/private/more-scheme.rkt:343:2 ??? [95] 100.0% ------------------------------------------------------------------------------------------- loop! [74] 100.0% [86] 6650(1.1%) 6072(1.0%) make-immutable-set .../private/set-types.rkt:948:0 stream? [97] 8.7% ------------------------------------------------------------------------------------------- ??? [77] 100.0% [87] 5826(1.0%) 4950(0.8%) do-curry ...cket/collects/racket/function.rkt:71:2 make-keyword-procedure [182] 10.0% procedure-keywords [194] 5.0% ------------------------------------------------------------------------------------------- loop! [74] 100.0% [88] 2613(0.4%) 296(0.1%) ??? ...erbie/alt-testing/src/core/enode.rkt:202:13 reverse [255] 55.3% update-en-expr [99] 33.3% ------------------------------------------------------------------------------------------- enode-merge! [79] 100.0% [89] 1456(0.2%) 1166(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 reverse [255] 19.9% ------------------------------------------------------------------------------------------- update-leader! [76] 100.0% [90] 582(0.1%) 582(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 ------------------------------------------------------------------------------------------- make-curried [80] 100.0% [91] 567(0.1%) 567(0.1%) partially-applied-procedure-arity-mask ...rkt:58:2 ------------------------------------------------------------------------------------------- enode-merge! [79] 100.0% [92] 292(0.0%) 292(0.0%) adopt-enode! ...t-testing/src/core/enode.rkt:105:0 ------------------------------------------------------------------------------------------- ??? [77] 100.0% [93] 288(0.0%) 0(0.0%) procedure-reduce-arity ...t/private/kw.rkt:1823:11 procedure-keywords [194] 100.0% ------------------------------------------------------------------------------------------- new-enode [82] 100.0% [94] 42672(7.3%) 0(0.0%) type-of-enode-expr ...ting/src/core/enode.rkt:68:0 get-sigs [98] 100.0% ------------------------------------------------------------------------------------------- do-hash-update [85] 100.0% [95] 6914(1.2%) 5456(0.9%) ??? ...rbie/alt-testing/src/core/egraph.rkt:226:24 update-en-expr [99] 16.9% reverse [255] 4.2% ------------------------------------------------------------------------------------------- custom-set-union [83] 100.0% [96] 866(0.1%) 578(0.1%) choose-immutable ...et/private/set-types.rkt:151:0 check-list [260] 33.2% ------------------------------------------------------------------------------------------- make-immutable-set [86] 100.0% [97] 578(0.1%) 578(0.1%) stream? ...t/collects/racket/private/for.rkt:493:2 ------------------------------------------------------------------------------------------- type-of-enode-expr [94] 100.0% [98] 42672(7.3%) 862(0.1%) get-sigs ...bie/alt-testing/src/type-check.rkt:5:0 table-ref [148] 47.6% ??? [101] 26.6% ??? [100] 14.9% ...sting/src/common.rkt:47:2 [159] 8.9% ------------------------------------------------------------------------------------------- merge-egraph-nodes! [70] 9.0% ??? [88] 27.2% update-leader! [76] 27.4% ??? [95] 36.4% [99] 3206(0.5%) 1470(0.3%) update-en-expr ...esting/src/core/egraph.rkt:212:0 make-sequence [228] 36.1% pack-leader [102] 18.1% ------------------------------------------------------------------------------------------- f138 [175] 0.3% setfindf [219] 0.6% split-table [30] 0.9% substitute-e [69] 2.2% ??? [227] 6.4% get-sigs [98] 6.8% match-e [67] 11.8% choose-best-alt! [34] 16.9% variable? [75] 21.0% finalize-iter! [32] 31.5% [100] 93437(16.0%) 2628(0.4%) ??? ...contract/private/arrow-val-first.rkt:486:18 hash-has-key? [103] 46.9% atab-add-altns [104] 31.5% atab-pick-alt [105] 16.9% ??? [227] 0.9% split-atab [107] 0.9% ------------------------------------------------------------------------------------------- ->bf [144] 2.4% expression-cost [68] 2.4% get-sigs [98] 95.2% [101] 11921(2.0%) 292(0.0%) ??? ...cts/racket/contract/private/arr-i.rkt:855:8 ??? [106] 73.3% handle-the-hash [170] 12.1% get/build-late-neg-projection [124] 9.8% arrow-higher-order:lnp [172] 2.4% ------------------------------------------------------------------------------------------- pack-leader [102] 6.3% reduce-to-single! [72] 12.6% update-en-expr [99] 18.8% match-e [67] 62.3% [102] 2310(0.4%) 2310(0.4%) pack-leader ...lt-testing/src/core/enode.rkt:247:0 pack-leader [102] 6.3% ------------------------------------------------------------------------------------------- mk-enode! [73] 1.9% ??? [100] 98.1% [103] 45311(7.7%) 33995(5.8%) hash-has-key? ...ket/private/more-scheme.rkt:372:2 ??? [158] 25.0% ------------------------------------------------------------------------------------------- ??? [100] 100.0% [104] 29693(5.1%) 0(0.0%) atab-add-altns ...ting/src/core/alt-table.rkt:52:0 atab-add-altn [108] 100.0% ------------------------------------------------------------------------------------------- ??? [100] 100.0% [105] 16088(2.8%) 0(0.0%) atab-pick-alt ...sting/src/core/alt-table.rkt:64:0 point-best-alt [109] 60.6% ??? [127] 28.5% write-json* [111] 5.5% errors [119] 3.6% loop [206] 1.8% ------------------------------------------------------------------------------------------- ??? [101] 100.0% [106] 8734(1.5%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:278:4 contract-pos/neg-doubling/proc [110] 100.0% ------------------------------------------------------------------------------------------- ??? [100] 100.0% [107] 856(0.1%) 0(0.0%) split-atab ...testing/src/core/alt-table.rkt:105:0 filter [187] 66.7% ??? [197] 33.3% ------------------------------------------------------------------------------------------- atab-add-altns [104] 100.0% [108] 29693(5.1%) 0(0.0%) atab-add-altn ...ting/src/core/alt-table.rkt:239:0 best-and-tied-at-points [112] 90.3% override-at-pnts [114] 8.7% minimize-alts [118] 0.9% ------------------------------------------------------------------------------------------- atab-pick-alt [105] 100.0% [109] 9756(1.7%) 0(0.0%) point-best-alt ...ting/src/core/alt-table.rkt:56:0 loop [206] 97.1% errors-score [116] 2.9% ------------------------------------------------------------------------------------------- ??? [106] 100.0% [110] 8734(1.5%) 3490(0.6%) contract-pos/neg-doubling/proc .../guts.rkt:1062:0 ??? [113] 56.7% ??? [117] 3.4% ------------------------------------------------------------------------------------------- atab-pick-alt [105] 100.0% [111] 881(0.2%) 0(0.0%) write-json* .../racket/collects/json/main.rkt:94:0 loop [115] 100.0% ------------------------------------------------------------------------------------------- atab-add-altn [108] 100.0% [112] 26826(4.6%) 286(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:153:0 errors [119] 98.9% ------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [110] 100.0% [113] 4950(0.8%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:192:2 ??? [120] 94.3% do-blame-add-context [121] 5.7% ------------------------------------------------------------------------------------------- atab-add-altn [108] 100.0% [114] 2593(0.4%) 287(0.0%) override-at-pnts ...g/src/core/alt-table.rkt:176:0 errors [119] 88.9% ------------------------------------------------------------------------------------------- write-json* [111] 25.0% loop [115] 75.0% [115] 881(0.2%) 881(0.2%) loop .../share/racket/collects/json/main.rkt:132:2 loop [115] 75.0% ------------------------------------------------------------------------------------------- point-best-alt [109] 48.3% copying-mergesort [58] 51.7% [116] 582(0.1%) 0(0.0%) errors-score ...e/alt-testing/src/points.rkt:281:0 loop [206] 51.7% list-member? [152] 48.3% ------------------------------------------------------------------------------------------- contract-pos/neg-doubling/proc [110] 100.0% [117] 293(0.1%) 0(0.0%) ??? ...ts/racket/contract/private/guts.rkt:1057:44 do-blame-add-context [121] 100.0% ------------------------------------------------------------------------------------------- atab-add-altn [108] 100.0% [118] 274(0.0%) 0(0.0%) minimize-alts ...ting/src/core/alt-table.rkt:193:0 rm-alts [122] 100.0% ------------------------------------------------------------------------------------------- atab-pick-alt [105] 0.5% override-at-pnts [114] 2.0% composed [215] 5.5% pred [27] 16.1% best-and-tied-at-points [112] 23.4% loop [206] 52.4% [119] 113614(19.4%) 856(0.1%) errors .../herbie/alt-testing/src/points.rkt:271:0 ??? [204] 56.6% eval-prog [123] 40.4% ??? [127] 1.3% ulp-difference [125] 1.0% ------------------------------------------------------------------------------------------- ??? [113] 100.0% [120] 4668(0.8%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:755:5 get/build-late-neg-projection [124] 93.7% reverse [255] 6.3% ------------------------------------------------------------------------------------------- ??? [113] 49.1% ??? [117] 50.9% [121] 576(0.1%) 576(0.1%) do-blame-add-context ...ct/private/blame.rkt:192:0 ------------------------------------------------------------------------------------------- minimize-alts [118] 100.0% [122] 274(0.0%) 0(0.0%) rm-alts ...lt-testing/src/core/alt-table.rkt:222:0 paired-fold [126] 100.0% ------------------------------------------------------------------------------------------- sindices->spoints [10] 0.3% point->alt [19] 1.8% errors [119] 48.0% make-exacts* [46] 49.9% [123] 95570(16.3%) 70352(12.0%) eval-prog ...ie/alt-testing/src/programs.rkt:150:0 f138 [175] 14.8% compile [128] 5.8% ??? [130] 2.4% ??? [127] 1.5% parse-lambda [133] 0.6% go [134] 0.3% kw-chaperone [135] 0.3% ------------------------------------------------------------------------------------------- ??? [131] 10.5% ??? [101] 10.5% ??? [120] 78.9% [124] 5544(0.9%) 580(0.1%) get/build-late-neg-projection ...te/guts.rkt:881:0 ??? [129] 71.1% ??? [131] 10.5% contract-struct-late-neg-projection [132] 7.9% ------------------------------------------------------------------------------------------- errors [119] 100.0% [125] 1146(0.2%) 278(0.0%) ulp-difference ...e/alt-testing/src/float.rkt:19:0 return/no-unsupplied [176] 25.3% set-member? [160] 25.3% ...sting/src/common.rkt:47:2 [159] 25.2% ------------------------------------------------------------------------------------------- rm-alts [122] 100.0% [126] 274(0.0%) 274(0.0%) paired-fold ...llects/racket/private/hash.rkt:40:2 ------------------------------------------------------------------------------------------- ??? [127] 0.2% loop [8] 0.3% loop [18] 0.3% ??? [202] 0.3% copying-mergesort [58] 0.6% errors [119] 1.4% eval-prog [123] 1.5% atab-pick-alt [105] 4.4% ??? [41] 4.9% loop [137] 11.6% taylor-alt [39] 11.6% f138 [175] 14.0% loop [206] 48.9% [127] 93932(16.1%) 5596(1.0%) ??? ...tract/private/arrow-higher-order.rkt:375:33 ->flonum [136] 30.6% real->bigfloat [139] 14.7% loop [137] 11.6% approximate [138] 11.6% ??? [227] 7.6% table-ref [148] 4.9% best-alt [140] 4.4% sample-multi-bounded [141] 3.8% ...sting/src/common.rkt:47:2 [159] 2.8% ->bf [144] 1.2% ??? [127] 0.2% ------------------------------------------------------------------------------------------- expression-cost [68] 47.2% eval-prog [123] 52.8% [128] 10432(1.8%) 0(0.0%) compile ...rbie/alt-testing/src/programs.rkt:186:0 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [124] 100.0% [129] 4382(0.7%) 1178(0.2%) ??? ...cts/racket/contract/private/prop.rkt:376:12 build-compound-type-name [142] 59.8% reverse [255] 13.3% ------------------------------------------------------------------------------------------- eval-prog [123] 100.0% [130] 2330(0.4%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [143] 100.0% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [124] 100.0% [131] 1168(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:272:2 get/build-late-neg-projection [124] 100.0% ------------------------------------------------------------------------------------------- get/build-late-neg-projection [124] 100.0% [132] 582(0.1%) 582(0.1%) contract-struct-late-neg-projection ...p.rkt:121:0 ------------------------------------------------------------------------------------------- eval-prog [123] 100.0% [133] 581(0.1%) 291(0.0%) parse-lambda ...llects/racket/private/kw.rkt:659:2 simple-args? [147] 49.9% ------------------------------------------------------------------------------------------- eval-prog [123] 100.0% [134] 294(0.1%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [145] 100.0% ------------------------------------------------------------------------------------------- eval-prog [123] 100.0% [135] 292(0.0%) 0(0.0%) kw-chaperone ...ects/racket/private/kw.rkt:2036:33 ...row-higher-order.rkt:387:44 [146] 100.0% ------------------------------------------------------------------------------------------- ??? [127] 100.0% [136] 28934(4.9%) 16155(2.8%) ->flonum ...rbie/alt-testing/src/programs.rkt:37:0 return/no-unsupplied [176] 21.0% ...sting/src/common.rkt:47:2 [159] 14.0% list-member? [152] 6.1% set-member? [160] 2.0% ??? [155] 1.0% ------------------------------------------------------------------------------------------- ??? [127] 13.4% loop [137] 86.6% [137] 21798(3.7%) 0(0.0%) loop .../herbie/alt-testing/src/programs.rkt:125:4 loop [137] 86.6% ??? [127] 13.4% ------------------------------------------------------------------------------------------- ??? [127] 100.0% [138] 21798(3.7%) 1174(0.2%) approximate ...lt-testing/src/core/taylor.rkt:12:0 hash-ref! [193] 68.9% taylor [151] 13.5% ??? [149] 10.9% ------------------------------------------------------------------------------------------- ??? [127] 100.0% [139] 13789(2.4%) 4252(0.7%) real->bigfloat .../private/bigfloat/mpfr.rkt:470:0 new-mpfr [239] 64.9% ??? [244] 2.1% ??? [247] 2.1% ------------------------------------------------------------------------------------------- ??? [127] 100.0% [140] 4586(0.8%) 0(0.0%) best-alt ...s/herbie/alt-testing/src/glue.rkt:71:0 argmins [150] 100.0% ------------------------------------------------------------------------------------------- ??? [127] 100.0% [141] 3560(0.6%) 2348(0.4%) sample-multi-bounded ...esting/src/points.rkt:44:0 random-exp [154] 34.1% ------------------------------------------------------------------------------------------- contract-struct-name [153] 10.9% ??? [129] 89.1% [142] 2620(0.4%) 862(0.1%) build-compound-type-name ...private/guts.rkt:543:0 contract-struct-name [153] 78.0% ------------------------------------------------------------------------------------------- ??? [130] 100.0% [143] 2330(0.4%) 2330(0.4%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------------------- loop [206] 21.3% ??? [127] 78.7% [144] 1472(0.3%) 314(0.1%) ->bf ...s/herbie/alt-testing/src/programs.rkt:53:0 table-ref [148] 59.3% ??? [101] 19.4% ------------------------------------------------------------------------------------------- go [134] 8.3% loop [145] 91.7% [145] 294(0.1%) 0(0.0%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [145] 91.7% stx-pair? [156] 8.3% ------------------------------------------------------------------------------------------- kw-chaperone [135] 100.0% [146] 292(0.0%) 0(0.0%) ...row-higher-order.rkt:387:44 ...order.rkt:387:44 successfully-got-the-right-kind-of-function [157]100.0% ------------------------------------------------------------------------------------------- parse-lambda [133] 100.0% [147] 290(0.0%) 290(0.0%) simple-args? ...llects/racket/private/kw.rkt:572:2 ------------------------------------------------------------------------------------------- ->bf [144] 1.6% ??? [127] 8.6% get-sigs [98] 37.7% expression-cost [68] 52.1% [148] 53844(9.2%) 13368(2.3%) table-ref ...erbie/alt-testing/src/common.rkt:46:0 ??? [158] 62.0% ??? [162] 4.0% set-member? [160] 3.8% return/no-unsupplied [176] 3.2% ...sting/src/common.rkt:47:2 [159] 1.6% reverse [255] 0.5% ------------------------------------------------------------------------------------------- approximate [138] 13.6% ??? [3] 86.4% [149] 17385(3.0%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:379:33 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------- extract-alt [221] 27.2% best-alt [140] 72.8% [150] 6299(1.1%) 0(0.0%) argmins ...herbie/alt-testing/src/common.rkt:152:0 composed [215] 100.0% ------------------------------------------------------------------------------------------- f138 [175] 0.8% loop [206] 1.0% composed [222] 1.8% taylor [151] 29.5% approximate [138] 30.4% hash-ref! [193] 36.4% [151] 5882(1.0%) 0(0.0%) taylor ...ie/alt-testing/src/core/taylor.rkt:163:0 taylor-quotient [163] 29.7% taylor [151] 29.5% normalize-series [171] 20.0% taylor-invert [164] 8.4% debug-print [178] 5.7% loop [206] 2.8% debug [180] 1.3% f138 [175] 0.8% ------------------------------------------------------------------------------------------- errors-score [116] 8.7% one-iter [62] 36.0% ->flonum [136] 55.2% [152] 3221(0.6%) 916(0.2%) list-member? ...llects/racket/private/set.rkt:24:0 member [161] 71.6% ------------------------------------------------------------------------------------------- build-compound-type-name [142] 100.0% [153] 2332(0.4%) 292(0.0%) contract-struct-name ...ract/private/prop.rkt:98:0 reverse [255] 62.9% build-compound-type-name [142] 24.6% ------------------------------------------------------------------------------------------- random-exp [154] 37.8% sample-multi-bounded [141] 62.2% [154] 1212(0.2%) 1212(0.2%) random-exp ...bie/alt-testing/src/common.rkt:253:0 random-exp [154] 37.8% ------------------------------------------------------------------------------------------- ->flonum [136] 100.0% [155] 296(0.1%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:59:13 ??? [244] 100.0% ------------------------------------------------------------------------------------------- loop [145] 100.0% [156] 294(0.1%) 294(0.1%) stx-pair? .../collects/racket/private/stx.rkt:40:4 ------------------------------------------------------------------------------------------- ...row-higher-order.rkt:387:44 [146] 100.0% [157] 292(0.0%) 0(0.0%) successfully-got-the-right-kind-of-function ...5:4 arity-checking-wrapper [165] 100.0% ------------------------------------------------------------------------------------------- hash-has-key? [103] 25.3% table-ref [148] 74.7% [158] 44682(7.6%) 20584(3.5%) ??? ...ects/racket/contract/private/list.rkt:814:4 ??? [167] 34.4% handle-the-hash [170] 13.0% ??? [214] 2.6% arrow-higher-order:lnp [172] 1.9% check-list [260] 0.7% ??? [181] 0.6% ------------------------------------------------------------------------------------------- ulp-difference [125] 1.2% cur-debug-level [191] 1.2% debug [180] 1.2% ??? [169] 3.0% table-ref [148] 3.6% ??? [127] 10.8% get-sigs [98] 15.0% ->flonum [136] 16.8% expression-cost [68] 46.0% [159] 24216(4.1%) 6644(1.1%) ...sting/src/common.rkt:47:2 ...e/arr-i.rkt:976:19 ??? [168] 40.8% ??? [169] 28.7% ??? [227] 4.2% coerce-contract [173] 1.2% ------------------------------------------------------------------------------------------- *rules* [52] 5.0% ulp-difference [125] 5.0% ->flonum [136] 10.0% match-e [67] 20.1% one-iter [62] 24.9% table-ref [148] 35.1% [160] 5814(1.0%) 5814(1.0%) set-member? ...ts/racket/private/generic.rkt:472:9 ------------------------------------------------------------------------------------------- list-member? [152] 100.0% [161] 2305(0.4%) 2305(0.4%) member ...collects/racket/private/member.rkt:13:21 ------------------------------------------------------------------------------------------- table-ref [148] 100.0% [162] 2172(0.4%) 2172(0.4%) ??? ...cts/racket/contract/private/list.rkt:211:14 ------------------------------------------------------------------------------------------- taylor [151] 100.0% [163] 1747(0.3%) 0(0.0%) taylor-quotient ...sting/src/core/taylor.rkt:328:0 normalize-series [171] 83.3% simplify [166] 16.7% ------------------------------------------------------------------------------------------- taylor [151] 100.0% [164] 1176(0.2%) 0(0.0%) taylor-invert ...testing/src/core/taylor.rkt:312:0 simplify [166] 100.0% ------------------------------------------------------------------------------------------- successfully-got-the-right-kind-of-function [157]100.0% [165] 292(0.0%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:443:0 matches-arity-exactly? [174] 100.0% ------------------------------------------------------------------------------------------- taylor-quotient [163] 1.5% ??? [199] 3.1% loop [206] 3.1% ??? [4] 4.6% ??? [6] 4.6% taylor-invert [164] 6.1% hash-ref! [193] 73.9% [166] 19138(3.3%) 0(0.0%) simplify ...e/alt-testing/src/core/reduce.rkt:16:0 f138 [175] 80.0% debug-print [178] 12.3% debug [180] 3.1% make-multiplication-node [223] 1.5% simplify-node [185] 1.5% ------------------------------------------------------------------------------------------- ??? [158] 100.0% [167] 15390(2.6%) 6954(1.2%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 blame-add-missing-party [177] 26.5% loop [179] 17.0% ??? [184] 5.7% make-keyword-procedure [182] 3.7% ------------------------------------------------------------------------------------------- ??? [214] 28.0% ...sting/src/common.rkt:47:2 [159] 72.0% [168] 9882(1.7%) 2330(0.4%) ??? ...ects/racket/contract/private/list.rkt:376:4 ??? [214] 48.3% ??? [227] 22.1% ??? [181] 11.9% ------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [159] 100.0% [169] 7667(1.3%) 3122(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1324:39 return/no-unsupplied [176] 25.4% ...sting/src/common.rkt:47:2 [159] 18.8% assoc-ref [183] 15.1% ------------------------------------------------------------------------------------------- ??? [101] 19.9% ??? [158] 80.1% [170] 7255(1.2%) 3188(0.5%) handle-the-hash ...contract/private/hash.rkt:323:0 ??? [214] 51.9% ??? [240] 4.1% ------------------------------------------------------------------------------------------- taylor [151] 44.7% taylor-quotient [163] 55.3% [171] 2632(0.5%) 0(0.0%) normalize-series ...ting/src/core/taylor.rkt:301:0 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------- ??? [101] 24.7% ??? [158] 75.3% [172] 1155(0.2%) 582(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:673:7 ??? [186] 49.6% ------------------------------------------------------------------------------------------- ...sting/src/common.rkt:47:2 [159] 100.0% [173] 292(0.0%) 0(0.0%) coerce-contract ...contract/private/guts.rkt:307:0 coerce-contract/f [250] 100.0% ------------------------------------------------------------------------------------------- arity-checking-wrapper [165] 100.0% [174] 292(0.0%) 292(0.0%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ------------------------------------------------------------------------------------------- all-critical-subexpressions [16] 0.0% eval-const-expr [15] 0.2% taylor [151] 0.2% composed [215] 0.2% hash-ref! [193] 0.5% eval-prog [123] 1.8% simplify [166] 3.5% loop [206] 8.9% split-table [30] 84.9% [175] 189434(32.4%) 9131(1.6%) f138 .../collects/racket/match/compiler.rkt:548:40 loop [206] 95.2% ??? [127] 1.7% composed [215] 0.2% taylor [151] 0.2% ??? [100] 0.1% variable? [75] 0.1% loop [18] 0.0% simple-compose [189] 0.0% exprs-to-branch-on [7] 0.0% ------------------------------------------------------------------------------------------- expression->type [55] 2.7% ulp-difference [125] 2.7% flag-set? [60] 2.8% table-ref [148] 16.5% ??? [169] 18.3% ->flonum [136] 57.1% [176] 10628(1.8%) 4370(0.7%) return/no-unsupplied ...ct/private/arr-i.rkt:566:0 filter [187] 43.4% reverse [255] 15.5% ------------------------------------------------------------------------------------------- ??? [167] 100.0% [177] 4076(0.7%) 4076(0.7%) blame-add-missing-party ...private/blame.rkt:382:0 ------------------------------------------------------------------------------------------- make-exacts [40] 7.6% taylor [151] 31.0% simplify [166] 61.4% [178] 3826(0.7%) 3227(0.6%) debug-print ...bie/alt-testing/src/debug.rkt:107:0 make-sequence [228] 15.7% ------------------------------------------------------------------------------------------- ??? [167] 45.6% loop [179] 54.4% [179] 2617(0.4%) 2617(0.4%) loop ...ts/racket/contract/private/blame.rkt:319:2 loop [179] 54.4% ------------------------------------------------------------------------------------------- loop [45] 19.5% prepare-points [31] 19.7% taylor [151] 20.5% simplify [166] 40.4% [180] 1460(0.2%) 0(0.0%) debug ...es/herbie/alt-testing/src/debug.rkt:102:0 get-setting [196] 39.9% cur-debug-level [191] 39.6% ...sting/src/common.rkt:47:2 [159] 20.5% ------------------------------------------------------------------------------------------- ??? [158] 19.6% ??? [168] 80.4% [181] 1458(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:287:9 check-hash/c [188] 100.0% ------------------------------------------------------------------------------------------- make-curried [80] 20.3% ??? [167] 39.5% do-curry [87] 40.2% [182] 1456(0.2%) 1456(0.2%) make-keyword-procedure ...ket/private/kw.rkt:448:4 ------------------------------------------------------------------------------------------- ??? [169] 100.0% [183] 1158(0.2%) 0(0.0%) assoc-ref ...collects/racket/private/dict.rkt:77:0 assoc [242] 100.0% ------------------------------------------------------------------------------------------- ??? [167] 100.0% [184] 882(0.2%) 882(0.2%) ??? ...rivate/unconstrained-domain-arrow.rkt:19:10 ------------------------------------------------------------------------------------------- simplify [166] 33.2% loop [206] 66.8% [185] 872(0.1%) 0(0.0%) simplify-node ...-testing/src/core/reduce.rkt:50:0 combine-mterms [190] 66.8% combine-aterms [192] 33.2% ------------------------------------------------------------------------------------------- arrow-higher-order:lnp [172] 100.0% [186] 572(0.1%) 287(0.0%) ??? ...et/contract/private/arity-checking.rkt:19:2 procedure-keywords [194] 49.9% ------------------------------------------------------------------------------------------- split-atab [107] 7.0% match-e [67] 14.4% one-iter [62] 21.7% return/no-unsupplied [176] 56.8% [187] 8118(1.4%) 7547(1.3%) filter ...t/collects/racket/private/list.rkt:275:2 ??? [197] 7.0% ------------------------------------------------------------------------------------------- ??? [181] 100.0% [188] 1458(0.2%) 574(0.1%) check-hash/c ...ket/contract/private/hash.rkt:86:0 flat-contract? [195] 60.6% ------------------------------------------------------------------------------------------- f138 [175] 25.7% set-precompute! [5] 74.3% [189] 1168(0.2%) 880(0.2%) simple-compose ...s/racket/private/list.rkt:426:10 procedure-keywords [194] 24.7% ------------------------------------------------------------------------------------------- simplify-node [185] 100.0% [190] 582(0.1%) 290(0.0%) combine-mterms ...esting/src/core/reduce.rkt:191:0 hash-ref! [193] 50.2% ------------------------------------------------------------------------------------------- debug [180] 100.0% [191] 578(0.1%) 0(0.0%) cur-debug-level .../alt-testing/src/debug.rkt:38:2 ...sting/src/common.rkt:47:2 [159] 50.8% get-setting [196] 49.2% ------------------------------------------------------------------------------------------- simplify-node [185] 100.0% [192] 290(0.0%) 290(0.0%) combine-aterms ...esting/src/core/reduce.rkt:183:0 ------------------------------------------------------------------------------------------- ??? [6] 0.2% combine-mterms [190] 0.2% localize-error [43] 0.7% ??? [13] 1.1% update-leader! [76] 1.9% composed [222] 2.1% ??? [201] 3.5% ??? [4] 3.9% normalize-series [171] 4.1% ??? [199] 5.6% ??? [198] 7.6% approximate [138] 8.3% ??? [149] 10.1% ??? [3] 14.7% compile [128] 15.1% loop [206] 18.8% [193] 30716(5.3%) 7537(1.3%) hash-ref! .../racket/private/more-scheme.rkt:377:2 ??? [3] 23.0% ??? [200] 20.8% simplify [166] 9.4% ??? [198] 7.8% ??? [199] 7.0% ??? [4] 5.3% bigfloat-hash [203] 5.1% ??? [201] 3.5% f138 [175] 2.8% taylor [151] 1.9% ??? [6] 0.5% ------------------------------------------------------------------------------------------- ??? [186] 16.6% procedure-reduce-arity [93] 16.7% simple-compose [189] 16.7% do-curry [87] 16.9% do-procedure-reduce-keyword-arity [84] 33.0% [194] 1720(0.3%) 1720(0.3%) procedure-keywords .../racket/private/kw.rkt:534:2 ------------------------------------------------------------------------------------------- check-hash/c [188] 100.0% [195] 884(0.2%) 0(0.0%) flat-contract? .../contract/private/guts.rkt:129:0 simple-flat-contract? [248] 100.0% ------------------------------------------------------------------------------------------- cur-debug-level [191] 32.8% debug [180] 67.2% [196] 868(0.1%) 868(0.1%) get-setting ...rbie/alt-testing/src/debug.rkt:96:0 ------------------------------------------------------------------------------------------- split-atab [107] 33.3% filter [187] 66.7% [197] 856(0.1%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:302:4 ??? [202] 100.0% ------------------------------------------------------------------------------------------- hash-ref! [193] 100.0% [198] 14154(2.4%) 0(0.0%) ??? ...erbie/alt-testing/src/core/taylor.rkt:44:15 hash-ref! [193] 97.9% ??? [13] 2.1% ------------------------------------------------------------------------------------------- hash-ref! [193] 100.0% [199] 10010(1.7%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:295:23 hash-ref! [193] 94.1% simplify [166] 5.9% ------------------------------------------------------------------------------------------- hash-ref! [193] 100.0% [200] 8700(1.5%) 876(0.1%) ??? ...s/herbie/alt-testing/src/programs.rkt:194:5 loop [206] 95.5% ------------------------------------------------------------------------------------------- hash-ref! [193] 100.0% [201] 6772(1.2%) 0(0.0%) ??? ...rbie/alt-testing/src/core/taylor.rkt:392:23 hash-ref! [193] 100.0% ------------------------------------------------------------------------------------------- ??? [197] 24.8% pick-errors [14] 33.2% loop [206] 41.9% [202] 3446(0.6%) 0(0.0%) ??? ...rbie/alt-testing/src/core/regimes.rkt:194:2 ??? [204] 91.6% ??? [127] 8.4% ------------------------------------------------------------------------------------------- hash-ref! [193] 100.0% [203] 3194(0.5%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:168:0 bfcanonicalize [205] 100.0% ------------------------------------------------------------------------------------------- ??? [202] 2.1% generic-sort/key [50] 2.8% copying-mergesort [58] 9.0% errors [119] 42.0% loop [206] 44.1% [204] 152854(26.1%) 75686(12.9%) ??? ...s/herbie/alt-testing/src/programs.rkt:156:4 loop [206] 28.6% bf* [207] 7.1% ??? [213] 4.0% ??? [208] 3.5% ??? [240] 2.1% ??? [209] 2.0% ??? [211] 1.5% ------------------------------------------------------------------------------------------- bigfloat-hash [203] 100.0% [205] 3194(0.5%) 0(0.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:158:0 bitwise-first-bit-set [210] 91.0% bfzero? [212] 9.0% ------------------------------------------------------------------------------------------- errors-score [116] 0.0% err-lsts->split-indices [12] 0.0% atab-pick-alt [105] 0.0% set-precompute! [5] 0.0% iterate-egraph! [56] 0.1% taylor [151] 0.2% get-final-combination [26] 0.3% mk-enode-rec! [65] 0.3% point-best-alt [109] 0.6% loop! [74] 0.8% loop [45] 0.8% option-on-expr [2] 0.8% ??? [200] 1.3% ??? [204] 1.3% match-e [67] 2.7% f138 [175] 9.1% loop [206] 81.4% [206] 288968(49.4%) 7628(1.3%) loop .../private/map.rkt:40:19 loop [206] 81.4% option-on-expr [2] 4.7% f138 [175] 3.8% errors [119] 1.5% ??? [127] 1.3% hash-ref! [193] 1.3% ??? [204] 0.8% step [216] 0.8% loop! [74] 0.8% foldl [217] 0.5% keyword-apply [220] 0.4% extract-alt [221] 0.3% composed [222] 0.2% simplify [166] 0.2% mk-enode! [73] 0.2% mk-enode-rec! [65] 0.2% simplify-node [185] 0.1% set-precompute! [5] 0.1% make-multiplication-node [223] 0.0% taylor [151] 0.0% setfindf [219] 0.0% make-addition-node* [224] 0.0% ??? [218] 0.0% ~a [225] 0.0% ??? [202] 0.0% composed [215] 0.0% loop [8] 0.0% ->bf [144] 0.0% ------------------------------------------------------------------------------------------- ??? [204] 100.0% [207] 10807(1.8%) 290(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [213] 97.3% ------------------------------------------------------------------------------------------- ??? [204] 100.0% [208] 5275(0.9%) 5275(0.9%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------- ??? [204] 100.0% [209] 3000(0.5%) 0(0.0%) ??? .../private/arrow-higher-order.rkt:379:33 ??? [214] 100.0% ------------------------------------------------------------------------------------------- bfcanonicalize [205] 100.0% [210] 2907(0.5%) 2907(0.5%) bitwise-first-bit-set ...hmetic/bitwise-6.rkt:35:0 ------------------------------------------------------------------------------------------- ??? [204] 100.0% [211] 2356(0.4%) 1752(0.3%) ??? .../herbie/alt-testing/src/bigcomplex.rkt:66:2 ^TYPE? [256] 25.6% ------------------------------------------------------------------------------------------- bfcanonicalize [205] 100.0% [212] 288(0.0%) 288(0.0%) bfzero? ...ib/math/private/bigfloat/mpfr.rkt:797:4 ------------------------------------------------------------------------------------------- ??? [204] 37.0% bf* [207] 63.0% [213] 16686(2.9%) 660(0.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [226] 96.0% ------------------------------------------------------------------------------------------- ??? [158] 7.5% ??? [209] 19.4% handle-the-hash [170] 24.3% ??? [168] 48.7% [214] 15477(2.6%) 5297(0.9%) ??? ...cts/racket/contract/private/list.rkt:215:14 ??? [168] 35.8% ??? [229] 18.7% ??? [227] 5.7% ??? [240] 3.8% check-list [260] 1.9% ------------------------------------------------------------------------------------------- loop [206] 3.5% f138 [175] 18.4% argmins [150] 78.1% [215] 8065(1.4%) 284(0.0%) composed ...ollects/racket/private/list.rkt:340:16 errors [119] 78.1% f138 [175] 18.4% ------------------------------------------------------------------------------------------- loop [206] 100.0% [216] 3198(0.5%) 2322(0.4%) step .../racket/collects/racket/function.rkt:145:9 sort [232] 18.5% ??? [47] 8.9% ------------------------------------------------------------------------------------------- loop [206] 100.0% [217] 2934(0.5%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:248:4 merge2 [230] 70.0% check-fold [231] 30.0% ------------------------------------------------------------------------------------------- loop [206] 22.0% err-lsts->split-indices [12] 78.0% [218] 2644(0.5%) 2644(0.5%) ??? ...e/racket/collects/racket/function.rkt:93:12 ------------------------------------------------------------------------------------------- loop [206] 100.0% [219] 2034(0.3%) 870(0.1%) setfindf ...erbie/alt-testing/src/common.rkt:186:0 ??? [100] 28.8% make-sequence [228] 14.3% constant? [234] 14.2% ------------------------------------------------------------------------------------------- loop [206] 100.0% [220] 1742(0.3%) 1456(0.2%) keyword-apply ...lects/racket/private/kw.rkt:478:2 loop [237] 16.4% ------------------------------------------------------------------------------------------- loop [206] 100.0% [221] 1713(0.3%) 0(0.0%) extract-alt ...erbie/alt-testing/src/glue.rkt:55:0 argmins [150] 100.0% ------------------------------------------------------------------------------------------- loop [206] 100.0% [222] 1441(0.2%) 0(0.0%) composed ...ollects/racket/private/list.rkt:341:16 hash-ref! [193] 59.3% taylor [151] 40.7% ------------------------------------------------------------------------------------------- simplify [166] 33.5% loop [206] 66.5% [223] 875(0.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [233] 67.0% make-multiplication-subsubsubnode [236] 33.0% ------------------------------------------------------------------------------------------- loop [206] 100.0% [224] 300(0.1%) 0(0.0%) make-addition-node* ...g/src/core/reduce.rkt:222:0 make-addition-node [235] 100.0% ------------------------------------------------------------------------------------------- loop [206] 100.0% [225] 286(0.0%) 0(0.0%) ~a ...are/racket/collects/racket/format.rkt:150:16 write-proc [238] 100.0% ------------------------------------------------------------------------------------------- ??? [213] 100.0% [226] 16027(2.7%) 6718(1.1%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:846:4 new-mpfr [239] 48.7% ??? [244] 7.5% ??? [247] 1.9% ------------------------------------------------------------------------------------------- ??? [100] 5.9% ??? [214] 5.9% ...sting/src/common.rkt:47:2 [159] 7.9% ??? [168] 29.5% ??? [127] 48.9% [227] 14841(2.5%) 2058(0.4%) ??? ...ects/racket/contract/private/guts.rkt:794:8 ??? [100] 42.9% contract? [241] 23.6% dict? [243] 13.7% ^TYPE? [256] 5.9% ------------------------------------------------------------------------------------------- setfindf [219] 3.2% loop [57] 6.4% debug-print [178] 6.6% update-leader! [76] 9.6% update-en-expr [99] 12.8% list-cartesian-product [78] 19.5% match-e [67] 41.9% [228] 9041(1.5%) 8165(1.4%) make-sequence ...ects/racket/private/for.rkt:557:2 :hash-gen [245] 9.7% ------------------------------------------------------------------------------------------- ??? [214] 100.0% [229] 2896(0.5%) 1158(0.2%) ??? ...ects/racket/contract/private/list.rkt:763:7 ??? [240] 40.1% check-list [260] 19.9% ------------------------------------------------------------------------------------------- foldl [217] 100.0% [230] 2052(0.4%) 285(0.0%) merge2 ...bie/alt-testing/src/core/ematch.rkt:31:0 assoc [242] 86.1% ------------------------------------------------------------------------------------------- foldl [217] 100.0% [231] 881(0.2%) 881(0.2%) check-fold ...llects/racket/private/list.rkt:223:2 ------------------------------------------------------------------------------------------- step [216] 100.0% [232] 591(0.1%) 591(0.1%) sort ...cket/collects/racket/private/list.rkt:43:2 ------------------------------------------------------------------------------------------- make-multiplication-node [223] 100.0% [233] 586(0.1%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:240:0 make-multiplication-subsubnode [246] 100.0% ------------------------------------------------------------------------------------------- match-e [67] 50.0% setfindf [219] 50.0% [234] 576(0.1%) 576(0.1%) constant? ...t-testing/src/syntax/syntax.rkt:660:0 ------------------------------------------------------------------------------------------- make-addition-node* [224] 100.0% [235] 300(0.1%) 0(0.0%) make-addition-node ...ng/src/core/reduce.rkt:208:0 partition [251] 100.0% ------------------------------------------------------------------------------------------- make-multiplication-node [223] 100.0% [236] 288(0.0%) 288(0.0%) make-multiplication-subsubsubnode ...uce.rkt:262:0 ------------------------------------------------------------------------------------------- keyword-apply [220] 100.0% [237] 286(0.0%) 286(0.0%) loop ...cket/collects/racket/private/kw.rkt:518:13 ------------------------------------------------------------------------------------------- ~a [225] 100.0% [238] 286(0.0%) 286(0.0%) write-proc ...alt-testing/src/alternative.rkt:22:9 ------------------------------------------------------------------------------------------- bfmul [226] 46.6% real->bigfloat [139] 53.4% [239] 16758(2.9%) 16758(2.9%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:344:0 ------------------------------------------------------------------------------------------- handle-the-hash [170] 5.7% ??? [214] 11.0% ??? [229] 22.1% ??? [204] 61.2% [240] 5262(0.9%) 1994(0.3%) ??? ...ects/racket/contract/private/prop.rkt:567:4 ??? [249] 50.9% ??? [253] 11.2% ------------------------------------------------------------------------------------------- ??? [227] 100.0% [241] 3510(0.6%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:125:0 simple-flat-contract? [248] 75.1% coerce-contract/f [250] 24.9% ------------------------------------------------------------------------------------------- substitute-e [69] 9.0% assoc-ref [183] 36.0% merge2 [230] 55.0% [242] 3214(0.5%) 3214(0.5%) assoc ...t/collects/racket/private/list.rkt:196:13 ------------------------------------------------------------------------------------------- ??? [227] 100.0% [243] 2039(0.3%) 1447(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 assoc? [252] 29.0% ------------------------------------------------------------------------------------------- real->bigfloat [139] 16.4% ??? [155] 16.4% bfmul [226] 67.2% [244] 1800(0.3%) 1800(0.3%) ??? ...hare/racket/collects/ffi/unsafe.rkt:1450:12 ------------------------------------------------------------------------------------------- make-sequence [228] 100.0% [245] 876(0.1%) 876(0.1%) :hash-gen ...collects/racket/private/for.rkt:781:4 ------------------------------------------------------------------------------------------- make-multiplication-subnode [233] 100.0% [246] 586(0.1%) 0(0.0%) make-multiplication-subsubnode ...reduce.rkt:250:0 partition [251] 100.0% ------------------------------------------------------------------------------------------- real->bigfloat [139] 49.1% bfmul [226] 50.9% [247] 584(0.1%) 0(0.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:959:4 assq [254] 100.0% ------------------------------------------------------------------------------------------- flat-contract? [195] 25.1% contract? [241] 74.9% [248] 3520(0.6%) 3520(0.6%) simple-flat-contract? ...ct/private/guts.rkt:141:0 ------------------------------------------------------------------------------------------- ??? [240] 100.0% [249] 2676(0.5%) 628(0.1%) ??? ...ects/racket/contract/private/orc.rkt:112:15 ??? [257] 43.4% ^TYPE? [256] 33.1% ------------------------------------------------------------------------------------------- coerce-contract [173] 25.1% contract? [241] 74.9% [250] 1165(0.2%) 584(0.1%) coerce-contract/f ...ntract/private/guts.rkt:372:0 coerce-simple-value [259] 49.9% ------------------------------------------------------------------------------------------- make-addition-node [235] 33.8% make-multiplication-subsubnode [246] 66.2% [251] 886(0.2%) 294(0.1%) partition ...racket/collects/racket/list.rkt:556:0 reverse [255] 66.9% ------------------------------------------------------------------------------------------- dict? [243] 100.0% [252] 592(0.1%) 592(0.1%) assoc? ...et/collects/racket/private/dict.rkt:13:0 ------------------------------------------------------------------------------------------- ??? [240] 100.0% [253] 592(0.1%) 0(0.0%) ??? ...lects/racket/contract/private/orc.rkt:117:8 eqables-pred [258] 100.0% ------------------------------------------------------------------------------------------- ??? [247] 100.0% [254] 584(0.1%) 584(0.1%) assq ...et/collects/racket/private/list.rkt:187:13 ------------------------------------------------------------------------------------------- table-ref [148] 2.1% update-leader! [76] 2.1% list-cartesian-product [78] 2.1% prepare-points [31] 2.1% custom-set-intersect! [89] 2.1% ??? [120] 2.1% ??? [95] 2.1% substitute-e [69] 2.1% one-iter [62] 4.2% ??? [129] 4.2% partition [251] 4.3% ??? [88] 10.4% contract-struct-name [153] 10.6% return/no-unsupplied [176] 11.9% match-e [67] 37.7% [255] 13867(2.4%) 13867(2.4%) reverse ...collects/racket/private/reverse.rkt:6:4 ------------------------------------------------------------------------------------------- ??? [211] 25.6% ??? [227] 36.9% ??? [249] 37.5% [256] 2362(0.4%) 2362(0.4%) ^TYPE? .../ffi/unsafe.rkt:1621:20 ------------------------------------------------------------------------------------------- ??? [249] 100.0% [257] 1162(0.2%) 876(0.1%) ??? ...ects/racket/contract/private/list.rkt:163:5 check-list [260] 24.6% ------------------------------------------------------------------------------------------- ??? [253] 100.0% [258] 592(0.1%) 592(0.1%) eqables-pred ...et/contract/private/orc.rkt:100:10 ------------------------------------------------------------------------------------------- coerce-contract/f [250] 100.0% [259] 581(0.1%) 581(0.1%) coerce-simple-value ...ract/private/guts.rkt:385:0 ------------------------------------------------------------------------------------------- err-lsts->split-indices [12] 9.8% ??? [257] 9.9% choose-immutable [96] 9.9% custom-set-union [83] 10.0% ??? [214] 10.0% ??? [158] 10.0% ??? [229] 19.9% match-e [67] 20.4% [260] 2891(0.5%) 2891(0.5%) check-list ...ollects/racket/private/for.rkt:690:2 -------------------------------------------------------------------------------------------