Profiling results ----------------- Total cpu time observed: 238006ms (out of 241652ms) Number of samples taken: 1763 (once every 135ms) (Hiding functions with self<1.0% and local<2.0%: 15 of 206 hidden) ========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================== ??? [52] 100.0% [1] 227014(95.4%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [8] 100.0% ------------------------------------------------------------------------------------------ map [99] 0.1% ??? [107] 1.4% for-loop [158] 21.9% loop [117] 76.6% [2] 161900(68.0%) 2910(1.2%) ??? /home/ztatlock/herbie/src/programs.rkt:152:4 ??? [9] 91.3% loop [117] 3.0% ??? [126] 2.3% ->flonum [12] 1.7% ------------------------------------------------------------------------------------------ ??? [52] 100.0% [3] 98570(41.4%) 0(0.0%) run-improve50 ...ock/herbie/src/mainloop.rkt:234:0 for-loop [10] 52.7% get-final-combination [11] 43.1% loop [64] 3.6% setup-prog [15] 0.5% errors [150] 0.1% ------------------------------------------------------------------------------------------ simplify-alt [28] 1.4% loop [117] 14.9% ??? [52] 83.7% [4] 28580(12.0%) 0(0.0%) simplify ...lock/herbie/src/core/simplify.rkt:39:0 iterate-egraph!5 [20] 73.8% loop [24] 14.7% simplify-expr [13] 7.5% for-loop [14] 3.4% mk-egraph [17] 0.6% ------------------------------------------------------------------------------------------ generic-sort/key [78] 4.2% copying-mergesort [90] 95.8% [5] 5676(2.4%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [107] 95.8% errors-score [16] 4.2% ------------------------------------------------------------------------------------------ loop [185] 100.0% [6] 382(0.2%) 110(0.0%) ??? ...ztatlock/herbie/src/core/localize.rkt:43:32 ->flonum [12] 71.2% ------------------------------------------------------------------------------------------ f6 [31] 100.0% [7] 144(0.1%) 0(0.0%) taylor-invert .../herbie/src/core/taylor.rkt:308:0 simplify [174] 100.0% ------------------------------------------------------------------------------------------ profile-thunk16 [1] 100.0% [8] 227014(95.4%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [52] 100.0% ------------------------------------------------------------------------------------------ ??? [2] 100.0% [9] 147744(62.1%) 31864(13.4%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [125] 60.3% bf* [21] 7.6% ??? [22] 6.8% ??? [25] 2.8% ??? [27] 0.5% ...higher-order.rkt:346:33 [26] 0.4% ------------------------------------------------------------------------------------------ run-improve50 [3] 100.0% [10] 51942(21.8%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:245:8 run-iter! [18] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [3] 100.0% [11] 42476(17.8%) 0(0.0%) get-final-combination ...ie/src/mainloop.rkt:260:0 split-table [19] 85.4% extract-alt [23] 14.6% ------------------------------------------------------------------------------------------ ??? [6] 3.3% ??? [107] 4.8% for-loop [158] 5.8% ??? [2] 32.9% loop [117] 53.1% [12] 8192(3.4%) 688(0.3%) ->flonum .../ztatlock/herbie/src/programs.rkt:34:0 ??? [35] 90.4% ------------------------------------------------------------------------------------------ simplify [4] 100.0% [13] 2148(0.9%) 0(0.0%) simplify-expr ...herbie/src/core/simplify.rkt:68:0 iterate-egraph!5 [20] 78.1% loop [24] 21.9% ------------------------------------------------------------------------------------------ simplify [4] 100.0% [14] 982(0.4%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:61:12 iterate-egraph!5 [20] 50.7% loop [24] 49.3% ------------------------------------------------------------------------------------------ run-improve50 [3] 100.0% [15] 524(0.2%) 0(0.0%) setup-prog /home/ztatlock/herbie/src/glue.rkt:45:0 simplify-alt [28] 75.6% ??? [100] 24.4% ------------------------------------------------------------------------------------------ jloop [5] 100.0% [16] 240(0.1%) 0(0.0%) errors-score ...atlock/herbie/src/points.rkt:194:0 loop [30] 50.8% loop [117] 49.2% ------------------------------------------------------------------------------------------ simplify [4] 100.0% [17] 160(0.1%) 0(0.0%) mk-egraph ...lock/herbie/src/core/egraph.rkt:123:0 expr->enode [29] 100.0% ------------------------------------------------------------------------------------------ for-loop [10] 100.0% [18] 51942(21.8%) 0(0.0%) run-iter! ...tatlock/herbie/src/mainloop.rkt:215:0 simplify! [32] 46.3% finalize-iter! [34] 40.2% choose-best-alt! [37] 7.1% localize-error [38] 4.2% gen-series! [39] 2.0% gen-rewrites! [41] 0.2% ------------------------------------------------------------------------------------------ get-final-combination [11] 100.0% [19] 36260(15.2%) 0(0.0%) split-table .../ztatlock/herbie/src/glue.rkt:164:0 f6 [31] 100.0% ------------------------------------------------------------------------------------------ for-loop [14] 2.1% simplify-expr [13] 7.2% simplify [4] 90.6% [20] 23262(9.8%) 350(0.1%) iterate-egraph!5 ...bie/src/core/simplify.rkt:95:0 one-iter [33] 98.5% ------------------------------------------------------------------------------------------ ??? [9] 100.0% [21] 11230(4.7%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [125] 100.0% ------------------------------------------------------------------------------------------ ??? [9] 100.0% [22] 9978(4.2%) 1638(0.7%) ??? ...tatlock/herbie/src/syntax/syntax.rkt:118:17 ??? [35] 83.6% ------------------------------------------------------------------------------------------ get-final-combination [11] 100.0% [23] 6216(2.6%) 0(0.0%) extract-alt ...e/ztatlock/herbie/src/glue.rkt:56:0 loop [117] 68.4% loop [128] 31.6% ------------------------------------------------------------------------------------------ simplify-expr [13] 9.1% for-loop [14] 9.4% simplify [4] 81.5% [24] 5158(2.2%) 0(0.0%) loop ...tatlock/herbie/src/core/simplify.rkt:203:2 pass [36] 100.0% ------------------------------------------------------------------------------------------ ??? [9] 100.0% [25] 4108(1.7%) 4108(1.7%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------ loop [117] 15.6% ??? [9] 84.4% [26] 758(0.3%) 318(0.1%) ...higher-order.rkt:346:33 (unknown source) ??? [145] 58.0% ------------------------------------------------------------------------------------------ ??? [9] 100.0% [27] 700(0.3%) 230(0.1%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ??? [40] 67.1% ------------------------------------------------------------------------------------------ setup-prog [15] 100.0% [28] 396(0.2%) 0(0.0%) simplify-alt .../ztatlock/herbie/src/glue.rkt:83:0 simplify [4] 100.0% ------------------------------------------------------------------------------------------ mk-egraph [17] 16.7% expr->enode [29] 83.3% [29] 160(0.1%) 0(0.0%) expr->enode ...ck/herbie/src/core/egraph.rkt:124:2 expr->enode [29] 83.3% curried [135] 16.7% ------------------------------------------------------------------------------------------ errors-score [16] 100.0% [30] 122(0.1%) 122(0.1%) loop ...hare/racket/collects/racket/list.rkt:551:2 ------------------------------------------------------------------------------------------ simplify [174] 0.4% approximate9 [123] 0.5% eval-prog [159] 3.1% hash-ref! [165] 3.7% f6 [31] 8.1% split-table [19] 84.3% [31] 41102(17.3%) 428(0.2%) f6 ...et/collects/racket/match/compiler.rkt:507:40 option-on-expr [42] 46.4% loop [117] 37.2% f6 [31] 8.1% map [99] 3.4% ??? [115] 2.7% exprs-to-branch-on [49] 0.7% taylor-quotient [51] 0.3% taylor [48] 0.2% taylor-invert [7] 0.1% variable? [93] 0.1% ------------------------------------------------------------------------------------------ run-iter! [18] 100.0% [32] 24036(10.1%) 0(0.0%) simplify! ...tatlock/herbie/src/mainloop.rkt:155:0 for-loop [43] 100.0% ------------------------------------------------------------------------------------------ iterate-egraph!5 [20] 100.0% [33] 22912(9.6%) 1276(0.5%) one-iter ...ock/herbie/src/core/simplify.rkt:106:0 for-loop [44] 81.8% loop [46] 9.0% apply-match [55] 3.6% ------------------------------------------------------------------------------------------ run-iter! [18] 100.0% [34] 20870(8.8%) 0(0.0%) finalize-iter! ...ck/herbie/src/mainloop.rkt:169:0 ??? [100] 100.0% ------------------------------------------------------------------------------------------ errors [150] 1.6% ulp-difference [168] 3.9% ->flonum [12] 44.5% ??? [22] 50.1% [35] 16662(7.0%) 7510(3.2%) ??? /home/ztatlock/herbie/src/config.rkt:48:0 ??? [142] 30.0% return/no-unsupplied [184] 23.5% ------------------------------------------------------------------------------------------ loop [24] 100.0% [36] 5158(2.2%) 0(0.0%) pass ...tatlock/herbie/src/core/simplify.rkt:193:2 for-loop [45] 100.0% ------------------------------------------------------------------------------------------ run-iter! [18] 100.0% [37] 3682(1.5%) 0(0.0%) choose-best-alt! .../herbie/src/mainloop.rkt:115:0 ??? [100] 100.0% ------------------------------------------------------------------------------------------ run-iter! [18] 100.0% [38] 2190(0.9%) 0(0.0%) localize-error ...erbie/src/core/localize.rkt:47:0 hash-ref! [165] 89.0% ??? [65] 11.0% ------------------------------------------------------------------------------------------ run-iter! [18] 100.0% [39] 1038(0.4%) 0(0.0%) gen-series! ...tlock/herbie/src/mainloop.rkt:129:0 for-loop [47] 100.0% ------------------------------------------------------------------------------------------ ??? [27] 100.0% [40] 470(0.2%) 470(0.2%) ??? ...lects/racket/contract/private/orc.rkt:83:14 ------------------------------------------------------------------------------------------ run-iter! [18] 100.0% [41] 126(0.1%) 0(0.0%) gen-rewrites! ...ock/herbie/src/mainloop.rkt:142:0 for-loop [50] 100.0% ------------------------------------------------------------------------------------------ loop [117] 44.3% f6 [31] 55.7% [42] 35986(15.1%) 0(0.0%) option-on-expr ...erbie/src/core/regimes.rkt:115:0 sort-context-on-expr [53] 45.9% loop [117] 41.4% errors [150] 6.9% pick-errors [56] 3.2% err-lsts->split-indices [58] 2.7% ------------------------------------------------------------------------------------------ simplify! [32] 100.0% [43] 24036(10.1%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:159:6 ??? [52] 99.6% debug-print [63] 0.4% ------------------------------------------------------------------------------------------ for-loop [44] 48.8% one-iter [33] 51.2% [44] 18732(7.9%) 4792(2.0%) for-loop ...ck/herbie/src/core/simplify.rkt:116:12 for-loop [44] 48.8% match-e [66] 37.2% ------------------------------------------------------------------------------------------ pass [36] 100.0% [45] 5158(2.2%) 252(0.1%) for-loop ...ck/herbie/src/core/simplify.rkt:196:29 argmin [54] 84.8% loop [59] 5.4% for-loop [61] 4.9% ------------------------------------------------------------------------------------------ one-iter [33] 100.0% [46] 2070(0.9%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:52:19 apply-match [55] 100.0% ------------------------------------------------------------------------------------------ gen-series! [39] 100.0% [47] 1038(0.4%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:135:7 taylor-alt [57] 100.0% ------------------------------------------------------------------------------------------ ??? [129] 29.9% hash-ref! [165] 31.0% f6 [31] 39.1% [48] 394(0.2%) 0(0.0%) taylor ...tatlock/herbie/src/core/taylor.rkt:159:0 loop [117] 100.0% ------------------------------------------------------------------------------------------ f6 [31] 100.0% [49] 274(0.1%) 0(0.0%) exprs-to-branch-on ...ie/src/core/regimes.rkt:44:0 critical-subexpression [60] 100.0% ------------------------------------------------------------------------------------------ gen-rewrites! [41] 100.0% [50] 126(0.1%) 0(0.0%) for-loop ...tatlock/herbie/src/mainloop.rkt:147:11 ??? [62] 100.0% ------------------------------------------------------------------------------------------ f6 [31] 100.0% [51] 112(0.0%) 0(0.0%) taylor-quotient ...erbie/src/core/taylor.rkt:324:0 simplify [174] 100.0% ------------------------------------------------------------------------------------------ for-loop [43] 3.6% run [8] 47.6% [52] 230608(96.9%) 140(0.1%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 47.6% loop [64] 28.6% run-improve50 [3] 20.2% simplify [4] 3.6% ------------------------------------------------------------------------------------------ option-on-expr [42] 100.0% [53] 16502(6.9%) 0(0.0%) sort-context-on-expr ...herbie/src/points.rkt:79:0 ??? [65] 100.0% ------------------------------------------------------------------------------------------ for-loop [45] 100.0% [54] 4372(1.8%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [67] 88.4% expression-cost [72] 11.6% ------------------------------------------------------------------------------------------ one-iter [33] 28.7% loop [46] 71.3% [55] 2904(1.2%) 160(0.1%) apply-match .../herbie/src/core/simplify.rkt:122:2 for-loop [71] 26.0% match-e [66] 21.1% substitute-e [81] 19.4% loop! [130] 17.8% merge-egraph-nodes! [73] 10.1% ------------------------------------------------------------------------------------------ option-on-expr [42] 100.0% [56] 1142(0.5%) 0(0.0%) pick-errors ...k/herbie/src/core/regimes.rkt:187:0 for-loop [68] 100.0% ------------------------------------------------------------------------------------------ for-loop [47] 100.0% [57] 1038(0.4%) 0(0.0%) taylor-alt ...e/ztatlock/herbie/src/glue.rkt:141:0 for-loop [69] 100.0% ------------------------------------------------------------------------------------------ option-on-expr [42] 100.0% [58] 966(0.4%) 96(0.0%) err-lsts->split-indices .../core/regimes.rkt:238:0 add-splitpoint [70] 90.1% ------------------------------------------------------------------------------------------ for-loop [45] 100.0% [59] 280(0.1%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [67] 100.0% ------------------------------------------------------------------------------------------ exprs-to-branch-on [49] 100.0% [60] 274(0.1%) 0(0.0%) critical-subexpression ...rc/core/regimes.rkt:52:0 for-loop [74] 100.0% ------------------------------------------------------------------------------------------ for-loop [45] 100.0% [61] 254(0.1%) 254(0.1%) for-loop ...ck/herbie/src/core/simplify.rkt:183:13 ------------------------------------------------------------------------------------------ for-loop [50] 100.0% [62] 126(0.1%) 0(0.0%) ??? /home/ztatlock/herbie/src/alternative.rkt:88:0 rewriter [75] 100.0% ------------------------------------------------------------------------------------------ for-loop [43] 100.0% [63] 104(0.0%) 0(0.0%) debug-print ...ztatlock/herbie/src/debug.rkt:107:0 for-loop [76] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [3] 2.6% ??? [52] 97.4% [64] 135402(56.9%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:159:2 make-exacts* [88] 54.1% loop [77] 44.4% loop [89] 1.0% for-loop [83] 0.3% filter-points [85] 0.1% ------------------------------------------------------------------------------------------ localize-error [38] 1.4% sort-context-on-expr [53] 98.6% [65] 16742(7.0%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [78] 86.5% loop [101] 13.5% ------------------------------------------------------------------------------------------ apply-match [55] 2.9% for-loop [91] 15.4% for-loop [44] 81.6% [66] 14552(6.1%) 7940(3.3%) match-e ...tatlock/herbie/src/core/ematch.rkt:46:0 for-loop [79] 24.3% for-loop [91] 11.9% ??? [100] 5.3% variable? [93] 2.9% list-cartesian-product [92] 2.4% custom-in-set [111] 2.4% loop [117] 1.1% ------------------------------------------------------------------------------------------ loop [59] 6.8% argmin [54] 93.2% [67] 4144(1.7%) 152(0.1%) for-loop ...ztatlock/herbie/src/programs.rkt:197:2 location-do [119] 72.3% ...erbie/src/common.rkt:46:2 [122] 20.9% ??? [124] 3.0% ------------------------------------------------------------------------------------------ pick-errors [56] 100.0% [68] 1142(0.5%) 166(0.1%) for-loop ...lock/herbie/src/core/regimes.rkt:190:4 eval-prog [159] 85.5% ------------------------------------------------------------------------------------------ taylor-alt [57] 100.0% [69] 1038(0.4%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:143:2 ??? [115] 100.0% ------------------------------------------------------------------------------------------ err-lsts->split-indices [58] 100.0% [70] 870(0.4%) 0(0.0%) add-splitpoint ...erbie/src/core/regimes.rkt:251:2 for-loop [80] 100.0% ------------------------------------------------------------------------------------------ apply-match [55] 100.0% [71] 756(0.3%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:136:10 loop! [130] 65.3% substitute-e [81] 34.7% ------------------------------------------------------------------------------------------ argmin [54] 100.0% [72] 508(0.2%) 0(0.0%) expression-cost ...k/herbie/src/programs.rkt:196:0 compile [82] 100.0% ------------------------------------------------------------------------------------------ apply-match [55] 100.0% [73] 294(0.1%) 0(0.0%) merge-egraph-nodes! ...e/src/core/egraph.rkt:152:0 update-leader! [84] 100.0% ------------------------------------------------------------------------------------------ critical-subexpression [60] 100.0% [74] 274(0.1%) 0(0.0%) for-loop ...lock/herbie/src/core/regimes.rkt:87:19 eval-prog [159] 100.0% ------------------------------------------------------------------------------------------ matcher [98] 50.0% ??? [62] 50.0% [75] 126(0.1%) 0(0.0%) rewriter ...lock/herbie/src/core/matcher.rkt:127:2 for-loop [87] 50.0% *rules* [86] 50.0% ------------------------------------------------------------------------------------------ debug-print [63] 100.0% [76] 104(0.0%) 104(0.0%) for-loop /home/ztatlock/herbie/src/debug.rkt:113:2 ------------------------------------------------------------------------------------------ loop [64] 100.0% [77] 60144(25.3%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:119:2 loop [89] 57.3% make-exacts* [88] 36.0% eval-prog [159] 6.7% ------------------------------------------------------------------------------------------ ??? [65] 100.0% [78] 14474(6.1%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [90] 83.2% loop [101] 15.1% jloop [5] 1.7% ------------------------------------------------------------------------------------------ match-e [66] 100.0% [79] 4618(1.9%) 1274(0.5%) for-loop ...tlock/herbie/src/core/ematch.rkt:59:11 for-loop [91] 46.0% list-cartesian-product [92] 20.5% filter [188] 3.0% loop [117] 2.9% ------------------------------------------------------------------------------------------ add-splitpoint [70] 100.0% [80] 870(0.4%) 0(0.0%) for-loop ...lock/herbie/src/core/regimes.rkt:253:4 for-loop [94] 100.0% ------------------------------------------------------------------------------------------ for-loop [71] 21.5% substitute-e [81] 31.4% apply-match [55] 47.1% [81] 826(0.3%) 258(0.1%) substitute-e ...ck/herbie/src/core/ematch.rkt:71:0 mk-enode! [96] 33.7% substitute-e [81] 31.4% variable? [93] 6.6% ??? [100] 5.1% ------------------------------------------------------------------------------------------ expression-cost [72] 100.0% [82] 508(0.2%) 150(0.1%) compile .../ztatlock/herbie/src/programs.rkt:173:0 hash-ref! [165] 70.5% ------------------------------------------------------------------------------------------ loop [64] 100.0% [83] 416(0.2%) 0(0.0%) for-loop .../ztatlock/herbie/src/points.rkt:166:24 for-loop [95] 100.0% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [73] 100.0% [84] 294(0.1%) 294(0.1%) update-leader! ...herbie/src/core/egraph.rkt:217:0 ------------------------------------------------------------------------------------------ loop [64] 100.0% [85] 174(0.1%) 0(0.0%) filter-points ...tlock/herbie/src/points.rkt:127:0 for-loop [97] 100.0% ------------------------------------------------------------------------------------------ rewriter [75] 100.0% [86] 126(0.1%) 126(0.1%) *rules* ...tlock/herbie/src/syntax/rules.rkt:411:0 ------------------------------------------------------------------------------------------ rewriter [75] 100.0% [87] 126(0.1%) 0(0.0%) for-loop ...ock/herbie/src/core/matcher.rkt:130:10 matcher [98] 100.0% ------------------------------------------------------------------------------------------ loop [77] 22.8% loop [64] 77.2% [88] 94922(39.9%) 0(0.0%) make-exacts* ...atlock/herbie/src/points.rkt:106:0 map [99] 52.4% loop [117] 42.4% eval-prog [159] 5.2% ------------------------------------------------------------------------------------------ loop [64] 3.9% loop [77] 96.1% [89] 35840(15.1%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:109:4 map [99] 100.0% ------------------------------------------------------------------------------------------ generic-sort/key [78] 47.7% copying-mergesort [90] 52.3% [90] 12044(5.1%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [90] 52.3% loop [101] 36.4% jloop [5] 11.3% ------------------------------------------------------------------------------------------ for-loop [79] 41.2% match-e [66] 58.8% [91] 4668(2.0%) 258(0.1%) for-loop ...tlock/herbie/src/core/ematch.rkt:65:37 match-e [66] 87.2% ??? [102] 7.3% ------------------------------------------------------------------------------------------ match-e [66] 17.3% list-cartesian-product [92] 26.5% for-loop [79] 56.3% [92] 1368(0.6%) 1102(0.5%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [92] 26.5% for-loop [104] 19.4% ------------------------------------------------------------------------------------------ f6 [31] 10.8% substitute-e [81] 13.2% match-e [66] 76.1% [93] 1246(0.5%) 0(0.0%) variable? ...ck/herbie/src/syntax/syntax.rkt:529:0 ??? [100] 100.0% ------------------------------------------------------------------------------------------ for-loop [80] 100.0% [94] 870(0.4%) 870(0.4%) for-loop ...lock/herbie/src/core/regimes.rkt:257:8 ------------------------------------------------------------------------------------------ for-loop [83] 100.0% [95] 416(0.2%) 0(0.0%) for-loop .../ztatlock/herbie/src/points.rkt:167:26 ??? [103] 100.0% ------------------------------------------------------------------------------------------ substitute-e [81] 100.0% [96] 278(0.1%) 0(0.0%) mk-enode! ...lock/herbie/src/core/egraph.rkt:101:0 hash-has-key? [109] 100.0% ------------------------------------------------------------------------------------------ filter-points [85] 100.0% [97] 174(0.1%) 0(0.0%) for-loop ...e/ztatlock/herbie/src/points.rkt:130:4 andmap [105] 100.0% ------------------------------------------------------------------------------------------ matcher [98] 50.0% for-loop [87] 50.0% [98] 126(0.1%) 0(0.0%) matcher ...tlock/herbie/src/core/matcher.rkt:163:2 matcher [98] 50.0% rewriter [75] 50.0% ------------------------------------------------------------------------------------------ f6 [31] 1.7% loop [89] 41.2% make-exacts* [88] 57.1% [99] 87028(36.6%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [117] 98.5% ??? [129] 1.0% loop [185] 0.4% ??? [2] 0.2% ------------------------------------------------------------------------------------------ substitute-e [81] 0.4% setup-prog [15] 0.5% variable? [93] 4.4% match-e [66] 4.6% ??? [153] 4.7% choose-best-alt! [37] 13.0% finalize-iter! [34] 72.3% [100] 28300(11.9%) 1780(0.7%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [106] 68.5% ??? [108] 13.0% hash-has-key? [109] 7.9% atab-add-altns [110] 3.9% ------------------------------------------------------------------------------------------ generic-sort/key [78] 19.8% ??? [65] 20.5% copying-mergesort [90] 59.7% [101] 11066(4.6%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [107] 100.0% ------------------------------------------------------------------------------------------ for-loop [91] 100.0% [102] 422(0.2%) 120(0.1%) ??? /home/ztatlock/herbie/src/core/ematch.rkt:50:5 for-loop [112] 38.4% custom-in-set [111] 33.2% ------------------------------------------------------------------------------------------ for-loop [95] 100.0% [103] 416(0.2%) 278(0.1%) ??? /home/ztatlock/herbie/src/points.rkt:156:9 random-exp [113] 33.2% ------------------------------------------------------------------------------------------ list-cartesian-product [92] 100.0% [104] 266(0.1%) 266(0.1%) for-loop ...atlock/herbie/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------------------ for-loop [97] 100.0% [105] 174(0.1%) 174(0.1%) andmap ...et/collects/racket/private/map.rkt:74:13 ------------------------------------------------------------------------------------------ ??? [100] 100.0% [106] 19776(8.3%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:51:2 atab-add-altn [114] 100.0% ------------------------------------------------------------------------------------------ jloop [5] 32.9% loop [101] 67.1% [107] 16502(6.9%) 516(0.2%) ??? /home/ztatlock/herbie/src/points.rkt:81:27 eval-prog [159] 81.1% ??? [2] 13.4% ->flonum [12] 2.4% ------------------------------------------------------------------------------------------ ??? [100] 100.0% [108] 3682(1.5%) 0(0.0%) ??? ...ztatlock/herbie/src/core/alt-table.rkt:54:0 ??? [115] 100.0% ------------------------------------------------------------------------------------------ mk-enode! [96] 9.5% ??? [100] 90.5% [109] 2920(1.2%) 688(0.3%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [127] 64.3% ??? [116] 12.1% ------------------------------------------------------------------------------------------ ??? [100] 100.0% [110] 1094(0.5%) 0(0.0%) atab-add-altns ...rbie/src/core/alt-table.rkt:50:0 atab-add-altn [114] 100.0% ------------------------------------------------------------------------------------------ ??? [102] 25.0% match-e [66] 75.0% [111] 560(0.2%) 560(0.2%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------------------ ??? [102] 100.0% [112] 162(0.1%) 162(0.1%) for-loop ...atlock/herbie/src/core/ematch.rkt:51:7 ------------------------------------------------------------------------------------------ ??? [103] 100.0% [113] 138(0.1%) 138(0.1%) random-exp ...ztatlock/herbie/src/common.rkt:222:0 ------------------------------------------------------------------------------------------ atab-add-altns [110] 5.2% for-loop [106] 94.8% [114] 20870(8.8%) 0(0.0%) atab-add-altn ...rbie/src/core/alt-table.rkt:208:0 best-and-tied-at-points [118] 79.9% override-at-pnts [120] 19.5% loop [117] 0.5% ------------------------------------------------------------------------------------------ for-loop [158] 1.4% location-do [119] 5.8% for-loop [69] 5.8% ??? [108] 39.5% f6 [31] 47.5% [115] 8976(3.8%) 266(0.1%) ??? ...tract/private/arrow-higher-order.rkt:342:33 best-alt [121] 39.5% location-do [119] 24.7% ??? [153] 19.4% ...erbie/src/common.rkt:46:2 [122] 6.5% approximate9 [123] 5.8% ??? [124] 1.2% ------------------------------------------------------------------------------------------ hash-has-key? [109] 100.0% [116] 354(0.1%) 354(0.1%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------------------ errors-score [16] 0.0% atab-add-altn [114] 0.0% match-e [66] 0.1% loop! [130] 0.1% for-loop [79] 0.2% taylor [48] 0.2% make-exacts* [88] 0.3% parse-loop12 [179] 0.4% map [99] 0.8% extract-alt [23] 0.8% ??? [2] 1.1% option-on-expr [42] 2.6% ??? [171] 5.1% f6 [31] 6.2% loop [117] 82.0% [117] 168118(70.6%) 1752(0.7%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [117] 82.0% option-on-expr [42] 6.2% hash-ref! [165] 5.1% errors [150] 2.6% ->flonum [12] 1.1% ??? [2] 1.0% simplify [4] 0.8% ??? [129] 0.4% simplify [174] 0.2% loop! [130] 0.1% ??? [125] 0.0% foldl [138] 0.0% ??? [126] 0.0% ...higher-order.rkt:346:33 [26] 0.0% curried [135] 0.0% ------------------------------------------------------------------------------------------ atab-add-altn [114] 100.0% [118] 16684(7.0%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [150] 98.4% ------------------------------------------------------------------------------------------ location-do [119] 15.8% ??? [115] 31.9% for-loop [67] 52.3% [119] 5730(2.4%) 942(0.4%) location-do ...acket/private/norm-define.rkt:53:83 ??? [127] 62.6% location-do [119] 15.8% dict? [162] 2.9% ??? [115] 2.3% ------------------------------------------------------------------------------------------ atab-add-altn [114] 100.0% [120] 4072(1.7%) 0(0.0%) override-at-pnts ...e/src/core/alt-table.rkt:145:0 errors [150] 93.9% for-loop [136] 6.1% ------------------------------------------------------------------------------------------ ??? [115] 100.0% [121] 3682(1.5%) 0(0.0%) best-alt /home/ztatlock/herbie/src/glue.rkt:78:0 loop [128] 86.5% argmins [133] 13.5% ------------------------------------------------------------------------------------------ ??? [115] 45.5% for-loop [67] 54.5% [122] 1592(0.7%) 416(0.2%) ...erbie/src/common.rkt:46:2 ...e/arr-i.rkt:906:19 ??? [131] 47.5% ??? [134] 26.4% ------------------------------------------------------------------------------------------ ??? [115] 100.0% [123] 1038(0.4%) 0(0.0%) approximate9 ...ck/herbie/src/core/taylor.rkt:12:0 loop [132] 64.0% f6 [31] 36.0% ------------------------------------------------------------------------------------------ ??? [115] 46.2% for-loop [67] 53.8% [124] 234(0.1%) 126(0.1%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 get/build-late-neg-projection [137] 46.2% ------------------------------------------------------------------------------------------ loop [117] 1.1% bf* [21] 11.1% ??? [9] 87.8% [125] 101374(42.6%) 76432(32.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [139] 18.1% bfsin [140] 6.5% ------------------------------------------------------------------------------------------ loop [117] 32.5% ??? [2] 67.5% [126] 5518(2.3%) 462(0.2%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [143] 91.6% ------------------------------------------------------------------------------------------ hash-has-key? [109] 34.4% location-do [119] 65.6% [127] 5464(2.3%) 1890(0.8%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [144] 51.1% ??? [154] 12.1% successfully-got-the-right-kind-of-function [186] 2.2% ------------------------------------------------------------------------------------------ extract-alt [23] 38.2% best-alt [121] 61.8% [128] 5148(2.2%) 0(0.0%) loop /home/ztatlock/herbie/src/common.rkt:135:2 composed [141] 100.0% ------------------------------------------------------------------------------------------ map [99] 14.6% loop [117] 85.4% [129] 1958(0.8%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [165] 94.0% taylor [48] 6.0% ------------------------------------------------------------------------------------------ loop [117] 18.7% for-loop [71] 37.6% apply-match [55] 43.7% [130] 1012(0.4%) 0(0.0%) loop! .../ztatlock/herbie/src/core/enode.rkt:163:2 custom-set-union [146] 55.3% loop [117] 33.5% update-en-expr [147] 5.7% set [148] 5.4% ------------------------------------------------------------------------------------------ ...erbie/src/common.rkt:46:2 [122] 100.0% [131] 756(0.3%) 288(0.1%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [142] 34.1% return/no-unsupplied [184] 27.8% ------------------------------------------------------------------------------------------ approximate9 [123] 100.0% [132] 664(0.3%) 0(0.0%) loop ...e/ztatlock/herbie/src/core/taylor.rkt:83:4 hash-ref! [165] 100.0% ------------------------------------------------------------------------------------------ best-alt [121] 100.0% [133] 498(0.2%) 0(0.0%) argmins /home/ztatlock/herbie/src/common.rkt:134:0 composed [141] 100.0% ------------------------------------------------------------------------------------------ for-loop [156] 16.2% ...erbie/src/common.rkt:46:2 [122] 83.8% [134] 420(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [145] 83.8% ??? [153] 16.2% ------------------------------------------------------------------------------------------ loop [117] 40.7% expr->enode [29] 59.3% [135] 270(0.1%) 270(0.1%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------------------------ override-at-pnts [120] 100.0% [136] 248(0.1%) 248(0.1%) for-loop ...k/herbie/src/core/alt-table.rkt:146:43 ------------------------------------------------------------------------------------------ ??? [124] 100.0% [137] 108(0.0%) 108(0.0%) get/build-late-neg-projection ...te/guts.rkt:691:0 ------------------------------------------------------------------------------------------ loop [117] 100.0% [138] 100(0.0%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [149] 100.0% ------------------------------------------------------------------------------------------ ??? [125] 100.0% [139] 18318(7.7%) 12774(5.4%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [151] 30.3% ------------------------------------------------------------------------------------------ ??? [125] 100.0% [140] 6624(2.8%) 4178(1.8%) bfsin ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [151] 36.9% ------------------------------------------------------------------------------------------ argmins [133] 8.8% loop [128] 91.2% [141] 5646(2.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [150] 100.0% ------------------------------------------------------------------------------------------ ??? [131] 4.9% ??? [35] 95.1% [142] 5262(2.2%) 1724(0.7%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [152] 63.2% ??? [153] 4.0% ------------------------------------------------------------------------------------------ ??? [126] 100.0% [143] 5056(2.1%) 4136(1.7%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [151] 18.2% ------------------------------------------------------------------------------------------ ??? [127] 100.0% [144] 2794(1.2%) 1998(0.8%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [154] 18.7% arrow-higher-order:lnp [187] 5.2% for-loop [157] 4.6% ------------------------------------------------------------------------------------------ ??? [134] 48.8% ...higher-order.rkt:346:33 [26] 51.2% [145] 860(0.4%) 522(0.2%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [153] 23.5% for-loop [156] 15.8% ------------------------------------------------------------------------------------------ loop! [130] 100.0% [146] 636(0.3%) 128(0.1%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [155] 79.9% ------------------------------------------------------------------------------------------ loop! [130] 100.0% [147] 116(0.0%) 116(0.0%) update-en-expr ...herbie/src/core/egraph.rkt:211:0 ------------------------------------------------------------------------------------------ loop! [130] 100.0% [148] 110(0.0%) 110(0.0%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------------------ foldl [138] 100.0% [149] 100(0.0%) 100(0.0%) merge2 ...ztatlock/herbie/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------------------ run-improve50 [3] 0.3% option-on-expr [42] 5.7% override-at-pnts [120] 8.8% composed [141] 13.0% loop [117] 34.1% best-and-tied-at-points [118] 37.8% [150] 43448(18.3%) 0(0.0%) errors /home/ztatlock/herbie/src/points.rkt:184:0 for-loop [158] 85.4% eval-prog [159] 14.0% ??? [35] 0.6% ------------------------------------------------------------------------------------------ real->bigfloat [143] 10.2% bfsin [140] 27.2% bfmul [139] 61.6% [151] 9006(3.8%) 9006(3.8%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------------------ ??? [142] 100.0% [152] 3326(1.4%) 3098(1.3%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [163] 6.9% ------------------------------------------------------------------------------------------ ??? [134] 5.9% ??? [145] 8.8% ??? [142] 9.2% ??? [115] 76.0% [153] 2294(1.0%) 302(0.1%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [100] 76.0% contract? [164] 5.9% dict? [162] 4.9% ------------------------------------------------------------------------------------------ for-loop [144] 44.2% ??? [127] 55.8% [154] 1182(0.5%) 526(0.2%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [160] 55.5% ------------------------------------------------------------------------------------------ custom-set-union [146] 100.0% [155] 508(0.2%) 118(0.0%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [161] 76.8% ------------------------------------------------------------------------------------------ ??? [145] 100.0% [156] 136(0.1%) 0(0.0%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [134] 100.0% ------------------------------------------------------------------------------------------ for-loop [144] 100.0% [157] 128(0.1%) 128(0.1%) for-loop ...racket/contract/private/hash.rkt:239:6 ------------------------------------------------------------------------------------------ errors [150] 100.0% [158] 37110(15.6%) 256(0.1%) for-loop ...e/ztatlock/herbie/src/points.rkt:187:4 ??? [2] 95.6% ulp-difference [168] 1.7% ->flonum [12] 1.3% ??? [115] 0.4% ------------------------------------------------------------------------------------------ for-loop [74] 0.9% for-loop [68] 3.3% loop [77] 13.7% make-exacts* [88] 16.6% errors [150] 20.5% ??? [107] 45.1% [159] 29662(12.5%) 12260(5.2%) eval-prog ...tatlock/herbie/src/programs.rkt:146:0 hash-ref! [165] 30.6% f6 [31] 16.3% ??? [166] 4.5% go [167] 2.6% ??? [169] 1.9% new-lambda [170] 1.0% ------------------------------------------------------------------------------------------ ??? [154] 100.0% [160] 656(0.3%) 656(0.3%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------------------ for-loop [155] 100.0% [161] 390(0.2%) 390(0.2%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------------------ ??? [153] 40.6% location-do [119] 59.4% [162] 276(0.1%) 276(0.1%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------------------ ??? [152] 100.0% [163] 228(0.1%) 228(0.1%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------------------ ??? [153] 100.0% [164] 136(0.1%) 136(0.1%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------------------ simplify* [183] 1.0% compile [82] 1.4% ??? [171] 1.5% loop [132] 3.1% localize-error [38] 3.8% ??? [129] 12.2% eval-prog [159] 19.1% loop [117] 55.5% [165] 12174(5.1%) 2070(0.9%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [171] 57.1% bigfloat-hash [172] 16.3% parse-loop12 [179] 13.6% f6 [31] 3.4% simplify [174] 0.9% taylor [48] 0.5% ------------------------------------------------------------------------------------------ eval-prog [159] 100.0% [166] 1336(0.6%) 338(0.1%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack242 [173] 74.7% ------------------------------------------------------------------------------------------ eval-prog [159] 100.0% [167] 782(0.3%) 430(0.2%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [176] 45.0% ------------------------------------------------------------------------------------------ for-loop [158] 100.0% [168] 646(0.3%) 0(0.0%) ulp-difference ...atlock/herbie/src/float.rkt:19:0 ??? [35] 100.0% ------------------------------------------------------------------------------------------ eval-prog [159] 100.0% [169] 550(0.2%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [175] 100.0% ------------------------------------------------------------------------------------------ eval-prog [159] 100.0% [170] 294(0.1%) 152(0.1%) new-lambda ...ollects/racket/private/kw.rkt:679:11 loop [177] 48.3% ------------------------------------------------------------------------------------------ hash-ref! [165] 100.0% [171] 8794(3.7%) 0(0.0%) ??? /home/ztatlock/herbie/src/programs.rkt:181:5 loop [117] 97.1% hash-ref! [165] 2.9% ------------------------------------------------------------------------------------------ hash-ref! [165] 100.0% [172] 7614(3.2%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [178] 83.6% sig+exp->bigfloat [180] 16.4% ------------------------------------------------------------------------------------------ ??? [166] 100.0% [173] 998(0.4%) 150(0.1%) unpack242 ...private/arrow-higher-order.rkt:354:44 maybe-cons-kwd [181] 85.0% ------------------------------------------------------------------------------------------ taylor-quotient [51] 12.3% taylor-invert [7] 15.8% hash-ref! [165] 28.9% loop [117] 43.1% [174] 914(0.4%) 0(0.0%) simplify ...atlock/herbie/src/core/reduce.rkt:15:0 parse-loop12 [179] 40.9% debug7 [182] 30.2% f6 [31] 16.0% simplify* [183] 12.9% ------------------------------------------------------------------------------------------ ??? [169] 100.0% [175] 550(0.2%) 550(0.2%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------------------------ loop [176] 32.2% go [167] 67.8% [176] 352(0.1%) 352(0.1%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [176] 32.2% ------------------------------------------------------------------------------------------ new-lambda [170] 100.0% [177] 142(0.1%) 142(0.1%) loop .../collects/racket/private/stxcase.rkt:112:7 ------------------------------------------------------------------------------------------ bigfloat-hash [172] 100.0% [178] 6368(2.7%) 6368(2.7%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ------------------------------------------------------------------------------------------ simplify [174] 16.1% hash-ref! [165] 83.9% [179] 2324(1.0%) 374(0.2%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [117] 83.2% loop [185] 0.7% ------------------------------------------------------------------------------------------ bigfloat-hash [172] 100.0% [180] 1246(0.5%) 1246(0.5%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ------------------------------------------------------------------------------------------ unpack242 [173] 100.0% [181] 848(0.4%) 292(0.1%) maybe-cons-kwd ...ate/arrow-higher-order.rkt:498:0 successfully-got-the-right-kind-of-function [186] 38.7% arrow-higher-order:lnp [187] 26.9% ------------------------------------------------------------------------------------------ simplify [174] 100.0% [182] 276(0.1%) 122(0.1%) debug7 /home/ztatlock/herbie/src/debug.rkt:102:0 return/no-unsupplied [184] 55.8% ------------------------------------------------------------------------------------------ simplify [174] 100.0% [183] 118(0.0%) 0(0.0%) simplify* ...tlock/herbie/src/core/reduce.rkt:20:0 hash-ref! [165] 100.0% ------------------------------------------------------------------------------------------ debug7 [182] 3.6% ??? [131] 4.9% ??? [35] 91.5% [184] 4272(1.8%) 3276(1.4%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [188] 23.3% ------------------------------------------------------------------------------------------ map [99] 2.0% parse-loop12 [179] 7.6% loop [185] 90.4% [185] 494(0.2%) 112(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [185] 90.4% ??? [6] 2.0% ------------------------------------------------------------------------------------------ ??? [127] 26.8% maybe-cons-kwd [181] 73.2% [186] 448(0.2%) 328(0.1%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [190] 26.8% ------------------------------------------------------------------------------------------ for-loop [144] 39.0% maybe-cons-kwd [181] 61.0% [187] 374(0.2%) 124(0.1%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [189] 66.8% ------------------------------------------------------------------------------------------ for-loop [79] 12.3% return/no-unsupplied [184] 87.7% [188] 1136(0.5%) 1136(0.5%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------------------ arrow-higher-order:lnp [187] 100.0% [189] 250(0.1%) 250(0.1%) ??? ...et/contract/private/arity-checking.rkt:19:2 ------------------------------------------------------------------------------------------ successfully-got-the-right-kind-of-function [186]100.0% [190] 120(0.1%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [191] 100.0% ------------------------------------------------------------------------------------------ arity-checking-wrapper [190] 100.0% [191] 120(0.1%) 120(0.1%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 ------------------------------------------------------------------------------------------