Profiling results ----------------- Total cpu time observed: 364810ms (out of 366044ms) Number of samples taken: 1071 (once every 341ms) (Hiding functions with self<1.0% and local<2.0%: 8 of 204 hidden) ============================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================ ??? [44] 100.0% [1] 321756(88.2%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [14] 100.0% ---------------------------------------------------------------------------- ??? [44] 100.0% [2] 311680(85.4%) 0(0.0%) run-improve50 ...ie/develop/src/mainloop.rkt:234:0 for-loop [15] 99.3% get-final-combination [20] 0.4% loop [49] 0.1% ??? [106] 0.1% ---------------------------------------------------------------------------- table-ref [48] 100.0% [3] 13004(3.6%) 324(0.1%) loop ...herbie/develop/src/core/simplify.rkt:215:2 pass [16] 97.5% ---------------------------------------------------------------------------- substitute-e [75] 13.2% match-e [71] 86.8% [4] 4974(1.4%) 0(0.0%) variable? ...e/develop/src/syntax/syntax.rkt:567:0 ??? [106] 100.0% ---------------------------------------------------------------------------- ??? [152] 100.0% [5] 3108(0.9%) 0(0.0%) approximate9 ...e/develop/src/core/taylor.rkt:12:0 loop [18] 66.7% f176 [145] 22.6% taylor-quotient [23] 10.7% ---------------------------------------------------------------------------- hash-ref! [157] 100.0% [6] 2406(0.7%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:285:26 for-loop [17] 100.0% ---------------------------------------------------------------------------- hash-ref! [157] 100.0% [7] 2048(0.6%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:295:23 for-loop [19] 100.0% ---------------------------------------------------------------------------- hash-ref! [157] 100.0% [8] 1376(0.4%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:322:33 for-loop [21] 100.0% ---------------------------------------------------------------------------- hash-ref! [157] 100.0% [9] 672(0.2%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:392:23 for-loop [22] 100.0% ---------------------------------------------------------------------------- copying-mergesort [195] 100.0% [10] 578(0.2%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [144] 100.0% ---------------------------------------------------------------------------- loop [171] 100.0% [11] 360(0.1%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 map [67] 100.0% ---------------------------------------------------------------------------- f176 [145] 100.0% [12] 356(0.1%) 0(0.0%) taylor ...herbie/develop/src/core/taylor.rkt:163:0 loop [171] 100.0% ---------------------------------------------------------------------------- f176 [145] 100.0% [13] 346(0.1%) 0(0.0%) taylor-invert ...develop/src/core/taylor.rkt:312:0 first-nonzero-exp [28] 100.0% ---------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [14] 321756(88.2%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [44] 100.0% ---------------------------------------------------------------------------- run-improve50 [2] 100.0% [15] 309616(84.9%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:249:10 run-iter! [24] 100.0% ---------------------------------------------------------------------------- loop [3] 100.0% [16] 12680(3.5%) 0(0.0%) pass ...herbie/develop/src/core/simplify.rkt:205:2 for-loop [25] 100.0% ---------------------------------------------------------------------------- ??? [6] 100.0% [17] 2406(0.7%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:285:52 hash-ref! [157] 85.1% ??? [30] 14.9% ---------------------------------------------------------------------------- approximate9 [5] 100.0% [18] 2072(0.6%) 0(0.0%) loop ...es/herbie/develop/src/core/taylor.rkt:86:4 ??? [152] 100.0% ---------------------------------------------------------------------------- ??? [7] 100.0% [19] 2048(0.6%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:298:27 hash-ref! [157] 100.0% ---------------------------------------------------------------------------- run-improve50 [2] 100.0% [20] 1376(0.4%) 0(0.0%) get-final-combination ...op/src/mainloop.rkt:264:0 split-table [27] 100.0% ---------------------------------------------------------------------------- ??? [8] 100.0% [21] 1376(0.4%) 354(0.1%) for-loop ...bie/develop/src/core/taylor.rkt:324:46 simplify [26] 74.3% ---------------------------------------------------------------------------- ??? [9] 100.0% [22] 672(0.2%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:396:33 for-loop [29] 100.0% ---------------------------------------------------------------------------- approximate9 [5] 100.0% [23] 334(0.1%) 0(0.0%) taylor-quotient ...velop/src/core/taylor.rkt:328:0 first-nonzero-exp [28] 100.0% ---------------------------------------------------------------------------- for-loop [15] 100.0% [24] 309616(84.9%) 0(0.0%) run-iter! ...herbie/develop/src/mainloop.rkt:215:0 simplify! [31] 94.6% finalize-iter! [32] 3.9% gen-series! [34] 1.1% gen-rewrites! [37] 0.2% localize-error [38] 0.1% ---------------------------------------------------------------------------- pass [16] 100.0% [25] 12680(3.5%) 346(0.1%) for-loop ...e/develop/src/core/simplify.rkt:208:29 argmin [33] 70.8% loop [35] 18.2% for-loop [36] 8.3% ---------------------------------------------------------------------------- first-nonzero-exp [28] 12.6% ??? [152] 12.9% for-loop [21] 37.1% hash-ref! [157] 37.4% [26] 2754(0.8%) 0(0.0%) simplify ...erbie/develop/src/core/reduce.rkt:16:0 f176 [145] 49.7% parse-loop79 [168] 37.4% debug-print [63] 12.9% ---------------------------------------------------------------------------- get-final-combination [20] 100.0% [27] 1376(0.4%) 0(0.0%) split-table ...s/herbie/develop/src/glue.rkt:162:0 f176 [145] 100.0% ---------------------------------------------------------------------------- taylor-quotient [23] 49.1% taylor-invert [13] 50.9% [28] 680(0.2%) 0(0.0%) first-nonzero-exp ...lop/src/core/taylor.rkt:260:0 simplify [26] 50.9% hash-ref! [157] 49.1% ---------------------------------------------------------------------------- for-loop [22] 100.0% [29] 672(0.2%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:398:39 hash-ref! [157] 100.0% ---------------------------------------------------------------------------- for-loop [17] 100.0% [30] 358(0.1%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:288:19 hash-ref! [157] 100.0% ---------------------------------------------------------------------------- run-iter! [24] 100.0% [31] 292776(80.3%) 0(0.0%) simplify! ...herbie/develop/src/mainloop.rkt:155:0 for-loop [39] 100.0% ---------------------------------------------------------------------------- run-iter! [24] 100.0% [32] 11974(3.3%) 0(0.0%) finalize-iter! ...e/develop/src/mainloop.rkt:169:0 ??? [106] 100.0% ---------------------------------------------------------------------------- for-loop [25] 100.0% [33] 8974(2.5%) 362(0.1%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [40] 76.4% expression-cost [42] 19.5% ---------------------------------------------------------------------------- run-iter! [24] 100.0% [34] 3464(0.9%) 0(0.0%) gen-series! ...rbie/develop/src/mainloop.rkt:129:0 for-loop [41] 100.0% ---------------------------------------------------------------------------- for-loop [25] 100.0% [35] 2310(0.6%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [40] 100.0% ---------------------------------------------------------------------------- for-loop [25] 100.0% [36] 1050(0.3%) 1050(0.3%) for-loop ...e/develop/src/core/simplify.rkt:195:13 ---------------------------------------------------------------------------- run-iter! [24] 100.0% [37] 684(0.2%) 0(0.0%) gen-rewrites! ...ie/develop/src/mainloop.rkt:142:0 for-loop [43] 100.0% ---------------------------------------------------------------------------- run-iter! [24] 100.0% [38] 360(0.1%) 0(0.0%) localize-error ...velop/src/core/localize.rkt:47:0 hash-ref! [157] 100.0% ---------------------------------------------------------------------------- simplify! [31] 99.5% [39] 294388(80.7%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:159:6 ??? [44] 100.0% ---------------------------------------------------------------------------- loop [35] 25.2% argmin [33] 74.8% [40] 9170(2.5%) 0(0.0%) for-loop .../herbie/develop/src/programs.rkt:199:2 table-ref [48] 68.9% ...velop/src/common.rkt:47:2 [109] 31.1% ---------------------------------------------------------------------------- gen-series! [34] 100.0% [41] 3464(0.9%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:135:7 taylor-alt [45] 100.0% ---------------------------------------------------------------------------- argmin [33] 100.0% [42] 1752(0.5%) 0(0.0%) expression-cost .../develop/src/programs.rkt:198:0 compile [46] 100.0% ---------------------------------------------------------------------------- gen-rewrites! [37] 100.0% [43] 684(0.2%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:147:11 ??? [47] 100.0% ---------------------------------------------------------------------------- for-loop [39] 27.5% run [14] 31.1% [44] 360964(98.9%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 table-ref [48] 37.9% profile-thunk16 [1] 31.1% run-improve50 [2] 29.7% loop [49] 1.4% ---------------------------------------------------------------------------- for-loop [41] 100.0% [45] 3464(0.9%) 0(0.0%) taylor-alt ...es/herbie/develop/src/glue.rkt:134:0 for-loop [50] 100.0% ---------------------------------------------------------------------------- expression-cost [42] 100.0% [46] 1752(0.5%) 328(0.1%) compile ...s/herbie/develop/src/programs.rkt:175:0 hash-ref! [157] 81.3% ---------------------------------------------------------------------------- for-loop [43] 100.0% [47] 684(0.2%) 0(0.0%) ??? ...ies/herbie/develop/src/alternative.rkt:88:0 rewriter [51] 100.0% ---------------------------------------------------------------------------- for-loop [40] 0.6% ??? [152] 1.3% get-sigs [102] 1.4% table-ref [48] 12.5% for-loop [53] 36.0% ??? [44] 47.7% [48] 341128(93.5%) 5148(1.4%) table-ref .../racket/private/norm-define.rkt:53:83 iterate-egraph!13 [52] 46.4% for-loop [53] 36.0% table-ref [48] 12.5% loop [3] 1.6% ??? [120] 1.4% ??? [152] 0.7% ??? [123] 0.3% return/no-unsupplied [180] 0.2% mk-egraph [55] 0.1% ??? [57] 0.1% ---------------------------------------------------------------------------- run-improve50 [2] 3.5% ??? [44] 96.5% [49] 10444(2.9%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:193:2 make-exacts* [59] 57.2% loop [54] 42.8% ---------------------------------------------------------------------------- taylor-alt [45] 100.0% [50] 3464(0.9%) 0(0.0%) for-loop ...lies/herbie/develop/src/glue.rkt:139:6 ??? [152] 100.0% ---------------------------------------------------------------------------- matcher [64] 31.8% ??? [47] 68.2% [51] 684(0.2%) 326(0.1%) rewriter ...bie/develop/src/core/matcher.rkt:131:2 f176 [145] 52.3% for-loop [56] 31.8% ---------------------------------------------------------------------------- table-ref [48] 100.0% [52] 321540(88.1%) 334(0.1%) iterate-egraph!13 ...p/src/core/simplify.rkt:102:0 one-iter [58] 98.8% map-enodes [60] 1.0% debug-print [63] 0.1% ---------------------------------------------------------------------------- table-ref [48] 100.0% [53] 251418(68.9%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:63:12 table-ref [48] 100.0% ---------------------------------------------------------------------------- loop [49] 100.0% [54] 4468(1.2%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:151:2 loop [61] 47.0% make-exacts* [59] 34.3% eval-prog [141] 18.8% ---------------------------------------------------------------------------- table-ref [48] 100.0% [55] 952(0.3%) 0(0.0%) mk-egraph ...bie/develop/src/core/egraph.rkt:123:0 expr->enode [62] 100.0% ---------------------------------------------------------------------------- rewriter [51] 100.0% [56] 326(0.1%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:134:10 matcher [64] 100.0% ---------------------------------------------------------------------------- table-ref [48] 100.0% [57] 300(0.1%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:60:15 ??? [173] 100.0% ---------------------------------------------------------------------------- iterate-egraph!13 [52] 100.0% [58] 317638(87.1%) 1362(0.4%) one-iter ...ie/develop/src/core/simplify.rkt:113:0 loop [65] 80.1% for-loop [66] 15.9% apply-match [69] 3.5% filter [188] 0.1% ---------------------------------------------------------------------------- loop [54] 20.4% loop [49] 79.6% [59] 7508(2.1%) 0(0.0%) make-exacts* ...erbie/develop/src/points.rkt:138:0 map [67] 63.1% loop [171] 36.9% ---------------------------------------------------------------------------- iterate-egraph!13 [52] 100.0% [60] 3262(0.9%) 0(0.0%) map-enodes ...ie/develop/src/core/egraph.rkt:139:0 loop [171] 100.0% ---------------------------------------------------------------------------- loop [54] 100.0% [61] 2098(0.6%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:141:4 map [67] 100.0% ---------------------------------------------------------------------------- mk-egraph [55] 30.6% expr->enode [62] 69.4% [62] 952(0.3%) 0(0.0%) expr->enode ...e/develop/src/core/egraph.rkt:124:2 expr->enode [62] 69.4% mk-enode! [79] 30.6% ---------------------------------------------------------------------------- iterate-egraph!13 [52] 46.2% simplify [26] 53.8% [63] 662(0.2%) 306(0.1%) debug-print .../herbie/develop/src/debug.rkt:107:0 for-loop [68] 53.8% ---------------------------------------------------------------------------- matcher [64] 50.0% for-loop [56] 50.0% [64] 326(0.1%) 0(0.0%) matcher ...rbie/develop/src/core/matcher.rkt:167:2 matcher [64] 50.0% rewriter [51] 50.0% ---------------------------------------------------------------------------- one-iter [58] 100.0% [65] 254444(69.7%) 726(0.2%) loop ...cket/collects/racket/private/map.rkt:52:19 apply-match [69] 99.7% ---------------------------------------------------------------------------- for-loop [66] 48.4% one-iter [58] 51.6% [66] 50504(13.8%) 11032(3.0%) for-loop ...e/develop/src/core/simplify.rkt:123:12 for-loop [66] 48.4% match-e [71] 38.8% ??? [90] 0.3% ---------------------------------------------------------------------------- ??? [11] 4.6% f176 [145] 8.9% loop [61] 26.6% make-exacts* [59] 60.0% [67] 7898(2.2%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [171] 86.6% f176 [145] 8.9% ??? [152] 4.6% ---------------------------------------------------------------------------- debug-print [63] 100.0% [68] 356(0.1%) 356(0.1%) for-loop ...ies/herbie/develop/src/debug.rkt:113:2 ---------------------------------------------------------------------------- one-iter [58] 4.1% loop [65] 95.9% [69] 264700(72.6%) 1384(0.4%) apply-match ...develop/src/core/simplify.rkt:130:2 for-loop [70] 76.6% update-leader! [78] 15.4% match-e [71] 7.1% reduce-to-single! [72] 0.4% ---------------------------------------------------------------------------- apply-match [69] 100.0% [70] 202724(55.6%) 358(0.1%) for-loop ...e/develop/src/core/simplify.rkt:145:10 merge-egraph-nodes! [73] 55.3% mk-enode! [79] 17.4% loop! [89] 14.6% substitute-e [75] 11.0% list-member? [76] 1.5% ---------------------------------------------------------------------------- apply-match [69] 20.3% for-loop [80] 27.3% for-loop [66] 52.4% [71] 57896(15.9%) 17662(4.8%) match-e ...herbie/develop/src/core/ematch.rkt:46:0 for-loop [74] 54.1% for-loop [80] 9.9% ??? [106] 5.2% variable? [4] 2.8% list-cartesian-product [83] 1.8% custom-in-set [131] 1.5% loop [171] 0.5% ---------------------------------------------------------------------------- apply-match [69] 100.0% [72] 980(0.3%) 334(0.1%) reduce-to-single! ...lop/src/core/egraph.rkt:324:0 for-loop [77] 65.9% ---------------------------------------------------------------------------- merge-egraph-nodes! [73] 1.2% for-loop [81] 2.3% for-loop [70] 96.6% [73] 112190(30.8%) 600(0.2%) merge-egraph-nodes! ...p/src/core/egraph.rkt:152:0 update-leader! [78] 75.0% for-loop [81] 7.4% loop! [89] 6.3% for-loop [82] 6.2% enode-merge! [85] 1.7% merge-egraph-nodes! [73] 1.2% make-sequence [115] 0.7% ---------------------------------------------------------------------------- match-e [71] 100.0% [74] 39168(10.7%) 18600(5.1%) for-loop ...rbie/develop/src/core/ematch.rkt:59:11 for-loop [80] 51.5% loop [171] 4.6% list-cartesian-product [83] 3.5% ---------------------------------------------------------------------------- substitute-e [75] 5.8% for-loop [70] 94.2% [75] 22360(6.1%) 1304(0.4%) substitute-e ...e/develop/src/core/ematch.rkt:71:0 mk-enode! [79] 88.6% substitute-e [75] 5.8% ??? [106] 1.1% variable? [4] 1.0% ---------------------------------------------------------------------------- for-loop [70] 100.0% [76] 3060(0.8%) 298(0.1%) list-member? ...llects/racket/private/set.rkt:24:0 loop [84] 68.4% member [86] 21.9% ---------------------------------------------------------------------------- reduce-to-single! [72] 100.0% [77] 646(0.2%) 646(0.2%) for-loop ...rbie/develop/src/core/egraph.rkt:325:8 ---------------------------------------------------------------------------- apply-match [69] 32.5% merge-egraph-nodes! [73] 67.5% [78] 125922(34.5%) 1728(0.5%) update-leader! ...evelop/src/core/egraph.rkt:217:0 for-loop [87] 97.6% hash-ref! [157] 0.5% mutable-set [94] 0.3% update-en-expr [119] 0.3% ---------------------------------------------------------------------------- expr->enode [62] 1.7% substitute-e [75] 35.4% for-loop [70] 62.9% [79] 55974(15.3%) 4768(1.3%) mk-enode! ...bie/develop/src/core/egraph.rkt:101:0 new-enode [88] 89.1% hash-has-key? [111] 1.8% mutable-set [94] 0.6% ---------------------------------------------------------------------------- match-e [71] 31.8% for-loop [74] 68.2% [80] 32828(9.0%) 3134(0.9%) for-loop ...rbie/develop/src/core/ematch.rkt:65:37 match-e [71] 88.2% ??? [90] 3.3% ---------------------------------------------------------------------------- merge-egraph-nodes! [73] 100.0% [81] 10904(3.0%) 0(0.0%) for-loop ...bie/develop/src/core/egraph.rkt:200:10 loop! [89] 52.5% merge-egraph-nodes! [73] 47.5% ---------------------------------------------------------------------------- merge-egraph-nodes! [73] 100.0% [82] 7178(2.0%) 6478(1.8%) for-loop ...rbie/develop/src/core/egraph.rkt:232:6 update-en-expr [119] 9.8% ---------------------------------------------------------------------------- match-e [71] 25.2% list-cartesian-product [83] 31.6% for-loop [74] 43.2% [83] 2758(0.8%) 2072(0.6%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [83] 31.6% for-loop [92] 18.3% ---------------------------------------------------------------------------- list-member? [76] 100.0% [84] 2092(0.6%) 2092(0.6%) loop (unknown source) ---------------------------------------------------------------------------- merge-egraph-nodes! [73] 100.0% [85] 2066(0.6%) 360(0.1%) enode-merge! ...e/develop/src/core/enode.rkt:129:0 adopt-enode! [91] 49.5% custom-set-intersect! [93] 33.1% ---------------------------------------------------------------------------- list-member? [76] 100.0% [86] 670(0.2%) 670(0.2%) member (unknown source) ---------------------------------------------------------------------------- update-leader! [78] 100.0% [87] 122838(33.7%) 2358(0.6%) for-loop ...rbie/develop/src/core/egraph.rkt:222:6 for-loop [95] 97.5% update-en-expr [119] 0.6% ---------------------------------------------------------------------------- mk-enode! [79] 100.0% [88] 49862(13.7%) 680(0.2%) new-enode ...erbie/develop/src/core/enode.rkt:97:0 type-of-enode-expr [96] 98.6% ---------------------------------------------------------------------------- for-loop [81] 10.2% merge-egraph-nodes! [73] 16.0% loop [171] 25.5% for-loop [70] 48.2% [89] 44518(12.2%) 7680(2.1%) loop! ...s/herbie/develop/src/core/enode.rkt:192:2 custom-set-union [97] 42.0% loop [171] 29.7% set [98] 12.5% update-en-expr [119] 5.2% ---------------------------------------------------------------------------- for-loop [66] 21.8% for-loop [80] 78.2% [90] 1378(0.4%) 712(0.2%) ??? ...ies/herbie/develop/src/core/ematch.rkt:50:5 for-loop [99] 48.3% ---------------------------------------------------------------------------- enode-merge! [85] 100.0% [91] 1022(0.3%) 0(0.0%) adopt-enode! ...e/develop/src/core/enode.rkt:105:0 custom-set-union [97] 100.0% ---------------------------------------------------------------------------- list-cartesian-product [83] 100.0% [92] 686(0.2%) 686(0.2%) for-loop ...erbie/develop/src/core/ematch.rkt:24:8 ---------------------------------------------------------------------------- enode-merge! [85] 100.0% [93] 684(0.2%) 684(0.2%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ---------------------------------------------------------------------------- mk-enode! [79] 49.5% update-leader! [78] 50.5% [94] 666(0.2%) 336(0.1%) mutable-set .../racket/private/set-types.rkt:999:0 for-loop [100] 49.5% ---------------------------------------------------------------------------- for-loop [87] 100.0% [95] 119796(32.8%) 1372(0.4%) for-loop ...rbie/develop/src/core/egraph.rkt:223:8 hash-update! [101] 98.9% ---------------------------------------------------------------------------- new-enode [88] 100.0% [96] 49182(13.5%) 1706(0.5%) type-of-enode-expr ...elop/src/core/enode.rkt:68:0 get-sigs [102] 96.5% ---------------------------------------------------------------------------- adopt-enode! [91] 5.1% loop! [89] 94.9% [97] 20104(5.5%) 5792(1.6%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [103] 64.2% for-loop [104] 7.0% ---------------------------------------------------------------------------- loop! [89] 100.0% [98] 11154(3.1%) 11154(3.1%) set ...collects/racket/private/set-types.rkt:981:0 ---------------------------------------------------------------------------- ??? [90] 100.0% [99] 666(0.2%) 366(0.1%) for-loop ...erbie/develop/src/core/ematch.rkt:51:7 ??? [106] 45.0% ---------------------------------------------------------------------------- mutable-set [94] 100.0% [100] 330(0.1%) 330(0.1%) for-loop ...cts/racket/private/set-types.rkt:943:2 ---------------------------------------------------------------------------- for-loop [95] 100.0% [101] 118424(32.5%) 354(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [105] 99.7% ---------------------------------------------------------------------------- type-of-enode-expr [96] 100.0% [102] 47476(13.0%) 1424(0.4%) get-sigs .../herbie/develop/src/type-check.rkt:5:0 ??? [107] 36.8% table-ref [48] 30.5% ??? [106] 19.8% ...velop/src/common.rkt:47:2 [109] 9.9% ---------------------------------------------------------------------------- custom-set-union [97] 100.0% [103] 12900(3.5%) 5000(1.4%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [108] 61.2% ---------------------------------------------------------------------------- custom-set-union [97] 100.0% [104] 1412(0.4%) 1412(0.4%) for-loop ...cts/racket/private/set-types.rkt:152:2 ---------------------------------------------------------------------------- hash-update! [101] 100.0% [105] 118070(32.4%) 1634(0.4%) ??? ...s/herbie/develop/src/core/egraph.rkt:225:24 for-loop [110] 97.7% make-sequence [115] 0.9% ---------------------------------------------------------------------------- setfindf [186] 0.8% for-loop [99] 0.9% run-improve50 [2] 0.9% substitute-e [75] 1.7% variable? [4] 14.4% match-e [71] 18.6% get-sigs [102] 27.2% finalize-iter! [32] 34.6% [106] 34606(9.5%) 9848(2.7%) ??? ...contract/private/arrow-val-first.rkt:357:18 hash-has-key? [111] 33.9% for-loop [112] 33.7% atab-add-altns [117] 1.9% ??? [179] 1.0% ??? [118] 1.0% ---------------------------------------------------------------------------- ??? [152] 1.8% f176 [145] 2.0% get-sigs [102] 96.2% [107] 18148(5.0%) 2054(0.6%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [113] 49.0% for-loop [136] 29.0% get/build-late-neg-projection [142] 8.7% ---------------------------------------------------------------------------- for-loop [103] 100.0% [108] 7900(2.2%) 7900(2.2%) for-loop ...cts/racket/private/set-types.rkt:178:5 ---------------------------------------------------------------------------- for-loop [40] 37.7% get-sigs [102] 62.3% [109] 7570(2.1%) 2234(0.6%) ...velop/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [114] 44.7% ??? [116] 25.8% ---------------------------------------------------------------------------- ??? [105] 100.0% [110] 115382(31.6%) 96426(26.4%) for-loop ...bie/develop/src/core/egraph.rkt:226:26 update-en-expr [119] 16.4% ---------------------------------------------------------------------------- mk-enode! [79] 7.9% ??? [106] 92.1% [111] 12760(3.5%) 4054(1.1%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [120] 60.4% ??? [124] 7.8% ---------------------------------------------------------------------------- ??? [106] 100.0% [112] 11646(3.2%) 0(0.0%) for-loop ...ie/develop/src/core/alt-table.rkt:51:2 atab-add-altn [121] 100.0% ---------------------------------------------------------------------------- ??? [107] 100.0% [113] 8892(2.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [122] 100.0% ---------------------------------------------------------------------------- ...velop/src/common.rkt:47:2 [109] 100.0% [114] 3382(0.9%) 334(0.1%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 ??? [123] 59.8% assoc-ref [125] 20.5% return/no-unsupplied [180] 9.8% ---------------------------------------------------------------------------- merge-egraph-nodes! [73] 48.7% ??? [105] 51.3% [115] 2054(0.6%) 1368(0.4%) make-sequence ...ects/racket/private/for.rkt:509:2 ??? [126] 33.4% ---------------------------------------------------------------------------- for-loop [174] 8.5% ...velop/src/common.rkt:47:2 [109] 91.5% [116] 1954(0.5%) 312(0.1%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [164] 75.5% ??? [179] 8.5% ---------------------------------------------------------------------------- ??? [106] 100.0% [117] 648(0.2%) 0(0.0%) atab-add-altns ...elop/src/core/alt-table.rkt:50:0 atab-add-altn [121] 100.0% ---------------------------------------------------------------------------- ??? [106] 100.0% [118] 358(0.1%) 0(0.0%) ??? .../herbie/develop/src/core/alt-table.rkt:54:0 ??? [152] 100.0% ---------------------------------------------------------------------------- update-leader! [78] 1.3% for-loop [87] 2.7% for-loop [82] 2.8% loop! [89] 18.2% for-loop [110] 75.0% [119] 25262(6.9%) 24904(6.8%) update-en-expr ...evelop/src/core/egraph.rkt:211:0 ---------------------------------------------------------------------------- hash-has-key? [111] 35.7% table-ref [48] 64.3% [120] 21596(5.9%) 6556(1.8%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [127] 53.0% ??? [134] 15.1% ??? [164] 1.5% ---------------------------------------------------------------------------- atab-add-altns [117] 5.3% for-loop [112] 94.7% [121] 12294(3.4%) 360(0.1%) atab-add-altn ...elop/src/core/alt-table.rkt:208:0 best-and-tied-at-points [128] 91.2% loop [171] 2.9% override-at-pnts [132] 2.9% ---------------------------------------------------------------------------- ??? [113] 100.0% [122] 8892(2.4%) 1350(0.4%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [129] 84.8% ---------------------------------------------------------------------------- table-ref [48] 42.7% ??? [114] 57.3% [123] 3530(1.0%) 956(0.3%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [130] 55.0% ??? [179] 18.0% ---------------------------------------------------------------------------- hash-has-key? [111] 100.0% [124] 994(0.3%) 994(0.3%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ---------------------------------------------------------------------------- ??? [114] 100.0% [125] 694(0.2%) 694(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ---------------------------------------------------------------------------- make-sequence [115] 100.0% [126] 686(0.2%) 360(0.1%) ??? ...acket/collects/racket/private/for.rkt:429:7 custom-in-set [131] 47.5% ---------------------------------------------------------------------------- ??? [120] 100.0% [127] 11442(3.1%) 6846(1.9%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [134] 28.8% for-loop [136] 8.7% ??? [137] 2.6% ---------------------------------------------------------------------------- atab-add-altn [121] 100.0% [128] 11210(3.1%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [133] 100.0% ---------------------------------------------------------------------------- ??? [122] 100.0% [129] 7542(2.1%) 1050(0.3%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [135] 86.1% ---------------------------------------------------------------------------- ??? [123] 100.0% [130] 1940(0.5%) 1940(0.5%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ---------------------------------------------------------------------------- ??? [126] 24.1% match-e [71] 75.9% [131] 1350(0.4%) 1350(0.4%) custom-in-set ...acket/private/set-types.rkt:577:0 ---------------------------------------------------------------------------- atab-add-altn [121] 100.0% [132] 362(0.1%) 0(0.0%) override-at-pnts ...p/src/core/alt-table.rkt:145:0 errors [133] 100.0% ---------------------------------------------------------------------------- composed [176] 3.0% override-at-pnts [132] 3.0% best-and-tied-at-points [128] 94.0% [133] 11930(3.3%) 0(0.0%) errors ...lies/herbie/develop/src/points.rkt:218:0 for-loop [138] 82.8% eval-prog [141] 17.2% ---------------------------------------------------------------------------- ??? [120] 49.8% for-loop [127] 50.2% [134] 6564(1.8%) 2916(0.8%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [140] 55.6% ---------------------------------------------------------------------------- ??? [129] 100.0% [135] 6492(1.8%) 1330(0.4%) for-loop ...racket/contract/private/list.rkt:680:9 add-list-context [139] 64.2% get/build-late-neg-projection [142] 15.3% ---------------------------------------------------------------------------- for-loop [127] 16.0% ??? [107] 84.0% [136] 6258(1.7%) 1000(0.3%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [164] 84.0% ---------------------------------------------------------------------------- for-loop [127] 100.0% [137] 298(0.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [143] 100.0% ---------------------------------------------------------------------------- errors [133] 100.0% [138] 9880(2.7%) 1300(0.4%) for-loop ...es/herbie/develop/src/points.rkt:221:4 ??? [144] 70.5% ulp-difference [147] 13.1% ??? [152] 3.2% ---------------------------------------------------------------------------- for-loop [135] 100.0% [139] 4170(1.1%) 4170(1.1%) add-list-context ...ontract/private/list.rkt:752:0 ---------------------------------------------------------------------------- ??? [134] 100.0% [140] 3648(1.0%) 3648(1.0%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ---------------------------------------------------------------------------- loop [54] 29.0% errors [133] 71.0% [141] 2888(0.8%) 1384(0.4%) eval-prog ...herbie/develop/src/programs.rkt:148:0 hash-ref! [157] 29.0% go [149] 11.6% f176 [145] 11.5% ---------------------------------------------------------------------------- ??? [148] 24.3% ??? [107] 37.2% for-loop [135] 38.5% [142] 2576(0.7%) 666(0.2%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [146] 49.8% ??? [148] 24.3% ---------------------------------------------------------------------------- ??? [137] 100.0% [143] 298(0.1%) 0(0.0%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [150] 100.0% ---------------------------------------------------------------------------- loop [196] 3.1% jloop [10] 3.3% for-loop [138] 40.0% loop [171] 53.5% [144] 17388(4.8%) 358(0.1%) ??? ...tlies/herbie/develop/src/programs.rkt:154:4 ??? [151] 85.8% ??? [152] 5.4% ??? [154] 5.0% ---------------------------------------------------------------------------- eval-prog [141] 2.9% approximate9 [5] 5.0% map [67] 8.1% rewriter [51] 9.4% f176 [145] 9.5% simplify [26] 28.8% split-table [27] 36.3% [145] 3790(1.0%) 1368(0.4%) f176 .../collects/racket/match/compiler.rkt:507:40 loop [171] 22.0% option-on-expr [182] 14.3% f176 [145] 9.5% ??? [107] 9.4% map [67] 8.1% taylor [12] 3.1% ??? [152] 2.9% taylor-invert [13] 1.8% ---------------------------------------------------------------------------- get/build-late-neg-projection [142]100.0% [146] 1910(0.5%) 958(0.3%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [153] 49.8% ---------------------------------------------------------------------------- for-loop [138] 100.0% [147] 1298(0.4%) 688(0.2%) ulp-difference ...erbie/develop/src/float.rkt:19:0 return/no-unsupplied [180] 47.0% ---------------------------------------------------------------------------- get/build-late-neg-projection [142]100.0% [148] 1252(0.3%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:211:2 get/build-late-neg-projection [142]100.0% ---------------------------------------------------------------------------- eval-prog [141] 100.0% [149] 334(0.1%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [155] 100.0% ---------------------------------------------------------------------------- check-hash/c [143] 100.0% [150] 298(0.1%) 298(0.1%) flat-contract? .../contract/private/guts.rkt:111:0 ---------------------------------------------------------------------------- ??? [144] 100.0% [151] 14922(4.1%) 5374(1.5%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [156] 44.7% ??? [158] 11.3% ??? [159] 6.0% ...higher-order.rkt:346:33 [163] 2.0% ---------------------------------------------------------------------------- loop [196] 4.0% loop [171] 4.7% for-loop [138] 5.1% f176 [145] 5.3% ??? [118] 5.7% map [67] 5.7% loop [18] 10.9% ??? [144] 14.7% table-ref [48] 21.9% for-loop [50] 21.9% [152] 6322(1.7%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:342:33 table-ref [48] 56.2% approximate9 [5] 19.1% hash-ref! [157] 10.9% best-alt [162] 5.7% ??? [107] 5.3% simplify [26] 2.8% ---------------------------------------------------------------------------- contract-struct-name [161] 19.0% ??? [146] 81.0% [153] 952(0.3%) 702(0.2%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [161] 45.3% ---------------------------------------------------------------------------- ??? [144] 100.0% [154] 872(0.2%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [160] 100.0% ---------------------------------------------------------------------------- go [149] 14.3% loop [155] 85.7% [155] 334(0.1%) 334(0.1%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [155] 85.7% ---------------------------------------------------------------------------- ??? [151] 100.0% [156] 6672(1.8%) 1022(0.3%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [165] 84.7% ---------------------------------------------------------------------------- first-nonzero-exp [28] 1.5% ??? [30] 2.1% for-loop [29] 2.4% eval-prog [141] 5.4% localize-error [38] 6.3% ??? [166] 8.4% ??? [152] 8.4% for-loop [19] 9.0% loop [171] 9.3% for-loop [17] 10.4% ??? [167] 11.3% update-leader! [78] 12.0% compile [46] 13.6% [157] 5716(1.6%) 1776(0.5%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [167] 23.5% ??? [6] 12.5% ??? [7] 9.0% ??? [166] 8.4% parse-loop79 [168] 6.3% bigfloat-hash [169] 5.4% ??? [8] 5.4% simplify [26] 4.4% ??? [9] 2.4% ---------------------------------------------------------------------------- ??? [151] 100.0% [158] 1692(0.5%) 694(0.2%) ??? ...herbie/develop/src/syntax/syntax.rkt:122:17 return/no-unsupplied [180] 59.0% ---------------------------------------------------------------------------- ??? [151] 100.0% [159] 892(0.2%) 892(0.2%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ---------------------------------------------------------------------------- ??? [154] 100.0% [160] 872(0.2%) 260(0.1%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [173] 70.2% ---------------------------------------------------------------------------- build-compound-type-name [153] 100.0% [161] 612(0.2%) 250(0.1%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [153] 59.2% ---------------------------------------------------------------------------- ??? [152] 100.0% [162] 358(0.1%) 0(0.0%) best-alt ...tlies/herbie/develop/src/glue.rkt:71:0 loop [170] 100.0% ---------------------------------------------------------------------------- ??? [151] 100.0% [163] 292(0.1%) 0(0.0%) ...higher-order.rkt:346:33 (unknown source) ??? [164] 100.0% ---------------------------------------------------------------------------- ...higher-order.rkt:346:33 [163] 3.9% ??? [120] 4.4% ??? [116] 21.8% for-loop [136] 69.9% [164] 7524(2.1%) 1574(0.4%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [172] 69.9% for-loop [174] 9.2% ---------------------------------------------------------------------------- ??? [156] 100.0% [165] 5650(1.5%) 3148(0.9%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [173] 44.3% ---------------------------------------------------------------------------- hash-ref! [157] 100.0% [166] 2072(0.6%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:44:15 hash-ref! [157] 100.0% ---------------------------------------------------------------------------- hash-ref! [157] 100.0% [167] 1890(0.5%) 336(0.1%) ??? ...tlies/herbie/develop/src/programs.rkt:183:5 hash-ref! [157] 46.8% loop [171] 44.3% ---------------------------------------------------------------------------- loop [171] 8.1% parse-loop79 [168] 24.2% hash-ref! [157] 25.9% simplify [26] 41.9% [168] 1390(0.4%) 694(0.2%) parse-loop79 ...s/racket/match/compiler.rkt:418:15 loop [171] 34.0% parse-loop79 [168] 24.2% simplify* [177] 4.0% ---------------------------------------------------------------------------- hash-ref! [157] 100.0% [169] 838(0.2%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [175] 70.9% sig+exp->bigfloat [178] 29.1% ---------------------------------------------------------------------------- best-alt [162] 100.0% [170] 358(0.1%) 0(0.0%) loop ...htlies/herbie/develop/src/common.rkt:146:2 composed [176] 100.0% ---------------------------------------------------------------------------- make-exacts* [59] 0.0% atab-add-altn [121] 0.1% map [67] 0.4% parse-loop79 [168] 0.5% taylor [12] 0.8% match-e [71] 1.5% f176 [145] 2.0% ??? [167] 2.0% for-loop [74] 2.3% map-enodes [60] 3.4% loop! [89] 11.6% loop [171] 75.4% [171] 42324(11.6%) 3634(1.0%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [171] 75.4% loop! [89] 10.4% for-loop [181] 2.7% hash-ref! [157] 2.0% option-on-expr [182] 2.0% foldl [184] 0.8% parse-loop79 [168] 0.4% ??? [144] 0.4% loop [183] 0.1% ??? [11] 0.1% ??? [152] 0.0% ---------------------------------------------------------------------------- ??? [164] 100.0% [172] 5258(1.4%) 360(0.1%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [179] 93.2% ---------------------------------------------------------------------------- ??? [57] 8.8% real->bigfloat [160] 17.9% bfsub [165] 73.3% [173] 3414(0.9%) 3414(0.9%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ---------------------------------------------------------------------------- ??? [164] 100.0% [174] 692(0.2%) 358(0.1%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [116] 48.3% ---------------------------------------------------------------------------- bigfloat-hash [169] 100.0% [175] 594(0.2%) 594(0.2%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ---------------------------------------------------------------------------- loop [170] 100.0% [176] 358(0.1%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [133] 100.0% ---------------------------------------------------------------------------- parse-loop79 [168] 100.0% [177] 336(0.1%) 0(0.0%) simplify* ...rbie/develop/src/core/reduce.rkt:31:0 return/no-unsupplied [180] 100.0% ---------------------------------------------------------------------------- bigfloat-hash [169] 100.0% [178] 244(0.1%) 244(0.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ---------------------------------------------------------------------------- ??? [116] 5.4% ??? [106] 5.8% ??? [123] 10.2% ??? [172] 78.7% [179] 6226(1.7%) 5558(1.5%) ??? ...ects/racket/contract/private/guts.rkt:644:8 dict? [189] 5.4% contract? [190] 5.4% ---------------------------------------------------------------------------- ??? [114] 8.9% simplify* [177] 9.1% ulp-difference [147] 16.5% ??? [158] 27.1% table-ref [48] 38.3% [180] 3688(1.0%) 3108(0.9%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [188] 15.7% ---------------------------------------------------------------------------- loop [171] 100.0% [181] 2938(0.8%) 720(0.2%) for-loop ...ie/develop/src/core/simplify.rkt:173:2 setfindf [186] 43.2% eval-const-expr [187] 32.3% ---------------------------------------------------------------------------- f176 [145] 39.4% loop [171] 60.6% [182] 1376(0.4%) 0(0.0%) option-on-expr ...velop/src/core/regimes.rkt:103:0 sort-context-on-expr [185] 100.0% ---------------------------------------------------------------------------- loop [171] 0.9% loop [183] 99.1% [183] 362(0.1%) 362(0.1%) loop ...ket/collects/racket/private/list.rkt:82:16 loop [183] 99.1% ---------------------------------------------------------------------------- loop [171] 100.0% [184] 326(0.1%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [191] 100.0% ---------------------------------------------------------------------------- option-on-expr [182] 100.0% [185] 1376(0.4%) 0(0.0%) sort-context-on-expr ...velop/src/points.rkt:115:0 ??? [192] 100.0% ---------------------------------------------------------------------------- for-loop [181] 100.0% [186] 1268(0.3%) 346(0.1%) setfindf ...es/herbie/develop/src/common.rkt:179:0 for-loop [193] 51.3% ??? [106] 21.5% ---------------------------------------------------------------------------- for-loop [181] 100.0% [187] 950(0.3%) 950(0.3%) eval-const-expr .../develop/src/programs.rkt:166:0 ---------------------------------------------------------------------------- one-iter [58] 37.4% return/no-unsupplied [180] 62.6% [188] 926(0.3%) 926(0.3%) filter ...t/collects/racket/private/list.rkt:256:2 ---------------------------------------------------------------------------- ??? [179] 100.0% [189] 334(0.1%) 334(0.1%) dict? ...ollects/racket/private/generic.rkt:146:11 ---------------------------------------------------------------------------- ??? [179] 100.0% [190] 334(0.1%) 334(0.1%) contract? ...acket/contract/private/guts.rkt:109:0 ---------------------------------------------------------------------------- foldl [184] 100.0% [191] 326(0.1%) 326(0.1%) merge2 .../herbie/develop/src/core/ematch.rkt:31:0 ---------------------------------------------------------------------------- sort-context-on-expr [185] 100.0% [192] 1376(0.4%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [194] 80.2% loop [196] 19.8% ---------------------------------------------------------------------------- setfindf [186] 100.0% [193] 650(0.2%) 650(0.2%) for-loop ...es/herbie/develop/src/common.rkt:180:2 ---------------------------------------------------------------------------- ??? [192] 100.0% [194] 1104(0.3%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [195] 76.8% loop [196] 23.2% ---------------------------------------------------------------------------- generic-sort/key [194] 48.9% copying-mergesort [195] 51.1% [195] 848(0.2%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [195] 51.1% loop [196] 31.8% jloop [10] 17.0% ---------------------------------------------------------------------------- generic-sort/key [194] 32.1% copying-mergesort [195] 33.8% ??? [192] 34.1% [196] 798(0.2%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [144] 67.9% ??? [152] 32.1% ----------------------------------------------------------------------------