Profiling results ----------------- Total cpu time observed: 154098ms (out of 154880ms) Number of samples taken: 461 (once every 334ms) (Hiding functions with self<1.0% and local<2.0%: 5 of 200 hidden) ========================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================================== ??? [49] 100.0% [1] 136824(88.8%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [13] 100.0% ------------------------------------------------------------------------------------------ ??? [49] 100.0% [2] 119338(77.4%) 0(0.0%) run-improve50 ...ie/develop/src/mainloop.rkt:234:0 for-loop [14] 93.2% get-final-combination [17] 6.0% setup-alt-simplified [20] 0.5% loop [61] 0.3% ------------------------------------------------------------------------------------------ ??? [94] 100.0% [3] 95658(62.1%) 360(0.2%) iterate-egraph!13 ...p/src/core/simplify.rkt:102:0 one-iter [15] 98.2% map-enodes [18] 1.1% debug7 [155] 0.4% ------------------------------------------------------------------------------------------ ??? [94] 100.0% [4] 14564(9.5%) 0(0.0%) loop ...herbie/develop/src/core/simplify.rkt:210:2 pass [16] 100.0% ------------------------------------------------------------------------------------------ substitute-e [54] 30.8% match-e [41] 69.2% [5] 3500(2.3%) 330(0.2%) variable? ...e/develop/src/syntax/syntax.rkt:529:0 ??? [42] 90.6% ------------------------------------------------------------------------------------------ hash-ref! [110] 100.0% [6] 932(0.6%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:291:23 for-loop [19] 100.0% ------------------------------------------------------------------------------------------ copying-mergesort [169] 100.0% [7] 874(0.6%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ->flonum [177] 68.2% ??? [174] 31.8% ------------------------------------------------------------------------------------------ hash-ref! [110] 100.0% [8] 630(0.4%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:281:26 for-loop [21] 100.0% ------------------------------------------------------------------------------------------ f37 [109] 100.0% [9] 342(0.2%) 0(0.0%) loop ...s/herbie/develop/src/core/taylor.rkt:258:2 hash-ref! [110] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [110] 100.0% [10] 330(0.2%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:388:23 for-loop [22] 100.0% ------------------------------------------------------------------------------------------ append-map [121] 100.0% [11] 302(0.2%) 0(0.0%) free-variables ...e/develop/src/programs.rkt:101:0 ??? [42] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [110] 100.0% [12] 296(0.2%) 0(0.0%) taylor-exp ...ie/develop/src/core/taylor.rkt:382:0 simplify [132] 100.0% ------------------------------------------------------------------------------------------ profile-thunk16 [1] 100.0% [13] 136824(88.8%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [49] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [2] 100.0% [14] 111170(72.1%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:249:10 run-iter! [23] 100.0% ------------------------------------------------------------------------------------------ iterate-egraph!13 [3] 100.0% [15] 93918(60.9%) 2656(1.7%) one-iter ...ie/develop/src/core/simplify.rkt:113:0 for-loop [24] 52.5% loop [25] 42.9% apply-match [32] 1.4% ------------------------------------------------------------------------------------------ loop [4] 100.0% [16] 14564(9.5%) 0(0.0%) pass ...herbie/develop/src/core/simplify.rkt:200:2 for-loop [26] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [2] 100.0% [17] 7152(4.6%) 0(0.0%) get-final-combination ...op/src/mainloop.rkt:264:0 split-table [27] 100.0% ------------------------------------------------------------------------------------------ iterate-egraph!13 [3] 100.0% [18] 1014(0.7%) 0(0.0%) map-enodes ...ie/develop/src/core/egraph.rkt:139:0 loop [123] 68.0% for-loop [134] 32.0% ------------------------------------------------------------------------------------------ ??? [6] 100.0% [19] 932(0.6%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:294:27 hash-ref! [110] 100.0% ------------------------------------------------------------------------------------------ run-improve50 [2] 100.0% [20] 636(0.4%) 0(0.0%) setup-alt-simplified .../develop/src/glue.rkt:48:0 simplify-alt [28] 100.0% ------------------------------------------------------------------------------------------ ??? [8] 100.0% [21] 630(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:281:52 hash-ref! [110] 52.4% ??? [30] 47.6% ------------------------------------------------------------------------------------------ ??? [10] 100.0% [22] 330(0.2%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:392:33 for-loop [29] 100.0% ------------------------------------------------------------------------------------------ for-loop [14] 100.0% [23] 111170(72.1%) 0(0.0%) run-iter! ...herbie/develop/src/mainloop.rkt:215:0 simplify! [31] 85.5% finalize-iter! [33] 10.4% gen-series! [36] 2.9% gen-rewrites! [37] 0.9% localize-error [39] 0.3% ------------------------------------------------------------------------------------------ for-loop [24] 48.9% one-iter [15] 51.1% [24] 49292(32.0%) 9744(6.3%) for-loop ...e/develop/src/core/simplify.rkt:123:12 for-loop [24] 48.9% match-e [41] 39.8% ??? [74] 0.3% ------------------------------------------------------------------------------------------ one-iter [15] 100.0% [25] 40292(26.1%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:52:19 apply-match [32] 100.0% ------------------------------------------------------------------------------------------ pass [16] 100.0% [26] 14564(9.5%) 0(0.0%) for-loop ...e/develop/src/core/simplify.rkt:203:29 argmin [34] 61.6% loop [35] 33.7% for-loop [38] 4.7% ------------------------------------------------------------------------------------------ get-final-combination [17] 100.0% [27] 7152(4.6%) 0(0.0%) split-table ...s/herbie/develop/src/glue.rkt:162:0 f37 [109] 100.0% ------------------------------------------------------------------------------------------ setup-alt-simplified [20] 100.0% [28] 636(0.4%) 0(0.0%) simplify-alt ...s/herbie/develop/src/glue.rkt:81:0 ??? [94] 100.0% ------------------------------------------------------------------------------------------ for-loop [22] 100.0% [29] 330(0.2%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:394:39 hash-ref! [110] 100.0% ------------------------------------------------------------------------------------------ for-loop [21] 100.0% [30] 300(0.2%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:284:19 hash-ref! [110] 100.0% ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [31] 95056(61.7%) 0(0.0%) simplify! ...herbie/develop/src/mainloop.rkt:155:0 for-loop [40] 100.0% ------------------------------------------------------------------------------------------ one-iter [15] 3.3% loop [25] 96.7% [32] 41648(27.0%) 360(0.2%) apply-match ...develop/src/core/simplify.rkt:129:2 merge-egraph-nodes! [51] 33.2% match-e [41] 24.5% for-loop [44] 16.9% loop! [129] 15.4% substitute-e [54] 4.2% mk-enode! [117] 4.0% reduce-to-single! [48] 0.9% ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [33] 11538(7.5%) 0(0.0%) finalize-iter! ...e/develop/src/mainloop.rkt:169:0 ??? [42] 100.0% ------------------------------------------------------------------------------------------ for-loop [26] 100.0% [34] 8968(5.8%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [43] 92.2% expression-cost [47] 7.8% ------------------------------------------------------------------------------------------ for-loop [26] 100.0% [35] 4912(3.2%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [43] 100.0% ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [36] 3248(2.1%) 0(0.0%) gen-series! ...rbie/develop/src/mainloop.rkt:129:0 for-loop [45] 100.0% ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [37] 996(0.6%) 0(0.0%) gen-rewrites! ...ie/develop/src/mainloop.rkt:142:0 for-loop [46] 100.0% ------------------------------------------------------------------------------------------ for-loop [26] 100.0% [38] 684(0.4%) 684(0.4%) for-loop ...e/develop/src/core/simplify.rkt:190:13 ------------------------------------------------------------------------------------------ run-iter! [23] 100.0% [39] 332(0.2%) 0(0.0%) localize-error ...velop/src/core/localize.rkt:47:0 hash-ref! [110] 100.0% ------------------------------------------------------------------------------------------ simplify! [31] 96.7% [40] 98250(63.8%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:159:6 ??? [49] 99.7% debug-print [59] 0.3% ------------------------------------------------------------------------------------------ apply-match [32] 12.4% for-loop [60] 22.4% for-loop [24] 65.3% [41] 49420(32.1%) 19270(12.5%) match-e ...herbie/develop/src/core/ematch.rkt:46:0 for-loop [50] 45.9% for-loop [60] 8.8% ??? [42] 5.9% custom-in-set [55] 2.1% variable? [5] 1.7% loop [123] 1.6% list-cartesian-product [64] 1.4% ------------------------------------------------------------------------------------------ f37 [109] 1.4% free-variables [11] 1.4% for-loop [86] 1.6% substitute-e [54] 1.7% ??? [190] 2.4% variable? [5] 14.5% match-e [41] 24.3% finalize-iter! [33] 52.8% [42] 21872(14.2%) 6428(4.2%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [52] 52.8% hash-has-key? [124] 16.2% ??? [190] 1.7% ------------------------------------------------------------------------------------------ loop [35] 37.3% argmin [34] 62.7% [43] 13184(8.6%) 328(0.2%) for-loop .../herbie/develop/src/programs.rkt:200:2 ??? [94] 64.2% ...velop/src/common.rkt:47:2 [96] 33.4% ------------------------------------------------------------------------------------------ apply-match [32] 100.0% [44] 7048(4.6%) 0(0.0%) for-loop ...e/develop/src/core/simplify.rkt:143:10 loop! [129] 56.1% merge-egraph-nodes! [51] 33.5% substitute-e [54] 10.4% ------------------------------------------------------------------------------------------ gen-series! [36] 100.0% [45] 3248(2.1%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:135:7 taylor-alt [53] 100.0% ------------------------------------------------------------------------------------------ gen-rewrites! [37] 100.0% [46] 996(0.6%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:147:11 ??? [56] 100.0% ------------------------------------------------------------------------------------------ argmin [34] 100.0% [47] 696(0.5%) 0(0.0%) expression-cost .../develop/src/programs.rkt:199:0 compile [57] 100.0% ------------------------------------------------------------------------------------------ apply-match [32] 100.0% [48] 368(0.2%) 0(0.0%) reduce-to-single! ...lop/src/core/egraph.rkt:324:0 for-loop [58] 100.0% ------------------------------------------------------------------------------------------ for-loop [40] 22.7% run [13] 34.4% [49] 152918(99.2%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 34.4% ??? [94] 30.6% run-improve50 [2] 29.0% loop [61] 6.0% ------------------------------------------------------------------------------------------ match-e [41] 100.0% [50] 28980(18.8%) 8758(5.7%) for-loop ...rbie/develop/src/core/ematch.rkt:59:11 for-loop [60] 50.5% list-cartesian-product [64] 8.6% loop [123] 8.4% curry* [69] 2.4% filter [187] 2.3% foldl [133] 0.6% ------------------------------------------------------------------------------------------ for-loop [66] 2.0% merge-egraph-nodes! [51] 6.4% for-loop [44] 14.6% apply-match [32] 77.1% [51] 16184(10.5%) 640(0.4%) merge-egraph-nodes! ...p/src/core/egraph.rkt:152:0 update-leader! [62] 65.6% for-loop [67] 8.4% loop! [129] 8.2% for-loop [66] 7.4% merge-egraph-nodes! [51] 6.4% ------------------------------------------------------------------------------------------ ??? [42] 100.0% [52] 11538(7.5%) 0(0.0%) for-loop ...ie/develop/src/core/alt-table.rkt:51:2 atab-add-altn [63] 100.0% ------------------------------------------------------------------------------------------ for-loop [45] 100.0% [53] 3248(2.1%) 0(0.0%) taylor-alt ...es/herbie/develop/src/glue.rkt:139:0 for-loop [65] 100.0% ------------------------------------------------------------------------------------------ for-loop [44] 12.3% substitute-e [54] 34.2% apply-match [32] 53.4% [54] 2470(1.6%) 0(0.0%) substitute-e ...e/develop/src/core/ematch.rkt:71:0 mk-enode! [117] 41.4% substitute-e [54] 34.2% variable? [5] 16.9% ??? [42] 7.5% ------------------------------------------------------------------------------------------ match-e [41] 100.0% [55] 1024(0.7%) 1024(0.7%) custom-in-set ...acket/private/set-types.rkt:577:0 ------------------------------------------------------------------------------------------ for-loop [46] 100.0% [56] 996(0.6%) 0(0.0%) ??? ...ies/herbie/develop/src/alternative.rkt:88:0 rewriter [68] 100.0% ------------------------------------------------------------------------------------------ expression-cost [47] 100.0% [57] 696(0.5%) 0(0.0%) compile ...s/herbie/develop/src/programs.rkt:176:0 hash-ref! [110] 100.0% ------------------------------------------------------------------------------------------ reduce-to-single! [48] 100.0% [58] 368(0.2%) 368(0.2%) for-loop ...rbie/develop/src/core/egraph.rkt:325:8 ------------------------------------------------------------------------------------------ for-loop [40] 100.0% [59] 328(0.2%) 0(0.0%) debug-print .../herbie/develop/src/debug.rkt:107:0 for-loop [70] 100.0% ------------------------------------------------------------------------------------------ match-e [41] 30.3% for-loop [50] 69.7% [60] 21998(14.3%) 2086(1.4%) for-loop ...rbie/develop/src/core/ematch.rkt:65:37 match-e [41] 89.7% ??? [74] 3.3% ------------------------------------------------------------------------------------------ run-improve50 [2] 2.0% ??? [49] 98.0% [61] 18770(12.2%) 326(0.2%) loop ...htlies/herbie/develop/src/points.rkt:193:2 loop [73] 43.9% make-exacts* [80] 28.8% loop [82] 20.8% for-loop [77] 4.9% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [51] 100.0% [62] 11810(7.7%) 1288(0.8%) update-leader! ...evelop/src/core/egraph.rkt:217:0 for-loop [72] 89.1% ------------------------------------------------------------------------------------------ for-loop [52] 100.0% [63] 11538(7.5%) 0(0.0%) atab-add-altn ...elop/src/core/alt-table.rkt:208:0 best-and-tied-at-points [71] 100.0% ------------------------------------------------------------------------------------------ match-e [41] 21.0% list-cartesian-product [64] 25.4% for-loop [50] 53.7% [64] 4018(2.6%) 3692(2.4%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [64] 25.4% for-loop [78] 4.1% ------------------------------------------------------------------------------------------ taylor-alt [53] 100.0% [65] 3248(2.1%) 0(0.0%) for-loop ...lies/herbie/develop/src/glue.rkt:141:2 ??? [91] 100.0% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [51] 100.0% [66] 1368(0.9%) 0(0.0%) for-loop ...bie/develop/src/core/egraph.rkt:200:10 loop! [129] 64.7% merge-egraph-nodes! [51] 35.3% ------------------------------------------------------------------------------------------ merge-egraph-nodes! [51] 100.0% [67] 1362(0.9%) 1362(0.9%) for-loop ...rbie/develop/src/core/egraph.rkt:232:6 ------------------------------------------------------------------------------------------ ??? [56] 26.0% matcher [83] 74.0% [68] 996(0.6%) 0(0.0%) rewriter ...bie/develop/src/core/matcher.rkt:127:2 for-loop [76] 74.0% *rules* [75] 26.0% ------------------------------------------------------------------------------------------ for-loop [50] 100.0% [69] 692(0.4%) 0(0.0%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [170] 100.0% ------------------------------------------------------------------------------------------ debug-print [59] 100.0% [70] 328(0.2%) 328(0.2%) for-loop ...ies/herbie/develop/src/debug.rkt:113:2 ------------------------------------------------------------------------------------------ atab-add-altn [63] 100.0% [71] 11538(7.5%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [79] 94.0% for-loop [85] 6.0% ------------------------------------------------------------------------------------------ update-leader! [62] 100.0% [72] 10522(6.8%) 914(0.6%) for-loop ...rbie/develop/src/core/egraph.rkt:222:6 for-loop [81] 91.3% ------------------------------------------------------------------------------------------ loop [61] 100.0% [73] 8232(5.3%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:151:2 make-exacts* [80] 54.5% loop [82] 45.5% ------------------------------------------------------------------------------------------ for-loop [24] 31.2% for-loop [60] 68.8% [74] 1046(0.7%) 360(0.2%) ??? ...ies/herbie/develop/src/core/ematch.rkt:50:5 for-loop [86] 65.6% ------------------------------------------------------------------------------------------ rewriter [68] 100.0% [75] 996(0.6%) 0(0.0%) *rules* ...rbie/develop/src/syntax/rules.rkt:445:0 for-loop [87] 66.3% flag-set? [88] 33.7% ------------------------------------------------------------------------------------------ rewriter [68] 100.0% [76] 996(0.6%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:130:10 matcher [83] 100.0% ------------------------------------------------------------------------------------------ loop [61] 100.0% [77] 916(0.6%) 0(0.0%) for-loop ...s/herbie/develop/src/points.rkt:200:24 for-loop [84] 100.0% ------------------------------------------------------------------------------------------ list-cartesian-product [64] 100.0% [78] 326(0.2%) 326(0.2%) for-loop ...erbie/develop/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------------------------ option-on-expr [131] 7.2% best-and-tied-at-points [71] 92.8% [79] 11680(7.6%) 0(0.0%) errors ...lies/herbie/develop/src/points.rkt:218:0 for-loop [90] 79.8% eval-prog [164] 20.2% ------------------------------------------------------------------------------------------ loop [73] 45.4% loop [61] 54.6% [80] 9884(6.4%) 0(0.0%) make-exacts* ...erbie/develop/src/points.rkt:138:0 loop [123] 52.6% map [116] 47.4% ------------------------------------------------------------------------------------------ for-loop [72] 100.0% [81] 9608(6.2%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:223:8 hash-update! [89] 100.0% ------------------------------------------------------------------------------------------ loop [73] 49.0% loop [61] 51.0% [82] 7644(5.0%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:141:4 map [116] 100.0% ------------------------------------------------------------------------------------------ for-loop [92] 13.0% matcher [83] 37.0% for-loop [76] 50.0% [83] 996(0.6%) 0(0.0%) matcher ...rbie/develop/src/core/matcher.rkt:163:2 rewriter [68] 50.0% matcher [83] 37.0% for-loop [92] 13.0% ------------------------------------------------------------------------------------------ for-loop [77] 100.0% [84] 916(0.6%) 0(0.0%) for-loop ...s/herbie/develop/src/points.rkt:201:26 ??? [91] 100.0% ------------------------------------------------------------------------------------------ best-and-tied-at-points [71] 100.0% [85] 696(0.5%) 696(0.5%) for-loop .../develop/src/core/alt-table.rkt:124:16 ------------------------------------------------------------------------------------------ ??? [74] 100.0% [86] 686(0.4%) 326(0.2%) for-loop ...erbie/develop/src/core/ematch.rkt:51:7 ??? [42] 52.5% ------------------------------------------------------------------------------------------ *rules* [75] 100.0% [87] 660(0.4%) 298(0.2%) for-loop ...ies/herbie/develop/src/common.rkt:94:9 ormap [93] 54.8% ------------------------------------------------------------------------------------------ *rules* [75] 100.0% [88] 336(0.2%) 0(0.0%) flag-set? ...es/herbie/develop/src/config.rkt:32:0 return/no-unsupplied [180] 100.0% ------------------------------------------------------------------------------------------ for-loop [81] 100.0% [89] 9608(6.2%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [95] 100.0% ------------------------------------------------------------------------------------------ errors [79] 100.0% [90] 9324(6.1%) 1214(0.8%) for-loop ...es/herbie/develop/src/points.rkt:221:4 ??? [174] 76.5% ulp-difference [98] 7.5% ->flonum [177] 3.0% ------------------------------------------------------------------------------------------ for-loop [84] 15.4% ??? [94] 27.3% for-loop [65] 27.3% f37 [109] 29.9% [91] 5938(3.9%) 304(0.2%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [94] 37.7% approximate9 [97] 27.3% ...velop/src/common.rkt:47:2 [96] 11.3% ??? [99] 9.8% ??? [190] 8.8% ------------------------------------------------------------------------------------------ matcher [83] 100.0% [92] 698(0.5%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:179:21 matcher [83] 100.0% ------------------------------------------------------------------------------------------ for-loop [87] 100.0% [93] 362(0.2%) 362(0.2%) ormap ...et/collects/racket/private/map.rkt:105:13 ------------------------------------------------------------------------------------------ simplify-alt [28] 0.3% ??? [91] 2.1% for-loop [43] 2.5% ??? [94] 4.8% for-loop [100] 43.4% ??? [49] 46.8% [94] 114722(74.4%) 2912(1.9%) ??? ...llects/racket/private/norm-define.rkt:53:83 for-loop [100] 43.4% iterate-egraph!13 [3] 41.7% loop [4] 5.1% ??? [94] 4.8% ??? [130] 1.7% ??? [91] 1.6% loop [107] 0.3% mk-egraph [106] 0.2% ------------------------------------------------------------------------------------------ hash-update! [89] 100.0% [95] 9608(6.2%) 314(0.2%) ??? ...s/herbie/develop/src/core/egraph.rkt:225:24 for-loop [101] 96.7% ------------------------------------------------------------------------------------------ ??? [91] 13.2% for-loop [43] 86.8% [96] 5068(3.3%) 1392(0.9%) ...velop/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [102] 39.0% ??? [104] 33.5% ------------------------------------------------------------------------------------------ ??? [91] 100.0% [97] 3248(2.1%) 0(0.0%) approximate9 ...e/develop/src/core/taylor.rkt:12:0 loop [103] 58.9% f37 [109] 20.8% for-loop [105] 20.4% ------------------------------------------------------------------------------------------ for-loop [90] 100.0% [98] 698(0.5%) 698(0.5%) ulp-difference ...erbie/develop/src/float.rkt:19:0 ------------------------------------------------------------------------------------------ ??? [91] 100.0% [99] 580(0.4%) 280(0.2%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [108] 51.7% ------------------------------------------------------------------------------------------ ??? [94] 100.0% [100] 102268(66.4%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:63:12 ??? [94] 100.0% ------------------------------------------------------------------------------------------ ??? [95] 100.0% [101] 9294(6.0%) 8296(5.4%) for-loop ...bie/develop/src/core/egraph.rkt:226:26 update-en-expr [142] 10.7% ------------------------------------------------------------------------------------------ ??? [186] 7.6% ...velop/src/common.rkt:47:2 [96] 92.4% [102] 1976(1.3%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [186] 58.2% ??? [111] 34.2% ??? [190] 7.6% ------------------------------------------------------------------------------------------ approximate9 [97] 100.0% [103] 1912(1.2%) 0(0.0%) loop ...es/herbie/develop/src/core/taylor.rkt:83:4 hash-ref! [110] 100.0% ------------------------------------------------------------------------------------------ ...velop/src/common.rkt:47:2 [96] 100.0% [104] 1700(1.1%) 684(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 assoc-ref [112] 21.4% ??? [188] 19.6% return/no-unsupplied [180] 18.7% ------------------------------------------------------------------------------------------ approximate9 [97] 100.0% [105] 662(0.4%) 0(0.0%) for-loop ...rbie/develop/src/core/taylor.rkt:29:18 f37 [109] 100.0% ------------------------------------------------------------------------------------------ ??? [94] 100.0% [106] 360(0.2%) 0(0.0%) mk-egraph ...bie/develop/src/core/egraph.rkt:123:0 expr->enode [113] 100.0% ------------------------------------------------------------------------------------------ ??? [94] 100.0% [107] 300(0.2%) 0(0.0%) loop ...ghtlies/herbie/develop/src/points.rkt:66:6 random-exp [114] 100.0% ------------------------------------------------------------------------------------------ ??? [99] 100.0% [108] 300(0.2%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:69:2 get-blame-party-info [115] 100.0% ------------------------------------------------------------------------------------------ ??? [135] 1.6% for-loop [105] 1.7% approximate9 [97] 2.4% map [116] 2.5% append-map [121] 2.9% hash-ref! [110] 3.2% simplify [132] 4.9% eval-prog [164] 6.3% f37 [109] 16.1% split-table [27] 57.6% [109] 10740(7.0%) 658(0.4%) f37 ...t/collects/racket/match/compiler.rkt:507:40 loop [123] 41.2% option-on-expr [131] 16.4% f37 [109] 16.1% map [116] 10.9% ??? [91] 5.8% append-map [121] 3.3% loop [9] 1.6% taylor-invert [125] 1.1% taylor [148] 0.6% ??? [42] 0.6% ------------------------------------------------------------------------------------------ for-loop [21] 1.4% for-loop [29] 1.4% ??? [30] 1.8% for-loop [19] 5.6% ??? [119] 5.6% ??? [122] 6.8% localize-error [39] 10.1% loop [9] 10.4% loop [103] 13.8% compile [57] 14.4% ??? [118] 28.6% [110] 3282(2.1%) 362(0.2%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [118] 28.6% simplify [132] 16.0% ??? [122] 10.2% parse-loop12 [145] 10.1% ??? [119] 5.6% ??? [6] 5.6% f37 [109] 5.2% ??? [8] 3.3% taylor-exp [12] 3.0% ??? [10] 1.4% ------------------------------------------------------------------------------------------ ??? [102] 100.0% [111] 676(0.4%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:222:6 check-hash/c [120] 100.0% ------------------------------------------------------------------------------------------ ??? [104] 100.0% [112] 364(0.2%) 364(0.2%) assoc-ref ...collects/racket/private/dict.rkt:56:0 ------------------------------------------------------------------------------------------ mk-egraph [106] 33.3% expr->enode [113] 66.7% [113] 360(0.2%) 0(0.0%) expr->enode ...e/develop/src/core/egraph.rkt:124:2 expr->enode [113] 66.7% mk-enode! [117] 33.3% ------------------------------------------------------------------------------------------ loop [107] 100.0% [114] 300(0.2%) 300(0.2%) random-exp .../herbie/develop/src/common.rkt:237:0 ------------------------------------------------------------------------------------------ ??? [108] 100.0% [115] 300(0.2%) 300(0.2%) get-blame-party-info ...ate/arrow-common.rkt:136:0 ------------------------------------------------------------------------------------------ ??? [135] 2.2% f37 [109] 15.3% make-exacts* [80] 31.3% loop [82] 51.2% [116] 14938(9.7%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [123] 77.8% f37 [109] 6.5% ->flonum [177] 4.8% taylor-invert [125] 3.4% ??? [135] 3.4% ??? [174] 2.2% make-multiplication-node [128] 2.0% ------------------------------------------------------------------------------------------ expr->enode [113] 11.8% substitute-e [54] 33.4% apply-match [32] 54.8% [117] 3060(2.0%) 1018(0.7%) mk-enode! ...bie/develop/src/core/egraph.rkt:101:0 hash-has-key? [124] 44.1% new-enode [126] 22.6% ------------------------------------------------------------------------------------------ hash-ref! [110] 100.0% [118] 1912(1.2%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:64:15 hash-ref! [110] 100.0% ------------------------------------------------------------------------------------------ hash-ref! [110] 100.0% [119] 932(0.6%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:43:15 hash-ref! [110] 100.0% ------------------------------------------------------------------------------------------ ??? [111] 100.0% [120] 676(0.4%) 360(0.2%) check-hash/c ...ket/contract/private/hash.rkt:83:0 flat-contract? [127] 46.7% ------------------------------------------------------------------------------------------ f37 [109] 100.0% [121] 598(0.4%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 f37 [109] 87.4% free-variables [11] 12.6% ------------------------------------------------------------------------------------------ hash-ref! [110] 100.0% [122] 334(0.2%) 334(0.2%) ??? ...tlies/herbie/develop/src/programs.rkt:184:5 hash-ref! [110] 66.7% ------------------------------------------------------------------------------------------ ??? [174] 0.0% parse-loop12 [145] 0.0% map-enodes [18] 0.1% map [116] 0.6% make-exacts* [80] 0.9% match-e [41] 3.8% for-loop [50] 6.1% loop! [129] 6.3% f37 [109] 15.5% loop [123] 66.6% [123] 34702(22.5%) 2678(1.7%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [123] 66.6% option-on-expr [131] 15.5% loop! [129] 6.3% foldl [133] 2.2% ??? [174] 1.5% for-loop [134] 0.1% ??? [135] 0.0% ->flonum [177] 0.0% ??? [176] 0.0% ------------------------------------------------------------------------------------------ mk-enode! [117] 27.6% ??? [42] 72.4% [124] 4894(3.2%) 2986(1.9%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [130] 31.5% ??? [136] 7.4% ------------------------------------------------------------------------------------------ f37 [109] 34.6% map [116] 65.4% [125] 1046(0.7%) 0(0.0%) taylor-invert ...develop/src/core/taylor.rkt:308:0 simplify [132] 100.0% ------------------------------------------------------------------------------------------ mk-enode! [117] 100.0% [126] 692(0.4%) 0(0.0%) new-enode ...erbie/develop/src/core/enode.rkt:68:0 set [141] 100.0% ------------------------------------------------------------------------------------------ check-hash/c [120] 100.0% [127] 316(0.2%) 316(0.2%) flat-contract? .../contract/private/guts.rkt:111:0 ------------------------------------------------------------------------------------------ map [116] 100.0% [128] 300(0.2%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:219:0 make-multiplication-subnode [137] 100.0% ------------------------------------------------------------------------------------------ for-loop [66] 6.9% merge-egraph-nodes! [51] 9.3% for-loop [44] 21.4% loop [123] 28.6% apply-match [32] 33.8% [129] 12762(8.3%) 3348(2.2%) loop! ...s/herbie/develop/src/core/enode.rkt:163:2 custom-set-union [138] 43.4% loop [123] 31.0% set [141] 8.4% update-en-expr [142] 4.0% ------------------------------------------------------------------------------------------ hash-has-key? [124] 20.9% ??? [94] 79.1% [130] 7402(4.8%) 2554(1.7%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [140] 43.5% ??? [146] 9.4% arrow-higher-order:lnp [149] 8.2% successfully-got-the-right-kind-of-function [150] 4.4% ------------------------------------------------------------------------------------------ f37 [109] 24.6% loop [123] 75.4% [131] 7152(4.6%) 0(0.0%) option-on-expr ...evelop/src/core/regimes.rkt:92:0 pick-errors [139] 64.2% sort-context-on-expr [143] 24.1% errors [79] 11.7% ------------------------------------------------------------------------------------------ taylor-exp [12] 11.3% taylor-invert [125] 40.0% hash-ref! [110] 48.7% [132] 2616(1.7%) 0(0.0%) simplify ...erbie/develop/src/core/reduce.rkt:15:0 f37 [109] 48.2% parse-loop12 [145] 38.5% debug7 [155] 13.3% ------------------------------------------------------------------------------------------ for-loop [50] 27.3% loop [123] 72.7% [133] 1354(0.9%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [144] 100.0% ------------------------------------------------------------------------------------------ map-enodes [18] 32.0% loop [123] 68.0% [134] 1014(0.7%) 324(0.2%) for-loop ...ie/develop/src/core/simplify.rkt:168:2 setfindf [147] 68.0% ------------------------------------------------------------------------------------------ loop [123] 32.8% map [116] 67.2% [135] 1012(0.7%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 f37 [109] 34.4% taylor [148] 32.8% map [116] 32.8% ------------------------------------------------------------------------------------------ hash-has-key? [124] 100.0% [136] 364(0.2%) 364(0.2%) ??? ...ects/racket/contract/private/hash.rkt:245:7 ------------------------------------------------------------------------------------------ make-multiplication-node [128] 100.0% [137] 300(0.2%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:229:0 group-by68 [151] 100.0% ------------------------------------------------------------------------------------------ loop! [129] 100.0% [138] 5712(3.7%) 1700(1.1%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [153] 64.5% for-loop [163] 5.7% ------------------------------------------------------------------------------------------ option-on-expr [131] 100.0% [139] 4590(3.0%) 0(0.0%) pick-errors .../develop/src/core/regimes.rkt:160:0 for-loop [152] 100.0% ------------------------------------------------------------------------------------------ ??? [130] 100.0% [140] 3218(2.1%) 1936(1.3%) for-loop ...acket/contract/private/list.rkt:743:12 for-loop [156] 39.8% ------------------------------------------------------------------------------------------ new-enode [126] 22.5% loop! [129] 77.5% [141] 3070(2.0%) 3070(2.0%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------------------ for-loop [101] 49.4% loop! [129] 50.6% [142] 2020(1.3%) 1684(1.1%) update-en-expr ...evelop/src/core/egraph.rkt:211:0 for-loop [159] 16.6% ------------------------------------------------------------------------------------------ option-on-expr [131] 100.0% [143] 1724(1.1%) 0(0.0%) sort-context-on-expr ...velop/src/points.rkt:115:0 ??? [154] 100.0% ------------------------------------------------------------------------------------------ foldl [133] 100.0% [144] 1354(0.9%) 1354(0.9%) merge2 .../herbie/develop/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------------------------ parse-loop12 [145] 16.4% hash-ref! [110] 24.8% simplify [132] 58.8% [145] 1340(0.9%) 666(0.4%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 parse-app [158] 25.5% loop [123] 24.8% parse-loop12 [145] 16.4% ------------------------------------------------------------------------------------------ ??? [130] 100.0% [146] 694(0.5%) 0(0.0%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [157] 100.0% ------------------------------------------------------------------------------------------ for-loop [134] 100.0% [147] 690(0.4%) 360(0.2%) setfindf ...es/herbie/develop/src/common.rkt:175:0 for-loop [160] 47.8% ------------------------------------------------------------------------------------------ f37 [109] 47.5% ??? [135] 52.5% [148] 632(0.4%) 0(0.0%) taylor ...herbie/develop/src/core/taylor.rkt:159:0 debug7 [155] 100.0% ------------------------------------------------------------------------------------------ ??? [130] 100.0% [149] 608(0.4%) 280(0.2%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ??? [161] 53.9% ------------------------------------------------------------------------------------------ ??? [130] 100.0% [150] 328(0.2%) 0(0.0%) successfully-got-the-right-kind-of-function ...9:4 arity-checking-wrapper [162] 100.0% ------------------------------------------------------------------------------------------ make-multiplication-subnode [137] 100.0% [151] 300(0.2%) 300(0.2%) group-by68 ...acket/collects/racket/list.rkt:749:0 ------------------------------------------------------------------------------------------ pick-errors [139] 100.0% [152] 4590(3.0%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:163:6 eval-prog [164] 93.9% ??? [174] 6.1% ------------------------------------------------------------------------------------------ custom-set-union [138] 100.0% [153] 3686(2.4%) 1328(0.9%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [165] 64.0% ------------------------------------------------------------------------------------------ sort-context-on-expr [143] 100.0% [154] 1724(1.1%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [166] 100.0% ------------------------------------------------------------------------------------------ simplify [132] 25.9% iterate-egraph!13 [3] 27.2% taylor [148] 47.0% [155] 1346(0.9%) 998(0.6%) debug7 ...tlies/herbie/develop/src/debug.rkt:102:0 return/no-unsupplied [180] 25.9% ------------------------------------------------------------------------------------------ for-loop [140] 100.0% [156] 1282(0.8%) 914(0.6%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [167] 28.7% ------------------------------------------------------------------------------------------ ??? [146] 100.0% [157] 694(0.5%) 694(0.5%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ------------------------------------------------------------------------------------------ parse-loop12 [145] 100.0% [158] 342(0.2%) 342(0.2%) parse-app .../collects/racket/private/kw.rkt:951:2 ------------------------------------------------------------------------------------------ update-en-expr [142] 100.0% [159] 336(0.2%) 336(0.2%) for-loop ...rbie/develop/src/core/egraph.rkt:213:6 ------------------------------------------------------------------------------------------ setfindf [147] 100.0% [160] 330(0.2%) 330(0.2%) for-loop ...es/herbie/develop/src/common.rkt:176:2 ------------------------------------------------------------------------------------------ arrow-higher-order:lnp [149] 100.0% [161] 328(0.2%) 328(0.2%) ??? ...et/contract/private/arity-checking.rkt:19:2 ------------------------------------------------------------------------------------------ successfully-got-the-right-kind-of-function [150]100.0% [162] 328(0.2%) 0(0.0%) arity-checking-wrapper ...w-higher-order.rkt:402:0 matches-arity-exactly? [168] 100.0% ------------------------------------------------------------------------------------------ custom-set-union [138] 100.0% [163] 326(0.2%) 326(0.2%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------------------ errors [79] 35.3% for-loop [152] 64.7% [164] 6666(4.3%) 4264(2.8%) eval-prog ...herbie/develop/src/programs.rkt:149:0 f37 [109] 31.1% ??? [171] 5.0% ------------------------------------------------------------------------------------------ for-loop [153] 100.0% [165] 2358(1.5%) 2358(1.5%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------------------ ??? [154] 100.0% [166] 1724(1.1%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [169] 82.5% loop [172] 17.5% ------------------------------------------------------------------------------------------ for-loop [156] 100.0% [167] 368(0.2%) 368(0.2%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ------------------------------------------------------------------------------------------ arity-checking-wrapper [162] 100.0% [168] 328(0.2%) 0(0.0%) matches-arity-exactly? ...te/arrow-common.rkt:70:0 procedure-arity [170] 100.0% ------------------------------------------------------------------------------------------ generic-sort/key [166] 28.2% copying-mergesort [169] 71.8% [169] 1422(0.9%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [169] 71.8% jloop [7] 15.4% loop [172] 12.8% ------------------------------------------------------------------------------------------ matches-arity-exactly? [168] 32.2% curry* [69] 67.8% [170] 1020(0.7%) 1020(0.7%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ------------------------------------------------------------------------------------------ eval-prog [164] 100.0% [171] 330(0.2%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack242 [173] 100.0% ------------------------------------------------------------------------------------------ generic-sort/key [166] 35.5% copying-mergesort [169] 64.5% [172] 850(0.6%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [174] 100.0% ------------------------------------------------------------------------------------------ ??? [171] 100.0% [173] 330(0.2%) 330(0.2%) unpack242 ...private/arrow-higher-order.rkt:354:44 ------------------------------------------------------------------------------------------ jloop [7] 1.1% for-loop [152] 1.1% map [116] 1.3% loop [172] 3.4% for-loop [90] 28.4% loop [123] 64.6% [174] 25082(16.3%) 1514(1.0%) ??? ...tlies/herbie/develop/src/programs.rkt:155:4 ??? [175] 55.1% ??? [176] 21.0% ->flonum [177] 14.4% loop [123] 3.4% ------------------------------------------------------------------------------------------ ??? [174] 100.0% [175] 13828(9.0%) 4296(2.8%) ??? ...acket/collects/racket/private/kw.rkt:444:14 bf* [179] 30.1% ??? [185] 17.2% ??? [181] 8.6% ??? [182] 6.5% ...higher-order.rkt:346:33 [183] 6.5% ------------------------------------------------------------------------------------------ loop [123] 14.1% ??? [174] 85.9% [176] 6128(4.0%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [178] 100.0% ------------------------------------------------------------------------------------------ for-loop [90] 4.8% jloop [7] 10.3% loop [123] 10.5% map [116] 12.3% ??? [174] 62.2% [177] 5806(3.8%) 3490(2.3%) ->flonum ...s/herbie/develop/src/programs.rkt:37:0 return/no-unsupplied [180] 25.1% ??? [188] 10.5% list-member? [184] 4.3% ------------------------------------------------------------------------------------------ ??? [176] 100.0% [178] 6128(4.0%) 3530(2.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [192] 42.4% ------------------------------------------------------------------------------------------ ??? [175] 100.0% [179] 4156(2.7%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [185] 100.0% ------------------------------------------------------------------------------------------ ??? [104] 12.9% flag-set? [88] 13.7% debug7 [155] 14.2% ->flonum [177] 59.2% [180] 2458(1.6%) 1792(1.2%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [187] 27.1% ------------------------------------------------------------------------------------------ ??? [175] 100.0% [181] 1194(0.8%) 936(0.6%) ??? ...herbie/develop/src/syntax/syntax.rkt:118:17 ??? [188] 21.6% ------------------------------------------------------------------------------------------ ??? [175] 100.0% [182] 902(0.6%) 902(0.6%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 ------------------------------------------------------------------------------------------ ??? [175] 100.0% [183] 900(0.6%) 618(0.4%) ...higher-order.rkt:346:33 (unknown source) ??? [186] 31.3% ------------------------------------------------------------------------------------------ ->flonum [177] 100.0% [184] 248(0.2%) 248(0.2%) list-member? ...llects/racket/private/set.rkt:24:0 ------------------------------------------------------------------------------------------ ??? [175] 36.4% bf* [179] 63.6% [185] 6536(4.2%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [189] 100.0% ------------------------------------------------------------------------------------------ ...higher-order.rkt:346:33 [183] 17.8% ??? [102] 82.2% [186] 1582(1.0%) 1000(0.6%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [102] 19.0% ??? [190] 17.8% ------------------------------------------------------------------------------------------ return/no-unsupplied [180] 49.9% for-loop [50] 50.1% [187] 1334(0.9%) 1334(0.9%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------------------ ??? [181] 21.4% ??? [104] 27.7% ->flonum [177] 50.8% [188] 1204(0.8%) 280(0.2%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [191] 49.0% ??? [190] 27.7% ------------------------------------------------------------------------------------------ ??? [185] 100.0% [189] 6536(4.2%) 3766(2.4%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [192] 42.4% ------------------------------------------------------------------------------------------ ??? [186] 15.6% ??? [102] 16.6% ??? [188] 18.5% ??? [42] 20.1% ??? [91] 29.1% [190] 1802(1.2%) 644(0.4%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [42] 29.1% dict? [193] 18.5% contract? [195] 16.6% ------------------------------------------------------------------------------------------ ??? [188] 100.0% [191] 590(0.4%) 258(0.2%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ??? [194] 56.3% ------------------------------------------------------------------------------------------ real->bigfloat [178] 48.4% bfmul [189] 51.6% [192] 5368(3.5%) 5368(3.5%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------------------------ ??? [190] 100.0% [193] 334(0.2%) 334(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------------------------ ??? [191] 100.0% [194] 332(0.2%) 332(0.2%) ??? ...ects/racket/contract/private/prop.rkt:256:4 ------------------------------------------------------------------------------------------ ??? [190] 100.0% [195] 300(0.2%) 300(0.2%) contract? ...acket/contract/private/guts.rkt:109:0 ------------------------------------------------------------------------------------------