Profiling results ----------------- Total cpu time observed: 84612ms (out of 85104ms) Number of samples taken: 263 (once every 322ms) (Hiding functions with self<1.0% and local<2.0%: 4 of 212 hidden) ================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ================================================================================== ??? [84] 100.0% [1] 84612(100.0%) 0(0.0%) profile-thunk16 ...e/pkgs/profile-lib/main.rkt:9:0 run [12] 100.0% ---------------------------------------------------------------------------------- ??? [84] 100.0% [2] 76082(89.9%) 0(0.0%) run-improve40 ...ie/develop/src/mainloop.rkt:336:0 for-loop [13] 100.0% ---------------------------------------------------------------------------------- matcher [72] 100.0% [3] 2150(2.5%) 0(0.0%) ??? .../herbie/develop/src/core/matcher.rkt:130:11 for-loop [14] 90.4% for-loop [20] 9.6% ---------------------------------------------------------------------------------- ??? [162] 100.0% [4] 1982(2.3%) 0(0.0%) approximate9 ...e/develop/src/core/taylor.rkt:12:0 loop [15] 100.0% ---------------------------------------------------------------------------------- hash-ref! [170] 100.0% [5] 1982(2.3%) 0(0.0%) simplify ...erbie/develop/src/core/reduce.rkt:16:0 parse-loop80 [17] 50.4% f67 [19] 49.6% ---------------------------------------------------------------------------------- hash-ref! [170] 100.0% [6] 1310(1.5%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:291:26 for-loop [18] 100.0% ---------------------------------------------------------------------------------- loop [194] 100.0% [7] 624(0.7%) 0(0.0%) expand-id-application-form17 (unknown source) syntax-e/no-taint [16] 100.0% ---------------------------------------------------------------------------------- for-loop [207] 48.9% loop [194] 51.1% [8] 610(0.7%) 0(0.0%) syntax-e (unknown source) syntax-e/no-taint [16] 100.0% ---------------------------------------------------------------------------------- hash-ref! [170] 100.0% [9] 360(0.4%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:301:23 for-loop [21] 100.0% ---------------------------------------------------------------------------------- for-loop [207] 100.0% [10] 334(0.4%) 0(0.0%) expand-implicit (unknown source) resolve+shift28 [202] 100.0% ---------------------------------------------------------------------------------- for-loop [63] 100.0% [11] 326(0.4%) 0(0.0%) for-loop ...rbie/develop/src/core/matcher.rkt:99:8 fix-up-variables [22] 100.0% ---------------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [12] 84612(100.0%) 0(0.0%) run ...et-7.0/share/pkgs/profile-lib/main.rkt:39:2 ??? [84] 100.0% ---------------------------------------------------------------------------------- run-improve40 [2] 100.0% [13] 76082(89.9%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:351:4 run-iter! [23] 100.0% ---------------------------------------------------------------------------------- ??? [3] 100.0% [14] 2150(2.5%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:132:15 matcher [72] 100.0% ---------------------------------------------------------------------------------- approximate9 [4] 100.0% [15] 1982(2.3%) 0(0.0%) loop ...es/herbie/develop/src/core/taylor.rkt:87:4 ??? [162] 100.0% ---------------------------------------------------------------------------------- gf [200] 21.1% syntax-e [8] 39.0% expand-id-application-form17 [7] 39.9% [16] 1564(1.8%) 0(0.0%) syntax-e/no-taint (unknown source) loop [194] 100.0% ---------------------------------------------------------------------------------- hash-ref! [170] 25.2% simplify [5] 74.8% [17] 1334(1.6%) 0(0.0%) parse-loop80 ...s/racket/match/compiler.rkt:418:15 eval-const-expr [24] 74.8% loop [139] 25.2% ---------------------------------------------------------------------------------- ??? [6] 100.0% [18] 1310(1.5%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:291:52 ??? [25] 50.4% hash-ref! [170] 49.6% ---------------------------------------------------------------------------------- simplify [5] 100.0% [19] 984(1.2%) 0(0.0%) f67 ...0/collects/racket/match/compiler.rkt:507:40 eval-const-expr [24] 100.0% ---------------------------------------------------------------------------------- ??? [3] 100.0% [20] 622(0.7%) 0(0.0%) for-loop ...bie/develop/src/core/matcher.rkt:106:4 foldl [148] 100.0% ---------------------------------------------------------------------------------- ??? [9] 100.0% [21] 360(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:304:27 hash-ref! [170] 100.0% ---------------------------------------------------------------------------------- for-loop [11] 100.0% [22] 326(0.4%) 0(0.0%) fix-up-variables ...lop/src/core/matcher.rkt:111:2 for-loop [26] 100.0% ---------------------------------------------------------------------------------- for-loop [13] 100.0% [23] 76082(89.9%) 0(0.0%) run-iter! ...herbie/develop/src/mainloop.rkt:317:0 simplify! [27] 80.5% finalize-iter! [28] 12.8% gen-rewrites! [29] 3.3% gen-series! [30] 2.6% localize! [31] 0.4% choose-best-alt! [32] 0.4% ---------------------------------------------------------------------------------- ??? [84] 14.3% f67 [19] 42.6% parse-loop80 [17] 43.2% [24] 2312(2.7%) 0(0.0%) eval-const-expr .../develop/src/programs.rkt:149:0 eval-prog [80] 100.0% ---------------------------------------------------------------------------------- for-loop [18] 100.0% [25] 660(0.8%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:294:19 hash-ref! [170] 100.0% ---------------------------------------------------------------------------------- fix-up-variables [22] 100.0% [26] 326(0.4%) 0(0.0%) for-loop ...rbie/develop/src/core/matcher.rkt:42:9 pattern-match [33] 100.0% ---------------------------------------------------------------------------------- run-iter! [23] 100.0% [27] 61230(72.4%) 0(0.0%) simplify! ...herbie/develop/src/mainloop.rkt:213:0 ??? [34] 98.9% for-loop [39] 0.5% for-loop [41] 0.5% ---------------------------------------------------------------------------------- run-iter! [23] 100.0% [28] 9718(11.5%) 0(0.0%) finalize-iter! ...e/develop/src/mainloop.rkt:268:0 ??? [43] 100.0% ---------------------------------------------------------------------------------- run-iter! [23] 100.0% [29] 2484(2.9%) 0(0.0%) gen-rewrites! ...ie/develop/src/mainloop.rkt:172:0 for-loop [35] 86.6% for-loop [40] 13.4% ---------------------------------------------------------------------------------- run-iter! [23] 100.0% [30] 1982(2.3%) 0(0.0%) gen-series! ...rbie/develop/src/mainloop.rkt:149:0 for-loop [36] 100.0% ---------------------------------------------------------------------------------- run-iter! [23] 100.0% [31] 336(0.4%) 0(0.0%) localize! ...herbie/develop/src/mainloop.rkt:116:0 localize-error [38] 100.0% ---------------------------------------------------------------------------------- run-iter! [23] 100.0% [32] 332(0.4%) 0(0.0%) choose-best-alt! ...develop/src/mainloop.rkt:107:0 ??? [43] 100.0% ---------------------------------------------------------------------------------- for-loop [26] 100.0% [33] 326(0.4%) 0(0.0%) pattern-match ...develop/src/core/matcher.rkt:30:0 variable? [37] 100.0% ---------------------------------------------------------------------------------- simplify! [27] 100.0% [34] 60576(71.6%) 0(0.0%) ??? ...s/herbie/develop/src/core/simplify.rkt:26:0 one-iter [50] 59.0% for-loop [42] 27.5% loop [44] 12.4% loop [139] 1.0% ---------------------------------------------------------------------------------- gen-rewrites! [29] 100.0% [35] 2150(2.5%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:180:11 rewrite-expression-head20 [45] 100.0% ---------------------------------------------------------------------------------- gen-series! [30] 100.0% [36] 1982(2.3%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:156:7 taylor-alt [46] 100.0% ---------------------------------------------------------------------------------- for-loop [63] 15.6% substitute-e [97] 16.3% pattern-match [33] 17.6% match-e [85] 50.5% [37] 1854(2.2%) 0(0.0%) variable? .../develop/src/syntax/syntax.rkt:1159:0 ??? [43] 100.0% ---------------------------------------------------------------------------------- localize! [31] 100.0% [38] 336(0.4%) 0(0.0%) localize-error ...velop/src/core/localize.rkt:52:0 hash-ref! [170] 100.0% ---------------------------------------------------------------------------------- simplify! [27] 100.0% [39] 336(0.4%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:252:6 for-loop [47] 100.0% ---------------------------------------------------------------------------------- gen-rewrites! [29] 100.0% [40] 334(0.4%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:197:4 for-loop [48] 100.0% ---------------------------------------------------------------------------------- simplify! [27] 100.0% [41] 318(0.4%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:218:6 debug-print [49] 100.0% ---------------------------------------------------------------------------------- ??? [34] 100.0% [42] 16688(19.7%) 0(0.0%) for-loop ...bie/develop/src/core/simplify.rkt:33:2 one-iter [50] 100.0% ---------------------------------------------------------------------------------- choose-best-alt! [32] 2.6% match-e [85] 7.3% variable? [37] 14.4% finalize-iter! [28] 75.7% [43] 12836(15.2%) 2786(3.3%) ??? ...contract/private/arrow-val-first.rkt:388:18 for-loop [51] 75.7% ??? [55] 2.6% ---------------------------------------------------------------------------------- ??? [34] 100.0% [44] 7504(8.9%) 356(0.4%) loop ...herbie/develop/src/core/simplify.rkt:143:2 for-loop [52] 95.3% ---------------------------------------------------------------------------------- for-loop [35] 100.0% [45] 2150(2.5%) 0(0.0%) rewrite-expression-head20 ...core/matcher.rkt:87:0 rewriter [53] 100.0% ---------------------------------------------------------------------------------- for-loop [36] 100.0% [46] 1982(2.3%) 0(0.0%) taylor-alt ...erbie/develop/src/mainloop.rkt:135:0 for-loop [54] 100.0% ---------------------------------------------------------------------------------- for-loop [39] 100.0% [47] 336(0.4%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:253:8 expression-cost [71] 100.0% ---------------------------------------------------------------------------------- for-loop [40] 100.0% [48] 334(0.4%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:198:6 ??? [162] 100.0% ---------------------------------------------------------------------------------- for-loop [41] 100.0% [49] 318(0.4%) 0(0.0%) debug-print .../herbie/develop/src/debug.rkt:110:0 for-loop [56] 100.0% ---------------------------------------------------------------------------------- for-loop [42] 31.8% ??? [34] 68.2% [50] 52436(62.0%) 0(0.0%) one-iter ...bie/develop/src/core/simplify.rkt:86:0 find-matches [57] 43.5% for-loop [58] 42.9% for-loop [60] 13.6% ---------------------------------------------------------------------------------- ??? [43] 100.0% [51] 9718(11.5%) 0(0.0%) for-loop ...ie/develop/src/core/alt-table.rkt:56:2 atab-add-altn [59] 86.8% loop [64] 13.2% ---------------------------------------------------------------------------------- loop [44] 100.0% [52] 7148(8.4%) 302(0.4%) for-loop ...ie/develop/src/core/simplify.rkt:149:4 loop [61] 38.2% argmin [62] 31.2% for-loop [65] 9.3% expression-cost [71] 8.6% for-loop [82] 4.3% make-sequence [98] 4.2% ---------------------------------------------------------------------------------- rewrite-expression-head20 [45] 32.2% matcher [72] 67.8% [53] 2150(2.5%) 0(0.0%) rewriter ...rbie/develop/src/core/matcher.rkt:89:2 for-loop [63] 90.3% *rules* [66] 9.7% ---------------------------------------------------------------------------------- taylor-alt [46] 100.0% [54] 1982(2.3%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:141:6 ??? [162] 100.0% ---------------------------------------------------------------------------------- ??? [43] 100.0% [55] 332(0.4%) 0(0.0%) ??? .../herbie/develop/src/core/alt-table.rkt:59:0 ??? [162] 100.0% ---------------------------------------------------------------------------------- debug-print [49] 100.0% [56] 318(0.4%) 318(0.4%) for-loop ...ies/herbie/develop/src/debug.rkt:116:2 ---------------------------------------------------------------------------------- one-iter [50] 100.0% [57] 22826(27.0%) 0(0.0%) find-matches ...develop/src/core/simplify.rkt:56:0 for-loop [67] 100.0% ---------------------------------------------------------------------------------- one-iter [50] 100.0% [58] 22502(26.6%) 300(0.4%) for-loop ...bie/develop/src/core/simplify.rkt:95:2 loop [68] 70.4% update-leader! [104] 28.2% ---------------------------------------------------------------------------------- for-loop [51] 100.0% [59] 8432(10.0%) 326(0.4%) atab-add-altn ...elop/src/core/alt-table.rkt:202:0 errors [69] 96.1% ---------------------------------------------------------------------------------- one-iter [50] 100.0% [60] 7108(8.4%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:111:2 set-precompute! [70] 100.0% ---------------------------------------------------------------------------------- for-loop [52] 100.0% [61] 2730(3.2%) 0(0.0%) loop .../racket-7.0/collects/racket/list.rkt:751:4 expression-cost [71] 100.0% ---------------------------------------------------------------------------------- for-loop [52] 100.0% [62] 2228(2.6%) 0(0.0%) argmin ...acket-7.0/collects/racket/list.rkt:765:0 for-loop [82] 57.9% expression-cost [71] 42.1% ---------------------------------------------------------------------------------- rewriter [53] 100.0% [63] 2150(2.5%) 0(0.0%) for-loop ...rbie/develop/src/core/matcher.rkt:91:4 matcher [72] 87.1% for-loop [11] 5.1% variable? [37] 4.5% ??? [188] 3.3% ---------------------------------------------------------------------------------- for-loop [51] 100.0% [64] 1286(1.5%) 0(0.0%) loop ...erbie/develop/src/core/alt-table.rkt:176:2 loop [74] 26.9% map [122] 26.1% loop [139] 23.6% argmax [76] 23.3% ---------------------------------------------------------------------------------- for-loop [52] 100.0% [65] 668(0.8%) 0(0.0%) for-loop ...e/develop/src/core/simplify.rkt:153:16 for-loop [73] 100.0% ---------------------------------------------------------------------------------- rewriter [53] 100.0% [66] 624(0.7%) 324(0.4%) *rules* ...rbie/develop/src/syntax/rules.rkt:783:0 for-loop [75] 48.1% ---------------------------------------------------------------------------------- for-loop [67] 48.0% find-matches [57] 52.0% [67] 22826(27.0%) 5178(6.1%) for-loop ...bie/develop/src/core/simplify.rkt:58:8 for-loop [67] 48.0% match-e [85] 38.7% ---------------------------------------------------------------------------------- for-loop [58] 100.0% [68] 15848(18.7%) 0(0.0%) loop ...herbie/develop/src/core/simplify.rkt:100:4 apply-match [77] 100.0% ---------------------------------------------------------------------------------- ??? [84] 3.3% ??? [196] 3.8% atab-add-altn [59] 92.9% [69] 8730(10.3%) 0(0.0%) errors ...lies/herbie/develop/src/points.rkt:228:0 for-loop [79] 67.7% eval-prog [80] 32.3% ---------------------------------------------------------------------------------- for-loop [60] 100.0% [70] 7108(8.4%) 298(0.4%) set-precompute! ...lop/src/core/simplify.rkt:117:0 for-loop [78] 95.8% ---------------------------------------------------------------------------------- for-loop [47] 7.3% for-loop [52] 13.3% argmin [62] 20.3% loop [61] 59.1% [71] 4616(5.5%) 0(0.0%) expression-cost .../develop/src/programs.rkt:204:0 compile [81] 100.0% ---------------------------------------------------------------------------------- for-loop [14] 47.1% for-loop [63] 52.9% [72] 2150(2.5%) 0(0.0%) matcher ...rbie/develop/src/core/matcher.rkt:118:2 ??? [3] 52.9% rewriter [53] 47.1% ---------------------------------------------------------------------------------- for-loop [65] 100.0% [73] 668(0.8%) 668(0.8%) for-loop ...e/develop/src/core/simplify.rkt:157:23 ---------------------------------------------------------------------------------- loop [64] 100.0% [74] 346(0.4%) 346(0.4%) loop ...-7.0/collects/racket/private/hash.rkt:20:4 ---------------------------------------------------------------------------------- *rules* [66] 100.0% [75] 300(0.4%) 0(0.0%) for-loop ...ies/herbie/develop/src/common.rkt:71:9 ormap [83] 100.0% ---------------------------------------------------------------------------------- loop [64] 100.0% [76] 300(0.4%) 0(0.0%) argmax ...acket-7.0/collects/racket/list.rkt:766:0 for-loop [82] 100.0% ---------------------------------------------------------------------------------- loop [68] 100.0% [77] 15848(18.7%) 0(0.0%) apply-match .../develop/src/core/simplify.rkt:65:0 for-loop [86] 74.1% match-e [85] 24.0% custom-set-intersect [91] 1.9% ---------------------------------------------------------------------------------- set-precompute! [70] 100.0% [78] 6810(8.0%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:119:2 merge-egraph-nodes! [93] 85.8% setfindf [89] 9.3% ??? [84] 4.8% ---------------------------------------------------------------------------------- errors [69] 100.0% [79] 5906(7.0%) 1212(1.4%) for-loop ...es/herbie/develop/src/points.rkt:230:2 ??? [84] 79.5% ---------------------------------------------------------------------------------- eval-const-expr [24] 45.0% errors [69] 55.0% [80] 5136(6.1%) 0(0.0%) eval-prog ...herbie/develop/src/programs.rkt:130:0 temp68_2 [87] 87.7% loop [194] 12.3% ---------------------------------------------------------------------------------- expression-cost [71] 100.0% [81] 4616(5.5%) 298(0.4%) compile ...s/herbie/develop/src/programs.rkt:181:0 hash-ref! [170] 93.5% ---------------------------------------------------------------------------------- argmax [76] 15.8% for-loop [52] 16.3% argmin [62] 67.9% [82] 1900(2.2%) 0(0.0%) for-loop .../herbie/develop/src/programs.rkt:205:2 table-ref [88] 100.0% ---------------------------------------------------------------------------------- for-loop [75] 100.0% [83] 300(0.4%) 0(0.0%) ormap ....0/collects/racket/private/map.rkt:141:13 flag-set? [90] 100.0% ---------------------------------------------------------------------------------- for-loop [78] 0.1% for-loop [79] 1.8% run [12] 49.0% [84] 84612(100.0%) 300(0.4%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 49.0% run-improve40 [2] 44.0% prepare-points-intervals [94] 3.8% ??? [155] 0.9% oracle-error [96] 0.7% ulp-difference [156] 0.6% ??? [162] 0.3% eval-errors [102] 0.2% get-final-combination [103] 0.2% eval-const-expr [24] 0.1% errors [69] 0.1% ---------------------------------------------------------------------------------- apply-match [77] 9.4% for-loop [105] 17.5% for-loop [67] 73.1% [85] 21450(25.4%) 4152(4.9%) match-e ...herbie/develop/src/core/ematch.rkt:39:0 for-loop [92] 76.2% make-sequence [98] 2.1% ??? [43] 1.7% variable? [37] 1.5% ---------------------------------------------------------------------------------- apply-match [77] 100.0% [86] 11746(13.9%) 0(0.0%) for-loop ...bie/develop/src/core/simplify.rkt:78:2 merge-egraph-nodes! [93] 86.7% substitute-e [97] 10.6% dedup-children! [121] 2.6% ---------------------------------------------------------------------------------- eval-prog [80] 100.0% [87] 4506(5.3%) 0(0.0%) temp68_2 (unknown source) compile16 [95] 100.0% ---------------------------------------------------------------------------------- for-loop [82] 100.0% [88] 1900(2.2%) 1598(1.9%) table-ref ...es/herbie/develop/src/common.rkt:42:0 for-loop [100] 15.9% ---------------------------------------------------------------------------------- for-loop [78] 100.0% [89] 634(0.7%) 0(0.0%) setfindf ...es/herbie/develop/src/common.rkt:139:0 for-loop [99] 100.0% ---------------------------------------------------------------------------------- ormap [83] 100.0% [90] 300(0.4%) 300(0.4%) flag-set? ...es/herbie/develop/src/config.rkt:28:0 ---------------------------------------------------------------------------------- apply-match [77] 100.0% [91] 300(0.4%) 0(0.0%) custom-set-intersect ...rivate/set-types.rkt:195:0 for-loop [101] 100.0% ---------------------------------------------------------------------------------- match-e [85] 100.0% [92] 17674(20.9%) 8576(10.1%) for-loop ...rbie/develop/src/core/ematch.rkt:52:11 for-loop [105] 41.2% foldr [109] 6.1% cartesian-product [112] 4.4% loop [139] 3.6% foldl [148] 2.6% ---------------------------------------------------------------------------------- for-loop [108] 4.1% merge-egraph-nodes! [93] 4.2% for-loop [78] 35.1% for-loop [86] 56.6% [93] 16034(19.0%) 0(0.0%) merge-egraph-nodes! ...p/src/core/egraph.rkt:145:0 update-leader! [104] 80.2% for-loop [108] 7.8% merge-egraph-nodes! [93] 4.2% enode-merge! [113] 3.7% loop! [149] 3.0% dedup-children! [121] 1.0% ---------------------------------------------------------------------------------- ??? [84] 100.0% [94] 6380(7.5%) 0(0.0%) prepare-points-intervals ...p/src/points.rkt:133:0 loop [106] 100.0% ---------------------------------------------------------------------------------- temp68_2 [87] 100.0% [95] 4506(5.3%) 0(0.0%) compile16 (unknown source) temp74_0 [107] 100.0% ---------------------------------------------------------------------------------- ??? [84] 100.0% [96] 1266(1.5%) 0(0.0%) oracle-error ...erbie/develop/src/points.rkt:212:0 for-loop [110] 100.0% ---------------------------------------------------------------------------------- for-loop [111] 25.2% for-loop [86] 74.8% [97] 1248(1.5%) 328(0.4%) substitute-e ...e/develop/src/core/ematch.rkt:64:0 for-loop [111] 74.8% variable? [37] 12.1% ---------------------------------------------------------------------------------- for-loop [52] 33.0% match-e [85] 67.0% [98] 904(1.1%) 904(1.1%) make-sequence ...ects/racket/private/for.rkt:528:2 ---------------------------------------------------------------------------------- setfindf [89] 100.0% [99] 634(0.7%) 634(0.7%) for-loop ...es/herbie/develop/src/common.rkt:140:2 ---------------------------------------------------------------------------------- table-ref [88] 100.0% [100] 302(0.4%) 302(0.4%) for-loop ...ies/herbie/develop/src/common.rkt:44:4 ---------------------------------------------------------------------------------- custom-set-intersect [91] 100.0% [101] 300(0.4%) 0(0.0%) for-loop ...cts/racket/private/set-types.rkt:207:3 for-loop [114] 100.0% ---------------------------------------------------------------------------------- ??? [84] 100.0% [102] 296(0.3%) 0(0.0%) eval-errors ...herbie/develop/src/points.rkt:203:0 for-loop [115] 100.0% ---------------------------------------------------------------------------------- ??? [84] 100.0% [103] 296(0.3%) 0(0.0%) get-final-combination ...op/src/mainloop.rkt:357:0 infer-splitpoints [116] 100.0% ---------------------------------------------------------------------------------- for-loop [58] 31.9% merge-egraph-nodes! [93] 68.1% [104] 19930(23.6%) 0(0.0%) update-leader! ...evelop/src/core/egraph.rkt:213:0 for-loop [117] 100.0% ---------------------------------------------------------------------------------- for-loop [92] 100.0% [105] 9088(10.7%) 656(0.8%) for-loop ...rbie/develop/src/core/ematch.rkt:58:37 match-e [85] 75.8% ??? [120] 16.9% ---------------------------------------------------------------------------------- prepare-points-intervals [94] 100.0% [106] 6380(7.5%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:145:4 loop [118] 100.0% ---------------------------------------------------------------------------------- compile16 [95] 100.0% [107] 4506(5.3%) 0(0.0%) temp74_0 (unknown source) expand-single [119] 92.6% compile-top9 [125] 7.4% ---------------------------------------------------------------------------------- merge-egraph-nodes! [93] 100.0% [108] 2220(2.6%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:199:4 merge-egraph-nodes! [93] 73.0% dedup-children! [121] 27.0% ---------------------------------------------------------------------------------- for-loop [92] 100.0% [109] 1552(1.8%) 900(1.1%) foldr ....0/collects/racket/private/list.rkt:242:4 cp-2 [123] 42.0% ---------------------------------------------------------------------------------- oracle-error [96] 100.0% [110] 1266(1.5%) 0(0.0%) for-loop ...es/herbie/develop/src/points.rkt:213:2 loop [139] 74.4% map [122] 25.6% ---------------------------------------------------------------------------------- substitute-e [97] 100.0% [111] 1248(1.5%) 0(0.0%) for-loop ...rbie/develop/src/core/ematch.rkt:73:24 substitute-e [97] 50.5% mk-enode! [124] 49.5% ---------------------------------------------------------------------------------- for-loop [92] 100.0% [112] 930(1.1%) 930(1.1%) cartesian-product ...ollects/racket/list.rkt:822:0 ---------------------------------------------------------------------------------- merge-egraph-nodes! [93] 100.0% [113] 600(0.7%) 0(0.0%) enode-merge! ...e/develop/src/core/enode.rkt:128:0 custom-set-intersect! [126] 50.0% adopt-enode! [127] 50.0% ---------------------------------------------------------------------------------- for-loop [101] 100.0% [114] 300(0.4%) 300(0.4%) for-loop ...cts/racket/private/set-types.rkt:201:4 ---------------------------------------------------------------------------------- eval-errors [102] 100.0% [115] 296(0.3%) 0(0.0%) for-loop ...es/herbie/develop/src/points.rkt:205:2 ??? [162] 100.0% ---------------------------------------------------------------------------------- get-final-combination [103] 100.0% [116] 296(0.3%) 0(0.0%) infer-splitpoints ...lop/src/core/regimes.rkt:34:0 for-loop [128] 100.0% ---------------------------------------------------------------------------------- update-leader! [104] 100.0% [117] 19930(23.6%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:218:6 hash-update! [138] 50.4% for-loop [129] 49.6% ---------------------------------------------------------------------------------- loop [106] 100.0% [118] 6380(7.5%) 580(0.7%) loop ...htlies/herbie/develop/src/points.rkt:104:2 ??? [155] 86.4% ??? [162] 4.5% ---------------------------------------------------------------------------------- temp74_0 [107] 100.0% [119] 4174(4.9%) 0(0.0%) expand-single (unknown source) expand-capturing-lifts [130] 100.0% ---------------------------------------------------------------------------------- for-loop [105] 100.0% [120] 1540(1.8%) 314(0.4%) ??? ...ies/herbie/develop/src/core/ematch.rkt:43:5 for-loop [131] 79.6% ---------------------------------------------------------------------------------- for-loop [86] 25.0% merge-egraph-nodes! [93] 26.7% for-loop [108] 48.3% [121] 1242(1.5%) 0(0.0%) dedup-children! ...evelop/src/core/enode.rkt:199:0 loop [132] 73.3% loop [134] 26.7% ---------------------------------------------------------------------------------- for-loop [110] 49.1% loop [64] 50.9% [122] 660(0.8%) 0(0.0%) map ...t-7.0/collects/racket/private/map.rkt:35:13 loop [139] 100.0% ---------------------------------------------------------------------------------- foldr [109] 100.0% [123] 652(0.8%) 0(0.0%) cp-2 .../racket-7.0/collects/racket/list.rkt:826:2 for-loop [133] 100.0% ---------------------------------------------------------------------------------- for-loop [111] 100.0% [124] 618(0.7%) 298(0.4%) mk-enode! ...rbie/develop/src/core/egraph.rkt:99:0 mutable-set [136] 51.8% ---------------------------------------------------------------------------------- temp74_0 [107] 100.0% [125] 332(0.4%) 0(0.0%) compile-top9 (unknown source) compile-forms31 [135] 100.0% ---------------------------------------------------------------------------------- enode-merge! [113] 100.0% [126] 300(0.4%) 300(0.4%) custom-set-intersect! ...ivate/set-types.rkt:269:0 ---------------------------------------------------------------------------------- enode-merge! [113] 100.0% [127] 300(0.4%) 300(0.4%) adopt-enode! ...e/develop/src/core/enode.rkt:104:0 ---------------------------------------------------------------------------------- infer-splitpoints [116] 100.0% [128] 296(0.3%) 0(0.0%) for-loop ...rbie/develop/src/core/regimes.rkt:46:6 option-on-expr [137] 100.0% ---------------------------------------------------------------------------------- for-loop [117] 100.0% [129] 9894(11.7%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:219:8 hash-update! [138] 100.0% ---------------------------------------------------------------------------------- loop [194] 13.1% expand-single [119] 86.9% [130] 4804(5.7%) 0(0.0%) expand-capturing-lifts (unknown source) lambda-clause-expander [140] 79.9% dispatch-transformer41 [141] 20.1% ---------------------------------------------------------------------------------- ??? [120] 100.0% [131] 1226(1.4%) 1226(1.4%) for-loop ...erbie/develop/src/core/ematch.rkt:44:7 ---------------------------------------------------------------------------------- dedup-children! [121] 26.1% loop [132] 73.9% [132] 910(1.1%) 0(0.0%) loop ...racket-7.0/collects/racket/list.rkt:417:34 loop [132] 73.9% member [142] 17.6% loop [194] 8.5% ---------------------------------------------------------------------------------- cp-2 [123] 100.0% [133] 652(0.8%) 652(0.8%) for-loop ...ket-7.0/collects/racket/list.rkt:827:4 ---------------------------------------------------------------------------------- loop [134] 50.0% dedup-children! [121] 50.0% [134] 332(0.4%) 332(0.4%) loop ...racket-7.0/collects/racket/list.rkt:434:17 loop [134] 50.0% ---------------------------------------------------------------------------------- compile-top9 [125] 100.0% [135] 332(0.4%) 0(0.0%) compile-forms31 (unknown source) serialize-phase-to-link-module-uses [143]100.0% ---------------------------------------------------------------------------------- mk-enode! [124] 100.0% [136] 320(0.4%) 0(0.0%) mutable-set .../racket/private/set-types.rkt:999:0 for-loop [144] 100.0% ---------------------------------------------------------------------------------- for-loop [128] 100.0% [137] 296(0.3%) 0(0.0%) option-on-expr ...velop/src/core/regimes.rkt:150:0 loop [139] 100.0% ---------------------------------------------------------------------------------- for-loop [129] 49.6% for-loop [117] 50.4% [138] 19930(23.6%) 0(0.0%) hash-update! ...cket/private/more-scheme.rkt:365:4 ??? [145] 100.0% ---------------------------------------------------------------------------------- loop [64] 0.2% parse-loop80 [17] 0.6% option-on-expr [137] 0.7% loop! [149] 5.8% ??? [34] 7.1% map [122] 9.8% for-loop [92] 10.6% for-loop [110] 14.0% loop [139] 51.2% [139] 4428(5.2%) 614(0.7%) loop ...-7.0/collects/racket/private/map.rkt:40:19 loop [139] 51.2% ??? [150] 10.2% point-error [152] 7.3% loop [153] 7.0% loop! [149] 5.8% ulp-difference [156] 3.8% foldl [148] 3.6% ??? [151] 2.5% ??? [155] 0.7% hash-ref! [170] 0.4% ---------------------------------------------------------------------------------- expand-capturing-lifts [130] 100.0% [140] 3838(4.5%) 0(0.0%) lambda-clause-expander (unknown source) finish-bodys [146] 67.2% loop [194] 25.0% for-loop [207] 7.8% ---------------------------------------------------------------------------------- loop [194] 27.8% for-loop [207] 29.9% expand-capturing-lifts [130] 42.3% [141] 2286(2.7%) 0(0.0%) dispatch-transformer41 (unknown source) apply-transformer52 [147] 100.0% ---------------------------------------------------------------------------------- loop [132] 100.0% [142] 600(0.7%) 600(0.7%) member (unknown source) ---------------------------------------------------------------------------------- compile-forms31 [135] 100.0% [143] 332(0.4%) 332(0.4%) serialize-phase-to-link-module-uses ...own source) ---------------------------------------------------------------------------------- mutable-set [136] 100.0% [144] 320(0.4%) 320(0.4%) for-loop ...cts/racket/private/set-types.rkt:943:2 ---------------------------------------------------------------------------------- hash-update! [138] 100.0% [145] 19930(23.6%) 668(0.8%) ??? ...s/herbie/develop/src/core/egraph.rkt:221:24 for-loop [154] 96.6% ---------------------------------------------------------------------------------- lambda-clause-expander [140] 29.0% for-loop [207] 71.0% [146] 2578(3.0%) 0(0.0%) finish-bodys (unknown source) for-loop [207] 100.0% ---------------------------------------------------------------------------------- dispatch-transformer41 [141] 100.0% [147] 2286(2.7%) 0(0.0%) apply-transformer52 (unknown source) apply-transformer-in-context [157] 58.3% loop [194] 27.3% apply-post-expansion [160] 14.4% ---------------------------------------------------------------------------------- loop [139] 20.2% for-loop [20] 39.6% for-loop [92] 40.2% [148] 1572(1.9%) 950(1.1%) foldl ....0/collects/racket/private/list.rkt:229:4 ??? [159] 39.6% ---------------------------------------------------------------------------------- loop [139] 33.8% merge-egraph-nodes! [93] 66.2% [149] 926(1.1%) 298(0.4%) loop! ...s/herbie/develop/src/core/enode.rkt:191:2 custom-set-union [158] 50.1% loop [139] 33.8% ---------------------------------------------------------------------------------- loop [139] 100.0% [150] 606(0.7%) 0(0.0%) ??? ...htlies/herbie/develop/src/points.rkt:214:26 ??? [155] 100.0% ---------------------------------------------------------------------------------- loop [139] 100.0% [151] 336(0.4%) 336(0.4%) ??? ...erbie/develop/src/core/alt-table.rkt:193:30 ---------------------------------------------------------------------------------- loop [139] 100.0% [152] 324(0.4%) 0(0.0%) point-error ...herbie/develop/src/points.rkt:195:0 ulp-difference [156] 100.0% ---------------------------------------------------------------------------------- loop [139] 100.0% [153] 310(0.4%) 310(0.4%) loop ...cket-7.0/collects/racket/function.rkt:53:6 ---------------------------------------------------------------------------------- ??? [145] 100.0% [154] 19262(22.8%) 16794(19.8%) for-loop ...bie/develop/src/core/egraph.rkt:222:26 update-en-expr [163] 12.8% ---------------------------------------------------------------------------------- loop [139] 3.4% ??? [150] 7.0% ??? [84] 25.7% loop [118] 63.8% [155] 8636(10.2%) 336(0.4%) ??? ...tlies/herbie/develop/src/programs.rkt:146:2 ??? [161] 78.9% ??? [162] 13.8% ??? [169] 3.4% ---------------------------------------------------------------------------------- point-error [152] 14.7% loop [139] 15.3% ??? [84] 70.0% [156] 2198(2.6%) 1862(2.2%) ulp-difference ...erbie/develop/src/float.rkt:14:0 return/no-unsupplied [187] 15.3% ---------------------------------------------------------------------------------- apply-transformer52 [147] 100.0% [157] 1332(1.6%) 0(0.0%) apply-transformer-in-context (unknown source) parse-app [164] 51.4% parse-lambda [167] 25.2% ??? [168] 23.4% ---------------------------------------------------------------------------------- loop! [149] 100.0% [158] 628(0.7%) 0(0.0%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [165] 100.0% ---------------------------------------------------------------------------------- foldl [148] 100.0% [159] 622(0.7%) 0(0.0%) ??? ...es/herbie/develop/src/core/matcher.rkt:26:7 core651 [166] 100.0% ---------------------------------------------------------------------------------- apply-transformer52 [147] 100.0% [160] 330(0.4%) 0(0.0%) apply-post-expansion (unknown source) gf [200] 100.0% ---------------------------------------------------------------------------------- ??? [155] 100.0% [161] 6816(8.1%) 1268(1.5%) ??? ...t-7.0/collects/racket/private/kw.rkt:592:14 ??? [171] 76.5% ??? [177] 4.9% ---------------------------------------------------------------------------------- loop [118] 5.7% for-loop [115] 5.9% ??? [55] 6.6% for-loop [48] 6.6% ??? [84] 12.6% loop [15] 13.1% location-do [172] 13.1% for-loop [54] 13.1% ??? [155] 23.5% [162] 5054(6.0%) 638(0.8%) ??? ...tract/private/arrow-higher-order.rkt:357:33 ->flonum [173] 29.0% location-do [172] 13.1% approximate9 [4] 13.1% hash-ref! [170] 13.1% ??? [176] 6.6% best-alt [178] 6.6% mk-ival [180] 5.9% ---------------------------------------------------------------------------------- for-loop [154] 100.0% [163] 2468(2.9%) 2468(2.9%) update-en-expr ...evelop/src/core/egraph.rkt:207:0 ---------------------------------------------------------------------------------- apply-transformer-in-context [157] 100.0% [164] 684(0.8%) 684(0.8%) parse-app ...collects/racket/private/kw.rkt:1105:2 ---------------------------------------------------------------------------------- custom-set-union [158] 100.0% [165] 628(0.7%) 0(0.0%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [174] 100.0% ---------------------------------------------------------------------------------- ??? [159] 100.0% [166] 622(0.7%) 0(0.0%) core651 ...acket/contract/private/arr-i.rkt:918:19 un-dep/maybe-chaperone [175] 100.0% ---------------------------------------------------------------------------------- apply-transformer-in-context [157] 100.0% [167] 336(0.4%) 336(0.4%) parse-lambda ...llects/racket/private/kw.rkt:585:2 ---------------------------------------------------------------------------------- apply-transformer-in-context [157] 100.0% [168] 312(0.4%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [179] 100.0% ---------------------------------------------------------------------------------- ??? [155] 100.0% [169] 296(0.3%) 296(0.3%) ??? ...ects/racket/contract/private/prop.rkt:519:4 ---------------------------------------------------------------------------------- for-loop [21] 1.1% localize-error [38] 1.7% ??? [25] 2.2% for-loop [18] 2.4% loop [139] 3.4% ??? [185] 6.8% ??? [184] 8.0% ??? [162] 8.0% ??? [181] 25.9% compile [81] 39.2% [170] 6636(7.8%) 4318(5.1%) hash-ref! .../racket/private/more-scheme.rkt:376:2 ??? [181] 25.9% ??? [184] 8.0% simplify [5] 8.0% ??? [185] 6.8% parse-loop80 [17] 5.1% ??? [6] 4.7% ??? [9] 1.1% ---------------------------------------------------------------------------------- ??? [161] 100.0% [171] 5214(6.2%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:361:33 ival-sub [182] 42.9% ival-div [183] 38.4% ival-add [186] 18.6% ---------------------------------------------------------------------------------- location-do [172] 17.3% ??? [162] 82.7% [172] 1982(2.3%) 0(0.0%) location-do ...rbie/develop/src/programs.rkt:111:0 ??? [162] 82.7% location-do [172] 17.3% ---------------------------------------------------------------------------------- ??? [162] 100.0% [173] 1468(1.7%) 1172(1.4%) ->flonum ...s/herbie/develop/src/programs.rkt:38:0 return/no-unsupplied [187] 20.2% ---------------------------------------------------------------------------------- for-loop [165] 100.0% [174] 628(0.7%) 628(0.7%) for-loop ...cts/racket/private/set-types.rkt:178:5 ---------------------------------------------------------------------------------- core651 [166] 100.0% [175] 622(0.7%) 298(0.4%) un-dep/maybe-chaperone ...private/arr-i.rkt:1097:2 ??? [190] 52.1% ---------------------------------------------------------------------------------- ??? [162] 100.0% [176] 334(0.4%) 0(0.0%) ??? ...cts/racket/contract/private/list.rkt:209:10 ??? [188] 100.0% ---------------------------------------------------------------------------------- ??? [161] 100.0% [177] 334(0.4%) 0(0.0%) ??? ...herbie/develop/src/syntax/syntax.rkt:317:17 return/no-unsupplied [187] 100.0% ---------------------------------------------------------------------------------- ??? [162] 100.0% [178] 332(0.4%) 0(0.0%) best-alt .../herbie/develop/src/mainloop.rkt:102:0 argmins [189] 100.0% ---------------------------------------------------------------------------------- ??? [168] 100.0% [179] 312(0.4%) 0(0.0%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 syntax->list [191] 100.0% ---------------------------------------------------------------------------------- ??? [162] 100.0% [180] 300(0.4%) 0(0.0%) mk-ival ...herbie/develop/src/biginterval.rkt:59:0 bf [192] 100.0% ---------------------------------------------------------------------------------- hash-ref! [170] 100.0% [181] 2802(3.3%) 0(0.0%) ??? ...tlies/herbie/develop/src/programs.rkt:189:5 hash-ref! [170] 100.0% ---------------------------------------------------------------------------------- ??? [171] 100.0% [182] 2238(2.6%) 290(0.3%) ival-sub ...rbie/develop/src/biginterval.rkt:102:0 bfdiv [193] 87.0% ---------------------------------------------------------------------------------- ??? [171] 100.0% [183] 2004(2.4%) 698(0.8%) ival-div ...rbie/develop/src/biginterval.rkt:150:0 bfdiv [193] 65.2% ---------------------------------------------------------------------------------- hash-ref! [170] 100.0% [184] 1982(2.3%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:45:15 hash-ref! [170] 100.0% ---------------------------------------------------------------------------------- hash-ref! [170] 100.0% [185] 1656(2.0%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:344:33 hash-ref! [170] 100.0% ---------------------------------------------------------------------------------- ??? [171] 100.0% [186] 972(1.1%) 312(0.4%) ival-add ...erbie/develop/src/biginterval.rkt:96:0 bfdiv [193] 67.9% ---------------------------------------------------------------------------------- ->flonum [173] 30.6% ??? [177] 34.6% ulp-difference [156] 34.8% [187] 966(1.1%) 630(0.7%) return/no-unsupplied ...ct/private/arr-i.rkt:534:0 filter [195] 34.8% ---------------------------------------------------------------------------------- for-loop [63] 46.3% ??? [176] 53.7% [188] 622(0.7%) 334(0.4%) ??? ...ects/racket/contract/private/guts.rkt:746:8 dict? [197] 46.3% ---------------------------------------------------------------------------------- best-alt [178] 100.0% [189] 332(0.4%) 0(0.0%) argmins ...lies/herbie/develop/src/common.rkt:93:0 ??? [196] 100.0% ---------------------------------------------------------------------------------- un-dep/maybe-chaperone [175] 100.0% [190] 324(0.4%) 324(0.4%) ??? ...ntract/private/arrow-higher-order.rkt:554:2 ---------------------------------------------------------------------------------- ??? [179] 100.0% [191] 312(0.4%) 0(0.0%) syntax->list (unknown source) loop [194] 100.0% ---------------------------------------------------------------------------------- mk-ival [180] 100.0% [192] 300(0.4%) 0(0.0%) bf ...ath-lib/math/private/bigfloat/mpfr.rkt:601:2 ??? [199] 100.0% ---------------------------------------------------------------------------------- ival-add [186] 16.9% ival-div [183] 33.4% ival-sub [182] 49.8% [193] 3914(4.6%) 0(0.0%) bfdiv ...-lib/math/private/bigfloat/mpfr.rkt:821:4 new-mpfr [198] 63.4% ??? [199] 36.6% ---------------------------------------------------------------------------------- syntax->list [191] 4.2% loop [194] 4.3% for-loop [207] 6.0% loop [132] 12.4% apply-transformer52 [147] 12.5% eval-prog [80] 12.6% lambda-clause-expander [140] 15.0% syntax-e/no-taint [16] 33.0% [194] 2498(3.0%) 634(0.7%) loop (unknown source) gf [200] 28.7% expand-capturing-lifts [130] 12.6% core-form-sym [201] 12.5% dispatch-transformer41 [141] 10.6% expand-id-application-form17 [7] 10.3% loop [194] 4.3% syntax-e [8] 4.2% ---------------------------------------------------------------------------------- return/no-unsupplied [187] 100.0% [195] 336(0.4%) 336(0.4%) filter ...0/collects/racket/private/list.rkt:256:2 ---------------------------------------------------------------------------------- argmins [189] 100.0% [196] 332(0.4%) 0(0.0%) ??? ...lies/herbie/develop/src/mainloop.rkt:104:19 errors [69] 100.0% ---------------------------------------------------------------------------------- ??? [188] 100.0% [197] 288(0.3%) 288(0.3%) dict? ...ollects/racket/private/generic.rkt:146:11 ---------------------------------------------------------------------------------- bfdiv [193] 100.0% [198] 2482(2.9%) 2482(2.9%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:335:0 ---------------------------------------------------------------------------------- bf [192] 17.3% bfdiv [193] 82.7% [199] 1732(2.0%) 1732(2.0%) ??? /opt/racket-7.0/collects/ffi/unsafe.rkt:898:4 ---------------------------------------------------------------------------------- apply-post-expansion [160] 13.3% loop [194] 86.7% [200] 1240(1.5%) 298(0.4%) gf (unknown source) propagation-merge [204] 25.2% propagation-apply [205] 24.2% syntax-e/no-taint [16] 13.3% cache-or-reuse-hash [203] 13.3% ---------------------------------------------------------------------------------- loop [194] 100.0% [201] 624(0.7%) 0(0.0%) core-form-sym (unknown source) resolve+shift28 [202] 100.0% ---------------------------------------------------------------------------------- expand-implicit [10] 34.9% core-form-sym [201] 65.1% [202] 958(1.1%) 0(0.0%) resolve+shift28 (unknown source) fallback-loop [206] 100.0% ---------------------------------------------------------------------------------- gf [200] 100.0% [203] 330(0.4%) 0(0.0%) cache-or-reuse-hash (unknown source) for-loop [207] 100.0% ---------------------------------------------------------------------------------- gf [200] 100.0% [204] 312(0.4%) 312(0.4%) propagation-merge (unknown source) ---------------------------------------------------------------------------------- gf [200] 100.0% [205] 300(0.4%) 300(0.4%) propagation-apply (unknown source) ---------------------------------------------------------------------------------- resolve+shift28 [202] 100.0% [206] 958(1.1%) 0(0.0%) fallback-loop (unknown source) for-loop [207] 100.0% ---------------------------------------------------------------------------------- lambda-clause-expander [140] 7.8% cache-or-reuse-hash [203] 8.6% fallback-loop [206] 12.8% for-loop [207] 15.5% finish-bodys [146] 55.3% [207] 3832(4.5%) 2250(2.7%) for-loop (unknown source) finish-bodys [146] 41.9% for-loop [207] 15.5% add-local-binding!37 [208] 7.8% syntax-e [8] 3.9% dispatch-transformer41 [141] 2.2% loop [194] 0.9% expand-implicit [10] 0.7% ---------------------------------------------------------------------------------- for-loop [207] 100.0% [208] 300(0.4%) 300(0.4%) add-local-binding!37 (unknown source) ----------------------------------------------------------------------------------