Profiling results ----------------- Total cpu time observed: 74900ms (out of 75724ms) Number of samples taken: 231 (once every 324ms) (Hiding functions with self<1.0% and local<2.0%: 5 of 207 hidden) ==================================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ==================================================================================== run [27] 50.0% [1] 74900(100.0%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [13] 50.0% run-improve39 [14] 30.2% loop [38] 16.4% oracle-error [19] 1.7% eval-errors [119] 1.1% get-final-combination [25] 0.4% baseline-error [26] 0.2% ------------------------------------------------------------------------------------ ??? [144] 100.0% [2] 21146(28.2%) 0(0.0%) ??? ...s/herbie/develop/src/core/simplify.rkt:31:0 iterate-egraph!7 [15] 94.6% loop [22] 5.4% ------------------------------------------------------------------------------------ ??? [144] 100.0% [3] 7954(10.6%) 0(0.0%) approximate9 ...e/develop/src/core/taylor.rkt:12:0 loop [16] 88.3% for-loop [23] 11.7% ------------------------------------------------------------------------------------ hash-ref! [74] 100.0% [4] 3992(5.3%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:416:23 for-loop [17] 100.0% ------------------------------------------------------------------------------------ hash-ref! [74] 100.0% [5] 3668(4.9%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:300:23 for-loop [18] 100.0% ------------------------------------------------------------------------------------ hash-ref! [74] 100.0% [6] 2452(3.3%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:290:26 for-loop [20] 100.0% ------------------------------------------------------------------------------------ loop [196] 100.0% [7] 882(1.2%) 0(0.0%) expand-id-application-form17 (unknown source) syntax-e/no-taint [21] 100.0% ------------------------------------------------------------------------------------ loop [196] 36.9% for-loop [189] 63.1% [8] 850(1.1%) 0(0.0%) syntax-e (unknown source) syntax-e/no-taint [21] 100.0% ------------------------------------------------------------------------------------ loop [128] 100.0% [9] 632(0.8%) 0(0.0%) set-precompute! ...lop/src/core/simplify.rkt:151:0 for-loop [24] 100.0% ------------------------------------------------------------------------------------ append-map [107] 100.0% [10] 606(0.8%) 0(0.0%) free-variables ...ie/develop/src/programs.rkt:80:0 ??? [82] 100.0% ------------------------------------------------------------------------------------ substitute-e [65] 45.4% match-e [52] 54.6% [11] 542(0.7%) 0(0.0%) variable? ...e/develop/src/syntax/syntax.rkt:716:0 ??? [82] 100.0% ------------------------------------------------------------------------------------ copying-mergesort [101] 100.0% [12] 308(0.4%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:120:23 ??? [132] 100.0% ------------------------------------------------------------------------------------ ??? [1] 100.0% [13] 74900(100.0%) 0(0.0%) profile-thunk16 ...e/pkgs/profile-lib/main.rkt:9:0 run [27] 100.0% ------------------------------------------------------------------------------------ ??? [1] 100.0% [14] 45244(60.4%) 0(0.0%) run-improve39 ...ie/develop/src/mainloop.rkt:322:0 for-loop [28] 98.6% setup-prog!32 [35] 1.4% ------------------------------------------------------------------------------------ ??? [2] 100.0% [15] 20008(26.7%) 0(0.0%) iterate-egraph!7 ...lop/src/core/simplify.rkt:61:0 one-iter [29] 100.0% ------------------------------------------------------------------------------------ approximate9 [3] 100.0% [16] 7026(9.4%) 0(0.0%) loop ...es/herbie/develop/src/core/taylor.rkt:87:4 ??? [144] 61.0% hash-ref! [74] 39.0% ------------------------------------------------------------------------------------ ??? [4] 100.0% [17] 3992(5.3%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:420:33 hash-ref! [74] 100.0% ------------------------------------------------------------------------------------ ??? [5] 100.0% [18] 3668(4.9%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:303:27 hash-ref! [74] 100.0% ------------------------------------------------------------------------------------ ??? [1] 100.0% [19] 2486(3.3%) 0(0.0%) oracle-error ...erbie/develop/src/points.rkt:311:0 for-loop [30] 100.0% ------------------------------------------------------------------------------------ ??? [6] 100.0% [20] 2452(3.3%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:290:52 hash-ref! [74] 87.4% simplify [84] 12.6% ------------------------------------------------------------------------------------ syntax-e [8] 49.1% expand-id-application-form17 [7] 50.9% [21] 1732(2.3%) 0(0.0%) syntax-e/no-taint (unknown source) loop [196] 100.0% ------------------------------------------------------------------------------------ ??? [2] 100.0% [22] 1138(1.5%) 0(0.0%) loop ...herbie/develop/src/core/simplify.rkt:195:2 for-loop [32] 100.0% ------------------------------------------------------------------------------------ approximate9 [3] 100.0% [23] 928(1.2%) 0(0.0%) for-loop ...rbie/develop/src/core/taylor.rkt:30:18 taylor-exp [34] 67.0% taylor [31] 33.0% ------------------------------------------------------------------------------------ set-precompute! [9] 100.0% [24] 632(0.8%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:153:2 eval-const-expr [33] 100.0% ------------------------------------------------------------------------------------ ??? [1] 100.0% [25] 608(0.8%) 0(0.0%) get-final-combination ...op/src/mainloop.rkt:345:0 infer-splitpoints [36] 100.0% ------------------------------------------------------------------------------------ ??? [1] 100.0% [26] 358(0.5%) 0(0.0%) baseline-error ...bie/develop/src/points.rkt:315:0 argmin [43] 100.0% ------------------------------------------------------------------------------------ profile-thunk16 [13] 100.0% [27] 74900(100.0%) 0(0.0%) run ...racket/share/pkgs/profile-lib/main.rkt:39:2 ??? [1] 100.0% ------------------------------------------------------------------------------------ run-improve39 [14] 100.0% [28] 44626(59.6%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:339:10 run-iter! [37] 100.0% ------------------------------------------------------------------------------------ iterate-egraph!7 [15] 100.0% [29] 20008(26.7%) 0(0.0%) one-iter ...bie/develop/src/core/simplify.rkt:72:0 for-loop [39] 58.3% for-loop [40] 36.9% map-enodes [41] 3.2% ------------------------------------------------------------------------------------ oracle-error [19] 100.0% [30] 2486(3.3%) 0(0.0%) for-loop ...es/herbie/develop/src/points.rkt:312:2 loop [128] 63.2% map [113] 36.8% ------------------------------------------------------------------------------------ for-loop [23] 5.0% hash-ref! [74] 43.9% taylor [31] 51.1% [31] 1218(1.6%) 0(0.0%) taylor ...herbie/develop/src/core/taylor.rkt:169:0 taylor [31] 51.1% debug-print [98] 25.3% loop [128] 12.5% loop [45] 11.2% ------------------------------------------------------------------------------------ loop [22] 100.0% [32] 1138(1.5%) 0(0.0%) for-loop ...e/develop/src/core/simplify.rkt:188:29 loop [42] 54.8% argmin [43] 23.2% for-loop [46] 22.0% ------------------------------------------------------------------------------------ for-loop [24] 100.0% [33] 632(0.8%) 0(0.0%) eval-const-expr .../develop/src/programs.rkt:127:0 eval-prog [122] 100.0% ------------------------------------------------------------------------------------ for-loop [23] 100.0% [34] 622(0.8%) 0(0.0%) taylor-exp ...ie/develop/src/core/taylor.rkt:410:0 simplify [84] 100.0% ------------------------------------------------------------------------------------ run-improve39 [14] 100.0% [35] 618(0.8%) 0(0.0%) setup-prog!32 ...bie/develop/src/mainloop.rkt:63:0 loop [38] 100.0% ------------------------------------------------------------------------------------ get-final-combination [25] 100.0% [36] 608(0.8%) 0(0.0%) infer-splitpoints ...lop/src/core/regimes.rkt:32:0 for-loop [44] 100.0% ------------------------------------------------------------------------------------ for-loop [28] 100.0% [37] 44626(59.6%) 0(0.0%) run-iter! ...herbie/develop/src/mainloop.rkt:303:0 simplify! [48] 48.8% finalize-iter! [49] 31.3% gen-series! [50] 18.5% gen-rewrites! [56] 0.7% ------------------------------------------------------------------------------------ setup-prog!32 [35] 2.4% ??? [1] 97.6% [38] 25234(33.7%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:242:2 make-exacts-intervals [47] 98.8% for-loop [57] 1.2% ------------------------------------------------------------------------------------ one-iter [29] 100.0% [39] 11662(15.6%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:123:2 for-loop [51] 68.2% match-e [52] 18.5% update-leader! [75] 13.4% ------------------------------------------------------------------------------------ for-loop [40] 47.7% one-iter [29] 52.3% [40] 7382(9.9%) 1870(2.5%) for-loop ...ie/develop/src/core/simplify.rkt:83:12 for-loop [40] 47.7% match-e [52] 37.3% ------------------------------------------------------------------------------------ one-iter [29] 100.0% [41] 632(0.8%) 0(0.0%) map-enodes ...ie/develop/src/core/egraph.rkt:140:0 loop [128] 100.0% ------------------------------------------------------------------------------------ for-loop [32] 100.0% [42] 624(0.8%) 0(0.0%) loop .../p92/racket/collects/racket/list.rkt:751:4 expression-cost [53] 100.0% ------------------------------------------------------------------------------------ for-loop [32] 42.4% baseline-error [26] 57.6% [43] 622(0.8%) 0(0.0%) argmin ...92/racket/collects/racket/list.rkt:765:0 ??? [55] 57.6% for-loop [58] 42.4% ------------------------------------------------------------------------------------ infer-splitpoints [36] 100.0% [44] 608(0.8%) 0(0.0%) for-loop ...rbie/develop/src/core/regimes.rkt:44:6 option-on-expr [54] 100.0% ------------------------------------------------------------------------------------ taylor [31] 100.0% [45] 606(0.8%) 306(0.4%) loop ...s/herbie/develop/src/core/taylor.rkt:267:2 hash-ref! [74] 49.5% ------------------------------------------------------------------------------------ for-loop [32] 100.0% [46] 250(0.3%) 0(0.0%) for-loop ...e/develop/src/core/simplify.rkt:175:13 andmap [59] 100.0% ------------------------------------------------------------------------------------ loop [38] 100.0% [47] 24936(33.3%) 0(0.0%) make-exacts-intervals ...elop/src/points.rkt:183:0 for-loop [60] 100.0% ------------------------------------------------------------------------------------ run-iter! [37] 100.0% [48] 21780(29.1%) 0(0.0%) simplify! ...herbie/develop/src/mainloop.rkt:206:0 for-loop [61] 100.0% ------------------------------------------------------------------------------------ run-iter! [37] 100.0% [49] 13958(18.6%) 0(0.0%) finalize-iter! ...e/develop/src/mainloop.rkt:257:0 ??? [82] 100.0% ------------------------------------------------------------------------------------ run-iter! [37] 100.0% [50] 8254(11.0%) 0(0.0%) gen-series! ...rbie/develop/src/mainloop.rkt:152:0 for-loop [62] 100.0% ------------------------------------------------------------------------------------ for-loop [39] 100.0% [51] 7952(10.6%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:106:4 merge-egraph-nodes! [64] 44.1% loop! [134] 39.6% substitute-e [65] 10.0% mk-enode! [88] 6.3% ------------------------------------------------------------------------------------ for-loop [39] 21.9% for-loop [76] 23.1% for-loop [40] 55.0% [52] 7664(10.2%) 1846(2.5%) match-e ...herbie/develop/src/core/ematch.rkt:39:0 for-loop [63] 76.8% ??? [82] 4.0% variable? [11] 1.3% ------------------------------------------------------------------------------------ loop [42] 100.0% [53] 624(0.8%) 0(0.0%) expression-cost .../develop/src/programs.rkt:182:0 compile [66] 100.0% ------------------------------------------------------------------------------------ for-loop [44] 100.0% [54] 608(0.8%) 0(0.0%) option-on-expr ...velop/src/core/regimes.rkt:112:0 sort-context-on-expr [68] 50.7% for-loop [69] 49.3% ------------------------------------------------------------------------------------ argmin [43] 100.0% [55] 358(0.5%) 0(0.0%) ??? ...htlies/herbie/develop/src/points.rkt:316:27 eval-errors [119] 100.0% ------------------------------------------------------------------------------------ run-iter! [37] 100.0% [56] 334(0.4%) 0(0.0%) gen-rewrites! ...ie/develop/src/mainloop.rkt:177:0 for-loop [67] 100.0% ------------------------------------------------------------------------------------ loop [38] 100.0% [57] 298(0.4%) 0(0.0%) for-loop ...s/herbie/develop/src/points.rkt:257:19 for-loop [70] 100.0% ------------------------------------------------------------------------------------ argmin [43] 100.0% [58] 264(0.4%) 0(0.0%) for-loop .../herbie/develop/src/programs.rkt:183:2 table-ref [116] 100.0% ------------------------------------------------------------------------------------ for-loop [46] 100.0% [59] 250(0.3%) 250(0.3%) andmap ...t/collects/racket/private/map.rkt:102:13 ------------------------------------------------------------------------------------ make-exacts-intervals [47] 100.0% [60] 24936(33.3%) 0(0.0%) for-loop ...es/herbie/develop/src/points.rkt:186:2 loop [71] 98.8% ??? [144] 1.2% ------------------------------------------------------------------------------------ simplify! [48] 100.0% [61] 21780(29.1%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:213:6 for-loop [72] 98.5% ??? [144] 1.5% ------------------------------------------------------------------------------------ gen-series! [50] 100.0% [62] 8254(11.0%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:160:7 taylor-alt [73] 100.0% ------------------------------------------------------------------------------------ match-e [52] 100.0% [63] 6762(9.0%) 3060(4.1%) for-loop ...rbie/develop/src/core/ematch.rkt:52:11 for-loop [76] 48.6% cp-2 [78] 7.1% loop [128] 3.6% foldr [80] 2.5% ------------------------------------------------------------------------------------ for-loop [51] 100.0% [64] 3508(4.7%) 0(0.0%) merge-egraph-nodes! ...p/src/core/egraph.rkt:153:0 update-leader! [75] 100.0% ------------------------------------------------------------------------------------ for-loop [77] 45.8% for-loop [51] 54.2% [65] 792(1.1%) 0(0.0%) substitute-e ...e/develop/src/core/ematch.rkt:64:0 for-loop [77] 77.1% ??? [82] 12.5% variable? [11] 10.4% ------------------------------------------------------------------------------------ expression-cost [53] 100.0% [66] 624(0.8%) 0(0.0%) compile ...s/herbie/develop/src/programs.rkt:159:0 hash-ref! [74] 100.0% ------------------------------------------------------------------------------------ gen-rewrites! [56] 100.0% [67] 334(0.4%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:184:11 ??? [79] 100.0% ------------------------------------------------------------------------------------ option-on-expr [54] 100.0% [68] 308(0.4%) 0(0.0%) sort-context-on-expr ...evelop/src/points.rkt:91:0 ??? [81] 100.0% ------------------------------------------------------------------------------------ option-on-expr [54] 100.0% [69] 300(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:120:4 eval-errors [119] 100.0% ------------------------------------------------------------------------------------ for-loop [57] 100.0% [70] 298(0.4%) 0(0.0%) for-loop ...es/herbie/develop/src/points.rkt:234:4 ??? [144] 100.0% ------------------------------------------------------------------------------------ for-loop [60] 100.0% [71] 24634(32.9%) 604(0.8%) loop ...htlies/herbie/develop/src/points.rkt:168:2 ??? [132] 87.7% ??? [144] 7.3% ??? [82] 2.5% ------------------------------------------------------------------------------------ for-loop [61] 100.0% [72] 21450(28.6%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:237:8 ??? [144] 98.6% debug-print [98] 1.4% ------------------------------------------------------------------------------------ for-loop [62] 100.0% [73] 8254(11.0%) 0(0.0%) taylor-alt ...erbie/develop/src/mainloop.rkt:138:0 for-loop [83] 96.4% ??? [144] 3.6% ------------------------------------------------------------------------------------ simplify* [123] 0.7% loop [45] 1.3% compile [66] 3.4% for-loop [20] 4.8% ??? [90] 4.8% for-loop [17] 10.2% loop [16] 11.7% for-loop [18] 13.6% ??? [85] 20.2% ??? [144] 29.4% [74] 7650(10.2%) 1234(1.6%) hash-ref! .../racket/private/more-scheme.rkt:376:2 ??? [85] 20.2% simplify [84] 20.1% ??? [5] 13.6% ??? [87] 11.7% ??? [4] 10.2% ??? [6] 6.1% taylor [31] 5.3% ??? [90] 4.8% ------------------------------------------------------------------------------------ for-loop [39] 30.8% merge-egraph-nodes! [64] 69.2% [75] 5066(6.8%) 0(0.0%) update-leader! ...evelop/src/core/egraph.rkt:215:0 for-loop [86] 81.8% for-loop [91] 12.2% make-sequence [94] 5.9% ------------------------------------------------------------------------------------ for-loop [63] 100.0% [76] 4084(5.5%) 640(0.9%) for-loop ...rbie/develop/src/core/ematch.rkt:58:37 match-e [52] 84.3% ------------------------------------------------------------------------------------ substitute-e [65] 100.0% [77] 792(1.1%) 0(0.0%) for-loop ...rbie/develop/src/core/ematch.rkt:73:24 substitute-e [65] 68.7% mk-enode! [88] 31.3% ------------------------------------------------------------------------------------ for-loop [63] 100.0% [78] 630(0.8%) 0(0.0%) cp-2 .../p92/racket/collects/racket/list.rkt:826:2 for-loop [89] 100.0% ------------------------------------------------------------------------------------ for-loop [67] 100.0% [79] 334(0.4%) 0(0.0%) ??? ...ies/herbie/develop/src/alternative.rkt:54:0 rewriter [92] 100.0% ------------------------------------------------------------------------------------ for-loop [63] 100.0% [80] 332(0.4%) 332(0.4%) foldr ...et/collects/racket/private/list.rkt:242:4 ------------------------------------------------------------------------------------ sort-context-on-expr [68] 100.0% [81] 308(0.4%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:369:3 generic-sort/key [93] 100.0% ------------------------------------------------------------------------------------ substitute-e [65] 1.8% variable? [11] 3.2% free-variables [10] 3.6% match-e [52] 3.6% loop [71] 3.7% finalize-iter! [49] 82.4% [82] 16944(22.6%) 2388(3.2%) ??? ...contract/private/arrow-val-first.rkt:388:18 for-loop [95] 82.4% ??? [160] 1.8% ------------------------------------------------------------------------------------ taylor-alt [73] 100.0% [83] 7954(10.6%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:144:6 ??? [144] 100.0% ------------------------------------------------------------------------------------ loop [128] 4.3% for-loop [20] 4.4% taylor-exp [34] 8.8% hash-ref! [74] 82.4% [84] 7040(9.4%) 0(0.0%) simplify ...erbie/develop/src/core/reduce.rkt:16:0 f67 [96] 69.6% parse-loop80 [120] 21.8% simplify* [123] 4.3% debug-print [98] 4.3% ------------------------------------------------------------------------------------ hash-ref! [74] 100.0% [85] 5814(7.8%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:45:15 hash-ref! [74] 100.0% ------------------------------------------------------------------------------------ update-leader! [75] 100.0% [86] 4146(5.5%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:220:6 for-loop [97] 100.0% ------------------------------------------------------------------------------------ hash-ref! [74] 100.0% [87] 2738(3.7%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:68:15 ??? [144] 100.0% ------------------------------------------------------------------------------------ for-loop [77] 33.1% for-loop [51] 66.9% [88] 750(1.0%) 0(0.0%) mk-enode! ...bie/develop/src/core/egraph.rkt:102:0 hash-has-key? [99] 66.4% for-loop [102] 33.6% ------------------------------------------------------------------------------------ cp-2 [78] 100.0% [89] 630(0.8%) 630(0.8%) for-loop .../racket/collects/racket/list.rkt:827:4 ------------------------------------------------------------------------------------ hash-ref! [74] 100.0% [90] 624(0.8%) 0(0.0%) ??? ...tlies/herbie/develop/src/programs.rkt:167:5 hash-ref! [74] 100.0% ------------------------------------------------------------------------------------ update-leader! [75] 100.0% [91] 620(0.8%) 620(0.8%) for-loop ...rbie/develop/src/core/egraph.rkt:230:6 ------------------------------------------------------------------------------------ matcher [109] 50.0% ??? [79] 50.0% [92] 334(0.4%) 0(0.0%) rewriter ...bie/develop/src/core/matcher.rkt:131:2 for-loop [100] 100.0% ------------------------------------------------------------------------------------ ??? [81] 100.0% [93] 308(0.4%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 copying-mergesort [101] 100.0% ------------------------------------------------------------------------------------ update-leader! [75] 100.0% [94] 300(0.4%) 300(0.4%) make-sequence ...ects/racket/private/for.rkt:528:2 ------------------------------------------------------------------------------------ ??? [82] 100.0% [95] 13958(18.6%) 0(0.0%) for-loop ...ie/develop/src/core/alt-table.rkt:51:2 atab-add-altn [103] 90.8% loop [105] 9.2% ------------------------------------------------------------------------------------ composed [106] 2.4% loop [128] 2.8% append-map [107] 6.5% parse-loop80 [120] 15.0% map [113] 31.3% simplify [84] 41.9% [96] 5214(7.0%) 300(0.4%) f67 ...t/collects/racket/match/compiler.rkt:507:40 map [113] 72.6% temp68_2 [129] 10.0% append-map [107] 7.7% compose [110] 6.1% composed [106] 2.4% ------------------------------------------------------------------------------------ for-loop [86] 100.0% [97] 4146(5.5%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:221:8 hash-update! [104] 100.0% ------------------------------------------------------------------------------------ simplify [84] 32.9% for-loop [72] 33.3% taylor [31] 33.8% [98] 912(1.2%) 608(0.8%) debug-print .../herbie/develop/src/debug.rkt:107:0 for-loop [111] 33.3% ------------------------------------------------------------------------------------ mk-enode! [88] 100.0% [99] 498(0.7%) 498(0.7%) hash-has-key? ...ket/private/more-scheme.rkt:371:2 ------------------------------------------------------------------------------------ rewriter [92] 100.0% [100] 334(0.4%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:134:10 matcher [109] 50.0% type-of [108] 50.0% ------------------------------------------------------------------------------------ generic-sort/key [93] 25.0% copying-mergesort [101] 75.0% [101] 308(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [101] 75.0% jloop [12] 25.0% ------------------------------------------------------------------------------------ mk-enode! [88] 100.0% [102] 252(0.3%) 252(0.3%) for-loop ...bie/develop/src/core/egraph.rkt:114:10 ------------------------------------------------------------------------------------ for-loop [95] 100.0% [103] 12676(16.9%) 0(0.0%) atab-add-altn ...elop/src/core/alt-table.rkt:210:0 override-at-pnts [112] 53.0% best-and-tied-at-points [114] 47.0% ------------------------------------------------------------------------------------ for-loop [97] 100.0% [104] 4146(5.5%) 0(0.0%) hash-update! ...cket/private/more-scheme.rkt:365:4 ??? [115] 100.0% ------------------------------------------------------------------------------------ for-loop [95] 100.0% [105] 1282(1.7%) 0(0.0%) loop ...erbie/develop/src/core/alt-table.rkt:184:2 map [113] 50.4% filter [180] 26.1% loop [118] 23.6% ------------------------------------------------------------------------------------ f67 [96] 100.0% [106] 906(1.2%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 f67 [96] 100.0% ------------------------------------------------------------------------------------ f67 [96] 100.0% [107] 606(0.8%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:586:2 f67 [96] 83.3% free-variables [10] 16.7% ------------------------------------------------------------------------------------ for-loop [100] 100.0% [108] 334(0.4%) 0(0.0%) type-of .../herbie/develop/src/type-check.rkt:34:0 table-ref [116] 100.0% ------------------------------------------------------------------------------------ for-loop [117] 50.0% for-loop [100] 50.0% [109] 334(0.4%) 0(0.0%) matcher ...rbie/develop/src/core/matcher.rkt:168:2 for-loop [117] 50.0% rewriter [92] 50.0% ------------------------------------------------------------------------------------ f67 [96] 100.0% [110] 316(0.4%) 316(0.4%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------------------ debug-print [98] 100.0% [111] 304(0.4%) 304(0.4%) for-loop ...ies/herbie/develop/src/debug.rkt:115:2 ------------------------------------------------------------------------------------ atab-add-altn [103] 100.0% [112] 6724(9.0%) 268(0.4%) override-at-pnts ...p/src/core/alt-table.rkt:145:0 eval-errors [119] 87.5% eval-prog [122] 8.5% ------------------------------------------------------------------------------------ parse-loop80 [120] 1.2% loop [105] 10.5% for-loop [30] 14.9% f67 [96] 73.4% [113] 6148(8.2%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:35:13 f67 [96] 35.7% parse-loop80 [120] 34.0% ??? [136] 14.9% loop [128] 10.5% simplify* [123] 3.7% make-multiplication-node [125] 1.2% ------------------------------------------------------------------------------------ atab-add-altn [103] 100.0% [114] 5952(7.9%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 eval-errors [119] 76.0% eval-prog [122] 19.1% for-loop [126] 4.8% ------------------------------------------------------------------------------------ hash-update! [104] 100.0% [115] 4146(5.5%) 0(0.0%) ??? ...s/herbie/develop/src/core/egraph.rkt:223:24 for-loop [121] 100.0% ------------------------------------------------------------------------------------ for-loop [58] 44.1% type-of [108] 55.9% [116] 598(0.8%) 264(0.4%) table-ref ...es/herbie/develop/src/common.rkt:46:0 assoc-iterate-first [124] 55.9% ------------------------------------------------------------------------------------ matcher [109] 100.0% [117] 334(0.4%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:184:21 matcher [109] 100.0% ------------------------------------------------------------------------------------ loop [105] 3.2% loop [118] 96.8% [118] 302(0.4%) 302(0.4%) loop ...p92/racket/collects/racket/list.rkt:434:28 loop [118] 96.8% ------------------------------------------------------------------------------------ for-loop [69] 2.4% ??? [55] 2.8% ??? [1] 12.5% best-and-tied-at-points [114] 35.8% override-at-pnts [112] 46.5% [119] 12658(16.9%) 0(0.0%) eval-errors ...herbie/develop/src/points.rkt:292:0 for-loop [127] 100.0% ------------------------------------------------------------------------------------ loop [128] 3.2% simplify [84] 9.4% parse-loop80 [120] 26.4% map [113] 60.9% [120] 4282(5.7%) 910(1.2%) parse-loop80 ...s/racket/match/compiler.rkt:418:15 parse-loop80 [120] 26.4% temp68_2 [129] 24.5% f67 [96] 21.5% map [113] 7.1% eval-one-top12 [131] 7.1% loop [128] 5.5% loop [196] 1.4% ------------------------------------------------------------------------------------ ??? [115] 100.0% [121] 4146(5.5%) 3596(4.8%) for-loop ...bie/develop/src/core/egraph.rkt:224:26 update-en-expr [141] 13.3% ------------------------------------------------------------------------------------ ??? [182] 11.4% override-at-pnts [112] 21.6% eval-const-expr [33] 23.9% best-and-tied-at-points [114] 43.1% [122] 2640(3.5%) 0(0.0%) eval-prog ...herbie/develop/src/programs.rkt:108:0 temp68_2 [129] 100.0% ------------------------------------------------------------------------------------ simplify [84] 33.3% map [113] 66.7% [123] 914(1.2%) 604(0.8%) simplify* ...rbie/develop/src/core/reduce.rkt:31:0 hash-ref! [74] 33.9% ------------------------------------------------------------------------------------ table-ref [116] 100.0% [124] 334(0.4%) 334(0.4%) assoc-iterate-first ...cket/private/dict.rkt:166:0 ------------------------------------------------------------------------------------ map [113] 100.0% [125] 304(0.4%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:238:0 make-multiplication-subnode [130] 100.0% ------------------------------------------------------------------------------------ best-and-tied-at-points [114] 100.0% [126] 288(0.4%) 288(0.4%) for-loop .../develop/src/core/alt-table.rkt:124:16 ------------------------------------------------------------------------------------ eval-errors [119] 100.0% [127] 12658(16.9%) 936(1.2%) for-loop ...es/herbie/develop/src/points.rkt:294:2 ??? [132] 59.1% ??? [144] 21.1% ulp-difference [135] 9.9% ??? [137] 2.5% ------------------------------------------------------------------------------------ map [113] 0.4% for-loop [63] 3.8% map-enodes [41] 4.6% taylor [31] 4.6% loop! [134] 9.2% parse-loop80 [120] 9.3% for-loop [30] 16.1% loop [128] 51.9% [128] 6556(8.8%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:40:19 loop [128] 51.9% ??? [136] 9.7% loop! [134] 9.2% parse-loop80 [120] 7.0% simplify [84] 4.6% set-precompute! [9] 4.6% ulp-difference [135] 4.1% foldl [176] 3.8% ??? [132] 2.3% f67 [96] 2.3% ------------------------------------------------------------------------------------ f67 [96] 17.0% parse-loop80 [120] 34.4% eval-prog [122] 48.6% [129] 5428(7.2%) 0(0.0%) temp68_2 (unknown source) compile16 [133] 100.0% ------------------------------------------------------------------------------------ make-multiplication-node [125] 100.0% [130] 304(0.4%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:248:0 for-loop [138] 100.0% ------------------------------------------------------------------------------------ parse-loop80 [120] 100.0% [131] 302(0.4%) 302(0.4%) eval-one-top12 (unknown source) ------------------------------------------------------------------------------------ loop [128] 1.0% jloop [12] 1.0% ??? [136] 5.0% for-loop [127] 24.0% loop [71] 69.1% [132] 31234(41.7%) 594(0.8%) ??? ...tlies/herbie/develop/src/programs.rkt:124:2 ??? [139] 83.4% ??? [144] 7.7% ??? [145] 7.0% ------------------------------------------------------------------------------------ temp68_2 [129] 100.0% [133] 5428(7.2%) 0(0.0%) compile16 (unknown source) temp74_0 [140] 88.3% loop [196] 11.7% ------------------------------------------------------------------------------------ loop [128] 37.0% for-loop [51] 63.0% [134] 3150(4.2%) 1190(1.6%) loop! ...s/herbie/develop/src/core/enode.rkt:190:2 loop [128] 37.0% custom-set-union [142] 23.8% update-en-expr [141] 8.9% set [143] 6.6% ------------------------------------------------------------------------------------ loop [128] 33.7% for-loop [127] 66.3% [135] 1888(2.5%) 640(0.9%) ulp-difference ...erbie/develop/src/float.rkt:19:0 return/no-unsupplied [166] 33.7% ??? [168] 32.4% ------------------------------------------------------------------------------------ loop [128] 41.0% map [113] 59.0% [136] 1548(2.1%) 0(0.0%) ??? ...htlies/herbie/develop/src/points.rkt:313:26 ??? [132] 100.0% ------------------------------------------------------------------------------------ for-loop [127] 100.0% [137] 320(0.4%) 320(0.4%) ??? ...ket/collects/racket/private/for.rkt:1208:14 ------------------------------------------------------------------------------------ make-multiplication-subnode [130] 100.0% [138] 304(0.4%) 304(0.4%) for-loop ...rbie/develop/src/core/reduce.rkt:250:3 ------------------------------------------------------------------------------------ ??? [132] 100.0% [139] 26052(34.8%) 1712(2.3%) ??? ...acket/collects/racket/private/kw.rkt:592:14 ??? [145] 74.5% ??? [146] 17.8% ??? [144] 1.2% ------------------------------------------------------------------------------------ compile16 [133] 100.0% [140] 4794(6.4%) 0(0.0%) temp74_0 (unknown source) expand-single [147] 87.2% compile-top9 [149] 12.8% ------------------------------------------------------------------------------------ for-loop [121] 49.5% loop! [134] 50.5% [141] 1110(1.5%) 306(0.4%) update-en-expr ...evelop/src/core/egraph.rkt:209:0 for-loop [148] 72.4% ------------------------------------------------------------------------------------ loop! [134] 100.0% [142] 900(1.2%) 264(0.4%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [150] 37.3% for-loop [151] 33.3% ------------------------------------------------------------------------------------ loop! [134] 100.0% [143] 500(0.7%) 500(0.7%) set ...collects/racket/private/set-types.rkt:981:0 ------------------------------------------------------------------------------------ for-loop [70] 0.8% taylor-alt [73] 0.8% ??? [139] 0.8% for-loop [60] 0.8% for-loop [61] 0.9% ??? [87] 2.4% loop [16] 3.8% loop [71] 4.8% ??? [132] 6.3% for-loop [127] 7.1% for-loop [83] 7.4% for-loop [72] 28.0% location-do [152] 35.4% [144] 37804(50.5%) 1538(2.1%) ??? ...tract/private/arrow-higher-order.rkt:357:33 location-do [152] 35.4% ??? [2] 28.0% ->flonum [154] 16.6% approximate9 [3] 7.4% hash-ref! [74] 6.2% best-alt [162] 0.8% sample-multi-bounded [163] 0.8% ------------------------------------------------------------------------------------ ??? [132] 10.2% ??? [139] 89.8% [145] 21594(28.8%) 320(0.4%) ??? ...tract/private/arrow-higher-order.rkt:361:33 ival-mult [153] 51.9% ival-exp [155] 27.4% mk-ival [157] 13.4% ival-sub [158] 5.8% ------------------------------------------------------------------------------------ ??? [139] 100.0% [146] 4638(6.2%) 2950(3.9%) ??? ...herbie/develop/src/syntax/syntax.rkt:198:17 return/no-unsupplied [166] 23.3% ??? [160] 6.6% ??? [168] 6.5% ------------------------------------------------------------------------------------ temp74_0 [140] 100.0% [147] 4182(5.6%) 0(0.0%) expand-single (unknown source) expand-capturing-lifts [156] 100.0% ------------------------------------------------------------------------------------ update-en-expr [141] 100.0% [148] 804(1.1%) 804(1.1%) for-loop ...rbie/develop/src/core/egraph.rkt:211:6 ------------------------------------------------------------------------------------ temp74_0 [140] 100.0% [149] 612(0.8%) 0(0.0%) compile-top9 (unknown source) compile-forms31 [159] 100.0% ------------------------------------------------------------------------------------ custom-set-union [142] 100.0% [150] 336(0.4%) 0(0.0%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [161] 100.0% ------------------------------------------------------------------------------------ custom-set-union [142] 100.0% [151] 300(0.4%) 300(0.4%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------------------ ??? [144] 35.3% location-do [152] 64.7% [152] 29100(38.9%) 0(0.0%) location-do ...erbie/develop/src/programs.rkt:89:0 location-do [152] 64.7% ??? [144] 35.3% ------------------------------------------------------------------------------------ ??? [145] 100.0% [153] 11218(15.0%) 0(0.0%) ival-mult ...rbie/develop/src/biginterval.rkt:94:0 bf* [164] 53.7% foldl [176] 28.7% bfmax* [171] 8.8% bfmin* [172] 6.0% ...higher-order.rkt:361:33 [173] 2.8% ------------------------------------------------------------------------------------ ??? [144] 100.0% [154] 6268(8.4%) 4470(6.0%) ->flonum ...s/herbie/develop/src/programs.rkt:36:0 ??? [168] 14.6% return/no-unsupplied [166] 9.3% ??? [193] 4.8% ------------------------------------------------------------------------------------ ??? [145] 100.0% [155] 5924(7.9%) 324(0.4%) ival-exp ...rbie/develop/src/biginterval.rkt:116:0 ??? [184] 94.5% ------------------------------------------------------------------------------------ loop [196] 18.3% expand-single [147] 81.7% [156] 5116(6.8%) 0(0.0%) expand-capturing-lifts (unknown source) lambda-clause-expander [167] 39.4% loop [196] 18.3% dispatch-transformer41 [169] 18.3% expand-implicit [170] 12.2% for-loop [189] 11.9% ------------------------------------------------------------------------------------ ??? [145] 100.0% [157] 2884(3.9%) 310(0.4%) mk-ival ...herbie/develop/src/biginterval.rkt:52:0 bf [165] 89.3% ------------------------------------------------------------------------------------ ??? [145] 100.0% [158] 1248(1.7%) 298(0.4%) ival-sub ...erbie/develop/src/biginterval.rkt:82:0 ??? [184] 76.1% ------------------------------------------------------------------------------------ compile-top9 [149] 100.0% [159] 612(0.8%) 0(0.0%) compile-forms31 (unknown source) for-loop [189] 100.0% ------------------------------------------------------------------------------------ ??? [82] 49.3% ??? [146] 50.7% [160] 604(0.8%) 604(0.8%) ??? ...ects/racket/contract/private/guts.rkt:746:8 ------------------------------------------------------------------------------------ for-loop [150] 100.0% [161] 336(0.4%) 336(0.4%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------------------ ??? [144] 100.0% [162] 300(0.4%) 0(0.0%) best-alt .../herbie/develop/src/mainloop.rkt:110:0 loop [174] 100.0% ------------------------------------------------------------------------------------ ??? [144] 100.0% [163] 298(0.4%) 0(0.0%) sample-multi-bounded ...evelop/src/points.rkt:44:0 loop [175] 100.0% ------------------------------------------------------------------------------------ ival-mult [153] 100.0% [164] 6026(8.0%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [184] 100.0% ------------------------------------------------------------------------------------ mk-ival [157] 100.0% [165] 2574(3.4%) 0(0.0%) bf ...ath-lib/math/private/bigfloat/mpfr.rkt:601:2 new-mpfr [192] 88.3% ??? [193] 11.7% ------------------------------------------------------------------------------------ ->flonum [154] 25.3% ulp-difference [135] 27.7% ??? [146] 47.0% [166] 2300(3.1%) 1984(2.6%) return/no-unsupplied ...ct/private/arr-i.rkt:534:0 filter [180] 13.7% ------------------------------------------------------------------------------------ expand-capturing-lifts [156] 100.0% [167] 2018(2.7%) 0(0.0%) lambda-clause-expander (unknown source) finish-bodys [177] 100.0% ------------------------------------------------------------------------------------ ??? [146] 16.4% ulp-difference [135] 33.5% ->flonum [154] 50.1% [168] 1828(2.4%) 1828(2.4%) ??? ...s/racket/contract/private/arr-i.rkt:1252:29 ------------------------------------------------------------------------------------ for-loop [189] 39.1% expand-capturing-lifts [156] 60.9% [169] 1534(2.0%) 0(0.0%) dispatch-transformer41 (unknown source) apply-transformer52 [178] 100.0% ------------------------------------------------------------------------------------ for-loop [189] 49.4% expand-capturing-lifts [156] 50.6% [170] 1230(1.6%) 0(0.0%) expand-implicit (unknown source) resolve+shift28 [179] 100.0% ------------------------------------------------------------------------------------ ival-mult [153] 100.0% [171] 988(1.3%) 0(0.0%) bfmax* .../herbie/develop/src/biginterval.rkt:91:0 foldl [176] 100.0% ------------------------------------------------------------------------------------ ival-mult [153] 100.0% [172] 668(0.9%) 0(0.0%) bfmin* .../herbie/develop/src/biginterval.rkt:88:0 foldl [176] 100.0% ------------------------------------------------------------------------------------ ival-mult [153] 100.0% [173] 312(0.4%) 0(0.0%) ...higher-order.rkt:361:33 (unknown source) ??? [181] 100.0% ------------------------------------------------------------------------------------ best-alt [162] 100.0% [174] 300(0.4%) 0(0.0%) loop ...htlies/herbie/develop/src/common.rkt:130:2 ??? [182] 100.0% ------------------------------------------------------------------------------------ sample-multi-bounded [163] 100.0% [175] 298(0.4%) 0(0.0%) loop ...ghtlies/herbie/develop/src/points.rkt:66:6 random-exp [183] 100.0% ------------------------------------------------------------------------------------ loop [128] 4.8% bfmin* [172] 13.0% bfmax* [171] 19.3% ival-mult [153] 62.9% [176] 5126(6.8%) 0(0.0%) foldl ...et/collects/racket/private/list.rkt:229:4 ??? [184] 95.2% merge2 [187] 4.8% ------------------------------------------------------------------------------------ lambda-clause-expander [167] 27.7% for-loop [189] 72.3% [177] 2018(2.7%) 0(0.0%) finish-bodys (unknown source) for-loop [189] 100.0% ------------------------------------------------------------------------------------ dispatch-transformer41 [169] 100.0% [178] 1534(2.0%) 308(0.4%) apply-transformer52 (unknown source) apply-transformer-in-context [186] 60.4% loop [196] 19.6% ------------------------------------------------------------------------------------ core-form-sym [198] 19.6% expand-implicit [170] 80.4% [179] 1530(2.0%) 308(0.4%) resolve+shift28 (unknown source) fallback-loop [185] 79.9% ------------------------------------------------------------------------------------ return/no-unsupplied [166] 48.6% loop [105] 51.4% [180] 650(0.9%) 650(0.9%) filter ...t/collects/racket/private/list.rkt:256:2 ------------------------------------------------------------------------------------ ...higher-order.rkt:361:33 [173] 100.0% [181] 312(0.4%) 312(0.4%) ??? ...cts/racket/contract/private/list.rkt:209:10 ------------------------------------------------------------------------------------ loop [174] 100.0% [182] 300(0.4%) 0(0.0%) ??? ...lies/herbie/develop/src/mainloop.rkt:112:19 eval-prog [122] 100.0% ------------------------------------------------------------------------------------ loop [175] 100.0% [183] 298(0.4%) 298(0.4%) random-exp .../herbie/develop/src/common.rkt:230:0 ------------------------------------------------------------------------------------ ival-sub [158] 5.4% foldl [176] 28.0% ival-exp [155] 32.1% bf* [164] 34.5% [184] 17456(23.3%) 5286(7.1%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [188] 60.5% bfexp [190] 9.2% ------------------------------------------------------------------------------------ resolve+shift28 [179] 100.0% [185] 1222(1.6%) 622(0.8%) fallback-loop (unknown source) for-loop [189] 49.1% ------------------------------------------------------------------------------------ apply-transformer52 [178] 100.0% [186] 926(1.2%) 612(0.8%) apply-transformer-in-context (unknown source) parse-app [191] 33.9% ------------------------------------------------------------------------------------ foldl [176] 100.0% [187] 246(0.3%) 246(0.3%) merge2 .../herbie/develop/src/core/ematch.rkt:24:0 ------------------------------------------------------------------------------------ ??? [184] 100.0% [188] 10562(14.1%) 634(0.8%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:821:4 new-mpfr [192] 48.3% ??? [193] 45.7% ------------------------------------------------------------------------------------ fallback-loop [185] 3.0% for-loop [189] 10.7% expand-capturing-lifts [156] 12.4% compile-forms31 [159] 18.9% finish-bodys [177] 55.0% [189] 3238(4.3%) 924(1.2%) for-loop (unknown source) finish-bodys [177] 39.6% dispatch-transformer41 [169] 11.1% for-loop [189] 10.7% module-uses-extract-extra-inspectorsss [195] 8.9% loop [196] 6.8% syntax-e [8] 5.6% expand-implicit [170] 4.3% ------------------------------------------------------------------------------------ ??? [184] 100.0% [190] 1608(2.1%) 0(0.0%) bfexp ...-lib/math/private/bigfloat/mpfr.rkt:618:4 new-mpfr [192] 63.4% ??? [193] 36.6% ------------------------------------------------------------------------------------ apply-transformer-in-context [186] 100.0% [191] 314(0.4%) 0(0.0%) parse-app ...collects/racket/private/kw.rkt:1105:2 syntax->list [194] 100.0% ------------------------------------------------------------------------------------ bfexp [190] 12.1% bf [165] 27.1% bfsub [188] 60.8% [192] 8400(11.2%) 8400(11.2%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:335:0 ------------------------------------------------------------------------------------ ->flonum [154] 5.0% bf [165] 5.0% bfexp [190] 9.8% bfsub [188] 80.2% [193] 6010(8.0%) 6010(8.0%) ??? /home/p92/racket/collects/ffi/unsafe.rkt:898:4 ------------------------------------------------------------------------------------ parse-app [191] 100.0% [194] 314(0.4%) 0(0.0%) syntax->list (unknown source) loop [196] 100.0% ------------------------------------------------------------------------------------ for-loop [189] 100.0% [195] 288(0.4%) 288(0.4%) module-uses-extract-extra-inspectorsss ... source) ------------------------------------------------------------------------------------ parse-loop80 [120] 5.1% syntax->list [194] 5.3% apply-transformer52 [178] 10.1% compile16 [133] 10.7% for-loop [189] 14.9% expand-capturing-lifts [156] 15.7% syntax-e/no-taint [21] 38.2% [196] 2966(4.0%) 1248(1.7%) loop (unknown source) gf [197] 32.9% expand-capturing-lifts [156] 15.7% expand-id-application-form17 [7] 14.9% core-form-sym [198] 10.1% syntax-e [8] 5.3% ------------------------------------------------------------------------------------ loop [196] 100.0% [197] 1418(1.9%) 0(0.0%) gf (unknown source) propagation-apply [199] 41.3% propagation-apply-shifted [200] 20.9% cache-or-reuse-set [201] 19.3% propagation-merge [202] 18.5% ------------------------------------------------------------------------------------ loop [196] 100.0% [198] 300(0.4%) 0(0.0%) core-form-sym (unknown source) resolve+shift28 [179] 100.0% ------------------------------------------------------------------------------------ gf [197] 100.0% [199] 586(0.8%) 586(0.8%) propagation-apply (unknown source) ------------------------------------------------------------------------------------ gf [197] 100.0% [200] 296(0.4%) 296(0.4%) propagation-apply-shifted (unknown source) ------------------------------------------------------------------------------------ gf [197] 100.0% [201] 274(0.4%) 274(0.4%) cache-or-reuse-set (unknown source) ------------------------------------------------------------------------------------ gf [197] 100.0% [202] 262(0.3%) 262(0.3%) propagation-merge (unknown source) ------------------------------------------------------------------------------------