Profiling results ----------------- Total cpu time observed: 113314ms (out of 115020ms) Number of samples taken: 500 (once every 227ms) (Hiding functions with self<1.0% and local<2.0%: 11 of 199 hidden) ========================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================= ??? [24] 100.0% [1] 109146(96.3%) 0(0.0%) profile-thunk14 ...t/pkgs/profile-lib/main.rkt:9:0 run [14] 100.0% ------------------------------------------------------------------------- simplify-alt [49] 1.3% loop [147] 13.4% ??? [24] 85.3% [2] 35488(31.3%) 0(0.0%) simplify ...lock/herbie/src/core/simplify.rkt:39:0 simplify-expr [16] 52.1% iterate-egraph!5 [25] 27.9% for-loop [18] 18.3% loop [28] 1.1% mk-egraph [29] 0.6% ------------------------------------------------------------------------- hash-ref! [133] 100.0% [3] 28218(24.9%) 818(0.7%) ??? .../ztatlock/herbie/src/core/taylor.rkt:285:26 for-loop [15] 98.3% ------------------------------------------------------------------------- hash-ref! [133] 100.0% [4] 22024(19.4%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:42:15 hash-ref! [133] 50.4% ??? [26] 44.1% simplify [141] 5.5% ------------------------------------------------------------------------- map [120] 10.1% f16 [154] 22.4% hash-ref! [133] 66.1% [5] 15040(13.3%) 240(0.2%) taylor-invert .../herbie/src/core/taylor.rkt:312:0 first-nonzero-exp [126] 89.9% simplify [141] 8.5% ------------------------------------------------------------------------- hash-ref! [133] 100.0% [6] 8610(7.6%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:295:23 for-loop [17] 100.0% ------------------------------------------------------------------------- loop [147] 100.0% [7] 6812(6.0%) 0(0.0%) completely-simplify-alt ...erbie/src/glue.rkt:87:0 simplify-expr [16] 100.0% ------------------------------------------------------------------------- hash-ref! [133] 100.0% [8] 3370(3.0%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:322:33 for-loop [19] 100.0% ------------------------------------------------------------------------- hash-ref! [133] 6.9% map [120] 19.9% f16 [154] 73.2% [9] 3114(2.7%) 420(0.4%) taylor ...tatlock/herbie/src/core/taylor.rkt:157:0 debug7 [152] 27.0% loop [147] 26.8% debug-print [151] 19.8% constant? [187] 6.4% curried [181] 6.4% ------------------------------------------------------------------------- hash-ref! [133] 100.0% [10] 2750(2.4%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:338:33 hash-ref! [133] 84.0% for-loop [22] 16.0% ------------------------------------------------------------------------- f16 [154] 100.0% [11] 2614(2.3%) 478(0.4%) combine-mterms ...herbie/src/core/reduce.rkt:182:0 for-loop [21] 81.7% ------------------------------------------------------------------------- hash-ref! [133] 100.0% [12] 2524(2.2%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:392:23 for-loop [20] 100.0% ------------------------------------------------------------------------- hash-ref! [133] 100.0% [13] 198(0.2%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:483:23 for-loop [23] 100.0% ------------------------------------------------------------------------- profile-thunk14 [1] 100.0% [14] 109146(96.3%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:31:2 ??? [24] 100.0% ------------------------------------------------------------------------- ??? [3] 100.0% [15] 27810(24.5%) 216(0.2%) for-loop ...lock/herbie/src/core/taylor.rkt:285:52 hash-ref! [133] 67.6% ??? [26] 26.1% simplify [141] 5.5% ------------------------------------------------------------------------- completely-simplify-alt [7] 26.9% simplify [2] 73.1% [16] 25306(22.3%) 0(0.0%) simplify-expr ...herbie/src/core/simplify.rkt:68:0 iterate-egraph!5 [25] 96.0% loop [28] 2.4% mk-egraph [29] 1.6% ------------------------------------------------------------------------- ??? [6] 100.0% [17] 8610(7.6%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:298:27 hash-ref! [133] 100.0% ------------------------------------------------------------------------- simplify [2] 100.0% [18] 6506(5.7%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:61:12 iterate-egraph!5 [25] 96.9% loop [28] 3.1% ------------------------------------------------------------------------- ??? [8] 100.0% [19] 3370(3.0%) 218(0.2%) for-loop ...lock/herbie/src/core/taylor.rkt:324:46 hash-ref! [133] 68.0% simplify [141] 25.6% ------------------------------------------------------------------------- ??? [12] 100.0% [20] 2524(2.2%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:396:33 for-loop [27] 100.0% ------------------------------------------------------------------------- combine-mterms [11] 100.0% [21] 2136(1.9%) 868(0.8%) for-loop ...tlock/herbie/src/core/reduce.rkt:186:5 hash-ref! [133] 59.4% ------------------------------------------------------------------------- ??? [10] 100.0% [22] 440(0.4%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:341:46 hash-ref! [133] 100.0% ------------------------------------------------------------------------- ??? [13] 100.0% [23] 198(0.2%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:487:35 parse-loop12 [75] 100.0% ------------------------------------------------------------------------- for-loop [66] 9.2% run [14] 44.2% [24] 112892(99.6%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk14 [1] 44.2% run-improve58 [30] 37.4% simplify [2] 9.2% loop [37] 9.2% ------------------------------------------------------------------------- for-loop [18] 15.6% simplify [2] 24.4% simplify-expr [16] 60.0% [25] 40494(35.7%) 0(0.0%) iterate-egraph!5 ...bie/src/core/simplify.rkt:95:0 one-iter [31] 96.3% map-enodes [32] 3.7% ------------------------------------------------------------------------- ??? [4] 33.1% for-loop [15] 66.9% [26] 10754(9.5%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:288:19 hash-ref! [133] 100.0% ------------------------------------------------------------------------- for-loop [20] 100.0% [27] 2524(2.2%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:398:39 hash-ref! [133] 100.0% ------------------------------------------------------------------------- for-loop [18] 17.1% simplify [2] 33.1% simplify-expr [16] 49.8% [28] 1196(1.1%) 0(0.0%) loop ...tatlock/herbie/src/core/simplify.rkt:203:2 pass [33] 100.0% ------------------------------------------------------------------------- simplify [2] 32.5% simplify-expr [16] 67.5% [29] 610(0.5%) 0(0.0%) mk-egraph ...lock/herbie/src/core/egraph.rkt:123:0 expr->enode [34] 100.0% ------------------------------------------------------------------------- ??? [24] 100.0% [30] 92082(81.3%) 0(0.0%) run-improve58 ...ock/herbie/src/mainloop.rkt:242:0 finalize-table! [35] 57.5% for-loop [36] 36.5% get-final-combination [40] 5.2% setup-prog [42] 0.5% loop [37] 0.3% ------------------------------------------------------------------------- iterate-egraph!5 [25] 100.0% [31] 39008(34.4%) 2388(2.1%) one-iter ...ock/herbie/src/core/simplify.rkt:106:0 for-loop [38] 52.8% loop [39] 39.5% apply-match [45] 0.5% ------------------------------------------------------------------------- iterate-egraph!5 [25] 100.0% [32] 1486(1.3%) 0(0.0%) map-enodes ...ock/herbie/src/core/egraph.rkt:139:0 loop [147] 100.0% ------------------------------------------------------------------------- loop [28] 100.0% [33] 1196(1.1%) 196(0.2%) pass ...tatlock/herbie/src/core/simplify.rkt:193:2 for-loop [41] 83.6% ------------------------------------------------------------------------- mk-egraph [29] 44.2% expr->enode [34] 55.8% [34] 610(0.5%) 0(0.0%) expr->enode ...ck/herbie/src/core/egraph.rkt:124:2 expr->enode [34] 55.8% mk-enode! [70] 44.2% ------------------------------------------------------------------------- run-improve58 [30] 100.0% [35] 52978(46.8%) 0(0.0%) finalize-table! ...k/herbie/src/mainloop.rkt:264:0 post-process [43] 100.0% ------------------------------------------------------------------------- run-improve58 [30] 100.0% [36] 33632(29.7%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:253:8 run-iter! [44] 100.0% ------------------------------------------------------------------------- run-improve58 [30] 1.1% ??? [24] 98.9% [37] 21050(18.6%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:122:2 make-exacts* [56] 57.4% loop [46] 41.5% for-loop [50] 1.1% ------------------------------------------------------------------------- for-loop [38] 49.0% one-iter [31] 51.0% [38] 20580(18.2%) 3170(2.8%) for-loop ...ck/herbie/src/core/simplify.rkt:116:12 for-loop [38] 49.0% match-e [55] 41.8% ??? [92] 0.5% ------------------------------------------------------------------------- one-iter [31] 100.0% [39] 15422(13.6%) 208(0.2%) loop ...cket/collects/racket/private/map.rkt:53:19 apply-match [45] 98.7% ------------------------------------------------------------------------- run-improve58 [30] 100.0% [40] 4760(4.2%) 0(0.0%) get-final-combination ...ie/src/mainloop.rkt:269:0 extract-alt [47] 100.0% ------------------------------------------------------------------------- pass [33] 100.0% [41] 1000(0.9%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:196:29 argmin [48] 60.2% for-loop [51] 20.0% loop [52] 19.8% ------------------------------------------------------------------------- run-improve58 [30] 100.0% [42] 472(0.4%) 0(0.0%) setup-prog /home/ztatlock/herbie/src/glue.rkt:46:0 simplify-alt [49] 100.0% ------------------------------------------------------------------------- finalize-table! [35] 100.0% [43] 52978(46.8%) 0(0.0%) post-process .../ztatlock/herbie/src/glue.rkt:95:0 for-loop [53] 82.8% loop [147] 14.0% ??? [69] 2.4% localize-error [60] 0.8% ------------------------------------------------------------------------- for-loop [36] 100.0% [44] 33632(29.7%) 0(0.0%) run-iter! ...tatlock/herbie/src/mainloop.rkt:223:0 simplify! [54] 90.7% gen-series! [61] 4.3% finalize-iter! [62] 3.7% localize-error [60] 1.3% ------------------------------------------------------------------------- one-iter [31] 1.3% loop [39] 98.7% [45] 15414(13.6%) 824(0.7%) apply-match .../herbie/src/core/simplify.rkt:122:2 merge-egraph-nodes! [68] 37.1% match-e [55] 23.5% for-loop [58] 14.0% substitute-e [59] 10.9% mk-enode! [70] 4.0% update-leader! [77] 1.3% loop! [157] 1.3% ------------------------------------------------------------------------- loop [37] 100.0% [46] 8734(7.7%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:93:2 loop [57] 61.8% make-exacts* [56] 35.7% eval-prog [118] 2.4% ------------------------------------------------------------------------- get-final-combination [40] 100.0% [47] 4760(4.2%) 0(0.0%) extract-alt ...e/ztatlock/herbie/src/glue.rkt:57:0 loop [147] 100.0% ------------------------------------------------------------------------- for-loop [41] 100.0% [48] 602(0.5%) 204(0.2%) argmin ...re/racket/collects/racket/list.rkt:743:0 expression-cost [63] 66.1% ------------------------------------------------------------------------- setup-prog [42] 100.0% [49] 472(0.4%) 0(0.0%) simplify-alt .../ztatlock/herbie/src/glue.rkt:84:0 simplify [2] 100.0% ------------------------------------------------------------------------- loop [37] 100.0% [50] 232(0.2%) 0(0.0%) for-loop .../ztatlock/herbie/src/points.rkt:128:18 for-loop [64] 100.0% ------------------------------------------------------------------------- for-loop [41] 100.0% [51] 200(0.2%) 200(0.2%) for-loop ...ck/herbie/src/core/simplify.rkt:183:13 ------------------------------------------------------------------------- for-loop [41] 100.0% [52] 198(0.2%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 expression-cost [63] 100.0% ------------------------------------------------------------------------- post-process [43] 100.0% [53] 43848(38.7%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:119:17 append-map [65] 100.0% ------------------------------------------------------------------------- run-iter! [44] 100.0% [54] 30508(26.9%) 0(0.0%) simplify! ...tatlock/herbie/src/mainloop.rkt:162:0 for-loop [66] 100.0% ------------------------------------------------------------------------- apply-match [45] 13.9% for-loop [76] 15.5% for-loop [38] 70.7% [55] 20832(18.4%) 10886(9.6%) match-e ...tatlock/herbie/src/core/ematch.rkt:46:0 for-loop [67] 42.4% for-loop [76] 8.3% list-cartesian-product [78] 4.0% loop [147] 1.0% ------------------------------------------------------------------------- loop [46] 20.5% loop [37] 79.5% [56] 15206(13.4%) 0(0.0%) make-exacts* ...tatlock/herbie/src/points.rkt:80:0 map [120] 57.2% loop [147] 41.5% eval-prog [118] 1.3% ------------------------------------------------------------------------- loop [46] 100.0% [57] 5400(4.8%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:83:4 map [120] 100.0% ------------------------------------------------------------------------- apply-match [45] 100.0% [58] 2154(1.9%) 218(0.2%) for-loop ...ck/herbie/src/core/simplify.rkt:136:10 loop! [157] 51.2% merge-egraph-nodes! [68] 28.5% mk-enode! [70] 10.2% ------------------------------------------------------------------------- apply-match [45] 100.0% [59] 1674(1.5%) 414(0.4%) substitute-e ...ck/herbie/src/core/ematch.rkt:71:0 mk-enode! [70] 75.3% ------------------------------------------------------------------------- run-iter! [44] 29.3% post-process [43] 29.3% loop [147] 41.4% [60] 1496(1.3%) 0(0.0%) localize-error ...erbie/src/core/localize.rkt:47:0 hash-ref! [133] 72.1% sort [124] 27.9% ------------------------------------------------------------------------- run-iter! [44] 100.0% [61] 1444(1.3%) 0(0.0%) gen-series! ...tlock/herbie/src/mainloop.rkt:134:0 for-loop [71] 100.0% ------------------------------------------------------------------------- run-iter! [44] 100.0% [62] 1242(1.1%) 0(0.0%) finalize-iter! ...ck/herbie/src/mainloop.rkt:177:0 ??? [69] 100.0% ------------------------------------------------------------------------- loop [52] 33.2% argmin [48] 66.8% [63] 596(0.5%) 198(0.2%) expression-cost ...k/herbie/src/programs.rkt:212:0 compile [72] 66.8% ------------------------------------------------------------------------- for-loop [50] 100.0% [64] 232(0.2%) 0(0.0%) for-loop .../ztatlock/herbie/src/points.rkt:129:20 sample-default [73] 100.0% ------------------------------------------------------------------------- simplify-node [148] 7.7% f16 [154] 14.7% append-map [65] 20.1% for-loop [53] 57.5% [65] 44466(39.2%) 2452(2.2%) append-map ...acket/collects/racket/list.rkt:565:2 taylor-alt [74] 53.7% append-map [65] 20.1% f16 [154] 12.4% parse-loop12 [75] 8.0% loop [147] 3.8% free-variables [180] 0.8% gather-additive-terms6 [89] 0.1% loop [85] 0.1% ------------------------------------------------------------------------- simplify! [54] 100.0% [66] 30508(26.9%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:166:6 ??? [24] 99.2% debug-print [151] 0.8% ------------------------------------------------------------------------- match-e [55] 100.0% [67] 10566(9.3%) 4310(3.8%) for-loop ...tlock/herbie/src/core/ematch.rkt:59:11 for-loop [76] 39.2% list-cartesian-product [78] 13.9% loop [147] 5.2% curried [181] 2.8% ------------------------------------------------------------------------- for-loop [80] 3.3% merge-egraph-nodes! [68] 8.6% for-loop [58] 9.7% apply-match [45] 78.4% [68] 6328(5.6%) 238(0.2%) merge-egraph-nodes! ...e/src/core/egraph.rkt:152:0 update-leader! [77] 49.8% loop! [157] 21.4% merge-egraph-nodes! [68] 8.6% for-loop [80] 6.7% for-loop [82] 6.6% for-loop [86] 3.2% ------------------------------------------------------------------------- debug7 [152] 19.6% finalize-iter! [62] 39.9% post-process [43] 40.5% [69] 3112(2.7%) 414(0.4%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [79] 73.3% atab-add-altns [84] 7.1% ??? [156] 6.3% ------------------------------------------------------------------------- for-loop [58] 8.1% expr->enode [34] 22.5% apply-match [45] 22.9% substitute-e [59] 46.5% [70] 2710(2.4%) 1860(1.6%) mk-enode! ...lock/herbie/src/core/egraph.rkt:101:0 hash-has-key? [81] 16.2% new-enode [83] 15.2% ------------------------------------------------------------------------- gen-series! [61] 100.0% [71] 1444(1.3%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:140:7 taylor-alt [74] 100.0% ------------------------------------------------------------------------- expression-cost [63] 100.0% [72] 398(0.4%) 0(0.0%) compile .../ztatlock/herbie/src/programs.rkt:189:0 hash-ref! [133] 100.0% ------------------------------------------------------------------------- for-loop [64] 100.0% [73] 232(0.2%) 0(0.0%) sample-default ...rc/syntax/distributions.rkt:11:0 ??? [173] 100.0% ------------------------------------------------------------------------- for-loop [71] 3.2% loop [147] 4.1% append-map [65] 92.7% [74] 45292(40.0%) 0(0.0%) taylor-alt ...e/ztatlock/herbie/src/glue.rkt:142:0 for-loop [87] 100.0% ------------------------------------------------------------------------- for-loop [115] 0.2% for-loop [23] 0.4% f16 [154] 2.6% make-addition-node [128] 2.7% simplify [141] 3.8% hash-ref! [133] 4.7% map [120] 12.0% parse-loop12 [75] 25.9% append-map [65] 47.7% [75] 22958(20.3%) 5534(4.9%) parse-loop12 ...s/racket/match/compiler.rkt:410:15 parse-loop12 [75] 25.9% for-loop [88] 14.3% make-multiplication-node [99] 13.9% f16 [154] 9.9% loop [147] 7.3% gather-additive-terms6 [89] 5.3% make-addition-node [128] 2.6% simplify-node [148] 1.8% map [120] 1.3% cp-2 [97] 0.9% loop [130] 0.3% ------------------------------------------------------------------------- match-e [55] 40.8% for-loop [67] 59.2% [76] 8018(7.1%) 1044(0.9%) for-loop ...tlock/herbie/src/core/ematch.rkt:65:37 match-e [55] 79.5% ??? [92] 7.5% ------------------------------------------------------------------------- apply-match [45] 5.6% merge-egraph-nodes! [68] 94.4% [77] 3544(3.1%) 1014(0.9%) update-leader! ...herbie/src/core/egraph.rkt:217:0 for-loop [91] 52.3% mutable-set [94] 7.3% custom-set-union! [95] 6.2% make-sequence [96] 5.6% ------------------------------------------------------------------------- match-e [55] 27.0% list-cartesian-product [78] 27.1% for-loop [67] 45.9% [78] 2718(2.4%) 2104(1.9%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [78] 27.1% for-loop [93] 18.9% ------------------------------------------------------------------------- ??? [69] 100.0% [79] 2282(2.0%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:51:2 atab-add-altn [90] 100.0% ------------------------------------------------------------------------- merge-egraph-nodes! [68] 100.0% [80] 636(0.6%) 0(0.0%) for-loop ...lock/herbie/src/core/egraph.rkt:200:10 merge-egraph-nodes! [68] 66.0% loop! [157] 34.0% ------------------------------------------------------------------------- mk-enode! [70] 100.0% [81] 438(0.4%) 438(0.4%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ------------------------------------------------------------------------- merge-egraph-nodes! [68] 100.0% [82] 418(0.4%) 200(0.2%) for-loop ...tlock/herbie/src/core/egraph.rkt:232:6 update-en-expr [175] 52.2% ------------------------------------------------------------------------- mk-enode! [70] 100.0% [83] 412(0.4%) 0(0.0%) new-enode ...atlock/herbie/src/core/enode.rkt:68:0 set [172] 100.0% ------------------------------------------------------------------------- ??? [69] 100.0% [84] 220(0.2%) 0(0.0%) atab-add-altns ...rbie/src/core/alt-table.rkt:50:0 atab-add-altn [90] 100.0% ------------------------------------------------------------------------- append-map [65] 33.3% loop [85] 66.7% [85] 202(0.2%) 202(0.2%) loop ...are/racket/collects/racket/list.rkt:414:34 loop [85] 66.7% ------------------------------------------------------------------------- merge-egraph-nodes! [68] 100.0% [86] 200(0.2%) 200(0.2%) for-loop ...e/ztatlock/herbie/src/common.rkt:205:9 ------------------------------------------------------------------------- taylor-alt [74] 100.0% [87] 45292(40.0%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:144:2 location-do [98] 100.0% ------------------------------------------------------------------------- parse-loop12 [75] 100.0% [88] 5942(5.2%) 0(0.0%) for-loop ...tlock/herbie/src/core/reduce.rkt:90:13 f16 [154] 62.1% make-multiplication-node [99] 37.9% ------------------------------------------------------------------------- append-map [65] 16.9% parse-loop12 [75] 83.1% [89] 2596(2.3%) 2370(2.1%) gather-additive-terms6 ...src/core/reduce.rkt:63:0 variable? [103] 8.7% ------------------------------------------------------------------------- atab-add-altns [84] 8.8% for-loop [79] 91.2% [90] 2502(2.2%) 0(0.0%) atab-add-altn ...rbie/src/core/alt-table.rkt:208:0 best-and-tied-at-points [100] 92.0% override-at-pnts [105] 8.0% ------------------------------------------------------------------------- update-leader! [77] 100.0% [91] 1854(1.6%) 220(0.2%) for-loop ...tlock/herbie/src/core/egraph.rkt:222:6 for-loop [101] 88.1% ------------------------------------------------------------------------- for-loop [38] 24.7% for-loop [76] 75.3% [92] 794(0.7%) 394(0.3%) ??? /home/ztatlock/herbie/src/core/ematch.rkt:50:5 for-loop [102] 50.4% ------------------------------------------------------------------------- list-cartesian-product [78] 100.0% [93] 614(0.5%) 614(0.5%) for-loop ...atlock/herbie/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------- update-leader! [77] 100.0% [94] 258(0.2%) 258(0.2%) mutable-set ...racket/private/set-types.rkt:1000:0 ------------------------------------------------------------------------- update-leader! [77] 100.0% [95] 218(0.2%) 218(0.2%) custom-set-union! ...t/private/set-types.rkt:246:0 ------------------------------------------------------------------------- update-leader! [77] 100.0% [96] 200(0.2%) 0(0.0%) make-sequence ...ects/racket/private/for.rkt:508:2 ??? [104] 100.0% ------------------------------------------------------------------------- parse-loop12 [75] 100.0% [97] 198(0.2%) 0(0.0%) cp-2 ...hare/racket/collects/racket/list.rkt:804:2 for-loop [106] 100.0% ------------------------------------------------------------------------- location-do [98] 10.6% for-loop [87] 89.4% [98] 45292(40.0%) 0(0.0%) location-do ...tlock/herbie/src/programs.rkt:129:0 approximate9 [107] 89.4% location-do [98] 10.6% ------------------------------------------------------------------------- simplify [141] 7.6% map [120] 18.0% for-loop [88] 27.9% parse-loop12 [75] 46.6% [99] 8082(7.1%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:221:0 make-multiplication-subnode [108]100.0% ------------------------------------------------------------------------- atab-add-altn [90] 100.0% [100] 2302(2.0%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [109] 90.4% for-loop [111] 9.6% ------------------------------------------------------------------------- for-loop [91] 100.0% [101] 1634(1.4%) 0(0.0%) for-loop ...tlock/herbie/src/core/egraph.rkt:223:8 hash-update! [110] 100.0% ------------------------------------------------------------------------- ??? [92] 100.0% [102] 400(0.4%) 400(0.4%) for-loop ...atlock/herbie/src/core/ematch.rkt:51:7 ------------------------------------------------------------------------- gather-additive-terms6 [89] 100.0% [103] 226(0.2%) 226(0.2%) variable? ...ck/herbie/src/syntax/syntax.rkt:218:0 ------------------------------------------------------------------------- make-sequence [96] 100.0% [104] 200(0.2%) 200(0.2%) ??? ...acket/collects/racket/private/for.rkt:428:7 ------------------------------------------------------------------------- atab-add-altn [90] 100.0% [105] 200(0.2%) 0(0.0%) override-at-pnts ...e/src/core/alt-table.rkt:145:0 errors [109] 100.0% ------------------------------------------------------------------------- cp-2 [97] 100.0% [106] 198(0.2%) 198(0.2%) for-loop .../racket/collects/racket/list.rkt:805:4 ------------------------------------------------------------------------- location-do [98] 100.0% [107] 45292(40.0%) 0(0.0%) approximate9 ...ck/herbie/src/core/taylor.rkt:11:0 loop [112] 89.1% for-loop [114] 5.6% taylor-quotient [122] 2.9% f16 [154] 2.4% ------------------------------------------------------------------------- make-multiplication-node [99] 100.0% [108] 8082(7.1%) 856(0.8%) make-multiplication-subnode ...re/reduce.rkt:231:0 group-by68 [113] 56.1% for-loop [115] 28.2% compose [176] 5.2% ------------------------------------------------------------------------- override-at-pnts [105] 8.8% best-and-tied-at-points [100] 91.2% [109] 2282(2.0%) 0(0.0%) errors /home/ztatlock/herbie/src/points.rkt:144:0 for-loop [116] 81.6% eval-prog [118] 18.4% ------------------------------------------------------------------------- for-loop [101] 100.0% [110] 1634(1.4%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [117] 100.0% ------------------------------------------------------------------------- best-and-tied-at-points [100] 100.0% [111] 220(0.2%) 0(0.0%) for-loop ...k/herbie/src/core/alt-table.rkt:124:16 ??? [119] 100.0% ------------------------------------------------------------------------- approximate9 [107] 100.0% [112] 40336(35.6%) 0(0.0%) loop ...e/ztatlock/herbie/src/core/taylor.rkt:82:4 hash-ref! [133] 100.0% ------------------------------------------------------------------------- make-multiplication-subnode [108]100.0% [113] 4532(4.0%) 2910(2.6%) group-by68 ...acket/collects/racket/list.rkt:749:0 hash-update [129] 18.0% sort [124] 13.5% for-loop [125] 4.4% ------------------------------------------------------------------------- approximate9 [107] 100.0% [114] 2556(2.3%) 0(0.0%) for-loop ...tlock/herbie/src/core/taylor.rkt:28:18 f16 [154] 58.1% taylor-quotient [122] 41.9% ------------------------------------------------------------------------- make-multiplication-subnode [108]100.0% [115] 2276(2.0%) 1274(1.1%) for-loop ...tlock/herbie/src/core/reduce.rkt:233:3 partition [135] 17.9% parse-loop12 [75] 8.8% compose [176] 8.7% map [120] 8.6% ------------------------------------------------------------------------- errors [109] 100.0% [116] 1862(1.6%) 220(0.2%) for-loop ...e/ztatlock/herbie/src/points.rkt:147:4 ??? [121] 88.2% ------------------------------------------------------------------------- hash-update! [110] 100.0% [117] 1634(1.4%) 196(0.2%) ??? .../ztatlock/herbie/src/core/egraph.rkt:225:24 for-loop [123] 88.0% ------------------------------------------------------------------------- make-exacts* [56] 24.0% loop [46] 25.5% errors [109] 50.5% [118] 832(0.7%) 420(0.4%) eval-prog ...tatlock/herbie/src/programs.rkt:162:0 hash-ref! [133] 49.5% ------------------------------------------------------------------------- for-loop [111] 100.0% [119] 220(0.2%) 220(0.2%) ??? ...ket/collects/racket/private/for.rkt:1150:14 ------------------------------------------------------------------------- for-loop [115] 0.0% parse-loop12 [75] 0.1% gather-multiplicative-terms [169] 1.2% loop [57] 10.2% make-exacts* [56] 16.5% f16 [154] 71.1% [120] 52852(46.6%) 1084(1.0%) map ...acket/collects/racket/private/map.rkt:21:13 f16 [154] 55.3% loop [147] 26.8% simplify-node [148] 6.9% parse-loop12 [75] 3.8% make-multiplication-node [99] 1.1% gather-multiplicative-terms [169] 1.0% taylor-invert [5] 0.8% ->flonum [161] 0.8% taylor-quotient [122] 0.8% taylor [9] 0.6% make-addition-node [128] 0.4% loop [130] 0.4% ??? [132] 0.1% ------------------------------------------------------------------------- for-loop [116] 7.5% loop [147] 92.5% [121] 21788(19.2%) 402(0.4%) ??? /home/ztatlock/herbie/src/programs.rkt:168:4 ??? [127] 59.5% loop [147] 19.7% real->bigfloat [158] 6.0% ??? [156] 5.7% ...e/case-arrow.rkt:150:50 [163] 5.3% ->flonum [161] 1.9% ------------------------------------------------------------------------- map [120] 11.2% f16 [154] 23.2% for-loop [114] 29.2% approximate9 [107] 36.4% [122] 3666(3.2%) 0(0.0%) taylor-quotient ...erbie/src/core/taylor.rkt:328:0 first-nonzero-exp [126] 77.3% simplify [141] 22.7% ------------------------------------------------------------------------- ??? [117] 100.0% [123] 1438(1.3%) 1236(1.1%) for-loop ...lock/herbie/src/core/egraph.rkt:226:26 update-en-expr [175] 14.0% ------------------------------------------------------------------------- localize-error [60] 40.7% group-by68 [113] 59.3% [124] 1028(0.9%) 610(0.5%) sort ...ket/collects/racket/private/sort.rkt:213:0 errors-score [137] 21.2% jloop [131] 19.5% ------------------------------------------------------------------------- group-by68 [113] 100.0% [125] 198(0.2%) 0(0.0%) for-loop .../racket/collects/racket/list.rkt:783:4 hash-update [129] 100.0% ------------------------------------------------------------------------- taylor-quotient [122] 17.3% taylor-invert [5] 82.7% [126] 16356(14.4%) 0(0.0%) first-nonzero-exp ...bie/src/core/taylor.rkt:260:0 hash-ref! [133] 100.0% ------------------------------------------------------------------------- ??? [121] 100.0% [127] 12968(11.4%) 200(0.2%) ??? ...acket/collects/racket/private/kw.rkt:400:14 ??? [149] 38.3% ...higher-order.rkt:373:33 [134] 28.8% bf* [143] 25.7% bfcube [136] 3.9% ??? [173] 1.7% ------------------------------------------------------------------------- parse-loop12 [75] 47.1% map [120] 52.9% [128] 1078(1.0%) 196(0.2%) make-addition-node ...ie/src/core/reduce.rkt:199:0 parse-loop12 [75] 49.1% partition [135] 42.1% loop [139] 6.5% ------------------------------------------------------------------------- for-loop [125] 19.6% group-by68 [113] 80.4% [129] 1012(0.9%) 1012(0.9%) hash-update ...cket/private/more-scheme.rkt:356:13 ------------------------------------------------------------------------- parse-loop12 [75] 3.6% map [120] 4.1% loop [130] 92.3% [130] 420(0.4%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:37:19 loop [130] 92.3% ??? [138] 4.1% ->flonum [161] 3.6% ------------------------------------------------------------------------- sort [124] 100.0% [131] 200(0.2%) 0(0.0%) jloop ...et/collects/racket/private/sort.rkt:85:19 errors-score [137] 100.0% ------------------------------------------------------------------------- map [120] 100.0% [132] 198(0.2%) 0(0.0%) ??? /home/ztatlock/herbie/src/core/reduce.rkt:52:5 for-loop [140] 100.0% ------------------------------------------------------------------------- for-loop [22] 0.1% eval-prog [118] 0.2% for-loop [21] 0.3% compile [72] 0.3% for-loop [171] 0.4% for-loop [19] 0.4% for-loop [27] 0.5% ??? [10] 0.6% loop [147] 0.7% localize-error [60] 0.8% for-loop [17] 3.3% ??? [4] 3.4% first-nonzero-exp [126] 5.3% ??? [26] 9.7% loop [112] 11.3% for-loop [15] 15.3% ??? [142] 45.0% [133] 44644(39.4%) 3596(3.2%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [142] 45.0% ??? [3] 24.3% simplify [141] 10.2% ??? [4] 5.7% ??? [6] 3.3% parse-loop12 [75] 2.3% f16 [154] 2.1% taylor-invert [5] 1.7% ??? [8] 0.7% ??? [10] 0.7% ??? [12] 0.5% bigfloat-hash [144] 0.2% taylor [9] 0.1% ??? [13] 0.0% ------------------------------------------------------------------------- ??? [127] 100.0% [134] 3740(3.3%) 304(0.3%) ...higher-order.rkt:373:33 (unknown source) ??? [150] 91.9% ------------------------------------------------------------------------- for-loop [115] 47.3% make-addition-node [128] 52.7% [135] 862(0.8%) 862(0.8%) partition ...racket/collects/racket/list.rkt:547:0 ------------------------------------------------------------------------- ??? [127] 100.0% [136] 500(0.4%) 0(0.0%) bfcube ...tlock/herbie/src/syntax/syntax.rkt:119:0 bf* [143] 57.6% ...ow-val-first.rkt:357:18 [145] 42.4% ------------------------------------------------------------------------- jloop [131] 47.8% sort [124] 52.2% [137] 418(0.4%) 0(0.0%) errors-score ...atlock/herbie/src/points.rkt:154:0 loop [147] 100.0% ------------------------------------------------------------------------- loop [130] 100.0% [138] 222(0.2%) 0(0.0%) ??? ...ztatlock/herbie/src/core/localize.rkt:43:32 ->flonum [161] 100.0% ------------------------------------------------------------------------- make-addition-node [128] 100.0% [139] 210(0.2%) 210(0.2%) loop ...hare/racket/collects/racket/list.rkt:551:2 ------------------------------------------------------------------------- ??? [132] 100.0% [140] 198(0.2%) 0(0.0%) for-loop ...atlock/herbie/src/core/reduce.rkt:53:7 pattern-match [146] 100.0% ------------------------------------------------------------------------- taylor-quotient [122] 2.0% loop [147] 2.0% for-loop [19] 2.1% ??? [4] 2.9% taylor-invert [5] 3.1% for-loop [15] 9.4% hash-ref! [133] 77.9% [141] 41126(36.3%) 198(0.2%) simplify ...atlock/herbie/src/core/reduce.rkt:18:0 f16 [154] 85.6% debug-print [151] 5.7% parse-loop12 [75] 3.1% simplify-node [148] 2.1% debug7 [152] 1.5% make-multiplication-node [99] 1.5% ------------------------------------------------------------------------- hash-ref! [133] 100.0% [142] 39316(34.7%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:63:15 hash-ref! [133] 100.0% ------------------------------------------------------------------------- bfcube [136] 7.9% ??? [127] 92.1% [143] 3624(3.2%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [149] 100.0% ------------------------------------------------------------------------- hash-ref! [133] 100.0% [144] 412(0.4%) 200(0.2%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [153] 51.5% ------------------------------------------------------------------------- bfcube [136] 100.0% [145] 212(0.2%) 0(0.0%) ...ow-val-first.rkt:357:18 (unknown source) ??? [150] 100.0% ------------------------------------------------------------------------- for-loop [140] 100.0% [146] 198(0.2%) 198(0.2%) pattern-match .../herbie/src/core/matcher.rkt:47:0 ------------------------------------------------------------------------- errors-score [137] 0.0% make-exacts* [56] 0.0% match-e [55] 0.5% for-loop [67] 0.6% ??? [121] 0.8% map-enodes [32] 1.2% map [120] 1.3% loop! [157] 1.5% post-process [43] 1.9% taylor [9] 1.9% extract-alt [47] 3.9% append-map [65] 4.3% parse-loop12 [75] 4.6% loop [147] 76.4% [147] 42972(37.9%) 2830(2.5%) loop ...cket/collects/racket/private/map.rkt:26:19 loop [147] 76.4% taylor-alt [74] 4.3% simplify [2] 3.9% f16 [154] 2.4% simplify [141] 1.9% completely-simplify-alt [7] 1.7% loop! [157] 1.5% for-loop [162] 1.2% foldl [164] 1.0% hash-ref! [133] 1.0% ->flonum [161] 0.7% ??? [121] 0.4% localize-error [60] 0.2% ??? [156] 0.0% real->bigfloat [158] 0.0% ...e/case-arrow.rkt:150:50 [163] 0.0% ------------------------------------------------------------------------- parse-loop12 [75] 1.0% simplify [141] 4.2% map [120] 94.8% [148] 20960(18.5%) 418(0.4%) simplify-node ...k/herbie/src/core/reduce.rkt:41:0 append-map [65] 79.7% combine-aterms [160] 10.6% f16 [154] 8.7% ------------------------------------------------------------------------- bf* [143] 42.2% ??? [127] 57.8% [149] 8596(7.6%) 538(0.5%) ??? ...-racket/utils/simple-result-arrow.rkt:26:12 bfmul [155] 74.3% ??? [167] 16.1% bfcbrt [166] 3.3% ------------------------------------------------------------------------- ...ow-val-first.rkt:357:18 [145] 5.8% ...higher-order.rkt:373:33 [134] 94.2% [150] 3648(3.2%) 0(0.0%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [156] 100.0% ------------------------------------------------------------------------- for-loop [66] 7.9% taylor [9] 19.3% simplify [141] 72.8% [151] 3196(2.8%) 616(0.5%) debug-print ...ztatlock/herbie/src/debug.rkt:107:0 for-loop [159] 80.7% ------------------------------------------------------------------------- simplify [141] 43.0% taylor [9] 57.0% [152] 1478(1.3%) 438(0.4%) debug7 /home/ztatlock/herbie/src/debug.rkt:102:0 ??? [69] 41.3% return/no-unsupplied [165] 29.1% ------------------------------------------------------------------------- bigfloat-hash [144] 100.0% [153] 212(0.2%) 212(0.2%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ------------------------------------------------------------------------- simplify-node [148] 0.3% loop [147] 0.6% approximate9 [107] 0.6% for-loop [114] 1.0% composed [168] 1.2% for-loop [88] 1.2% parse-loop12 [75] 2.4% hash-ref! [133] 3.5% f16 [154] 5.4% append-map [65] 7.3% simplify [141] 18.8% map [120] 57.0% [154] 41290(36.4%) 4014(3.5%) f16 ...t/collects/racket/match/compiler.rkt:499:40 map [120] 74.0% append-map [65] 8.4% f16 [154] 5.4% gather-multiplicative-terms [169] 2.0% taylor-invert [5] 1.5% composed [168] 1.4% taylor [9] 0.7% combine-mterms [11] 0.6% taylor-quotient [122] 0.5% parse-loop12 [75] 0.4% compose [176] 0.0% ------------------------------------------------------------------------- ??? [149] 100.0% [155] 6386(5.6%) 4706(4.2%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [170] 26.3% ------------------------------------------------------------------------- ??? [69] 3.4% loop [147] 11.7% ??? [121] 21.5% ??? [150] 63.4% [156] 5756(5.1%) 196(0.2%) ??? ...ects/racket/contract/private/guts.rkt:638:8 ??? [167] 96.6% ------------------------------------------------------------------------- for-loop [80] 3.2% apply-match [45] 5.8% for-loop [58] 19.6% merge-egraph-nodes! [68] 33.7% loop [147] 37.8% [157] 3426(3.0%) 840(0.7%) loop! .../ztatlock/herbie/src/core/enode.rkt:163:2 loop [147] 37.8% set [172] 19.1% custom-set-union [177] 18.6% update-en-expr [175] 9.4% ------------------------------------------------------------------------- ??? [121] 38.9% loop [147] 61.1% [158] 3374(3.0%) 2628(2.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [170] 22.1% ------------------------------------------------------------------------- debug-print [151] 100.0% [159] 2580(2.3%) 2580(2.3%) for-loop /home/ztatlock/herbie/src/debug.rkt:113:2 ------------------------------------------------------------------------- simplify-node [148] 100.0% [160] 2230(2.0%) 218(0.2%) combine-aterms ...herbie/src/core/reduce.rkt:174:0 for-loop [171] 90.2% ------------------------------------------------------------------------- loop [130] 10.2% ??? [138] 11.5% ??? [121] 21.7% map [120] 22.6% loop [147] 34.1% [161] 1938(1.7%) 418(0.4%) ->flonum ...ock/herbie/src/syntax/syntax.rkt:224:0 ??? [173] 53.6% ??? [167] 24.9% ------------------------------------------------------------------------- loop [147] 100.0% [162] 1486(1.3%) 196(0.2%) for-loop ...ock/herbie/src/core/simplify.rkt:161:2 setfindf [174] 73.5% curried [181] 13.3% ------------------------------------------------------------------------- loop [147] 19.9% ??? [121] 80.1% [163] 1434(1.3%) 1434(1.3%) ...e/case-arrow.rkt:150:50 (unknown source) ------------------------------------------------------------------------- loop [147] 100.0% [164] 658(0.6%) 220(0.2%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [178] 66.6% ------------------------------------------------------------------------- debug7 [152] 100.0% [165] 430(0.4%) 430(0.4%) return/no-unsupplied ...ct/private/arr-i.rkt:534:0 ------------------------------------------------------------------------- ??? [149] 100.0% [166] 284(0.3%) 284(0.3%) bfcbrt ...lib/math/private/bigfloat/mpfr.rkt:616:4 ------------------------------------------------------------------------- ->flonum [161] 6.5% ??? [149] 18.7% ??? [156] 74.8% [167] 7430(6.6%) 2662(2.3%) ??? ...tract/private/arrow-higher-order.rkt:373:33 ??? [179] 60.5% ??? [183] 3.7% ------------------------------------------------------------------------- f16 [154] 100.0% [168] 5410(4.8%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 f16 [154] 88.2% free-variables [180] 11.8% ------------------------------------------------------------------------- map [120] 27.0% f16 [154] 73.0% [169] 4676(4.1%) 3390(3.0%) gather-multiplicative-terms ...re/reduce.rkt:107:0 map [120] 40.9% curried [181] 9.3% curry* [185] 4.3% ------------------------------------------------------------------------- real->bigfloat [158] 30.8% bfmul [155] 69.2% [170] 2426(2.1%) 2426(2.1%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------- combine-aterms [160] 100.0% [171] 2012(1.8%) 478(0.4%) for-loop ...tlock/herbie/src/core/reduce.rkt:176:4 hash-ref! [133] 76.2% ------------------------------------------------------------------------- new-enode [83] 24.0% loop! [157] 76.0% [172] 1718(1.5%) 1718(1.5%) set ...collects/racket/private/set-types.rkt:982:0 ------------------------------------------------------------------------- ??? [127] 14.8% sample-default [73] 15.6% ->flonum [161] 69.7% [173] 1490(1.3%) 1490(1.3%) ??? /home/ztatlock/herbie/src/config.rkt:29:0 ------------------------------------------------------------------------- for-loop [162] 100.0% [174] 1092(1.0%) 874(0.8%) setfindf ...e/ztatlock/herbie/src/common.rkt:173:0 for-loop [184] 20.0% ------------------------------------------------------------------------- for-loop [123] 19.0% for-loop [82] 20.5% loop! [157] 60.5% [175] 1064(0.9%) 1064(0.9%) update-en-expr ...herbie/src/core/egraph.rkt:211:0 ------------------------------------------------------------------------- for-loop [115] 23.9% f16 [154] 25.8% make-multiplication-subnode [108] 50.4% [176] 830(0.7%) 830(0.7%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------- loop! [157] 100.0% [177] 636(0.6%) 198(0.2%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [182] 68.9% ------------------------------------------------------------------------- foldl [164] 100.0% [178] 438(0.4%) 438(0.4%) merge2 ...ztatlock/herbie/src/core/ematch.rkt:31:0 ------------------------------------------------------------------------- ??? [167] 100.0% [179] 4494(4.0%) 3382(3.0%) ??? ...llects/racket/contract/combinator.rkt:178:4 any-wrap/traverse [186] 24.7% ------------------------------------------------------------------------- composed [168] 30.4% append-map [65] 69.6% [180] 2106(1.9%) 1888(1.7%) free-variables ...ock/herbie/src/programs.rkt:89:0 constant? [187] 10.4% ------------------------------------------------------------------------- for-loop [162] 16.1% taylor [9] 16.1% for-loop [67] 32.4% gather-multiplicative-terms [169] 35.4% [181] 1230(1.1%) 1230(1.1%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------- custom-set-union [177] 100.0% [182] 438(0.4%) 200(0.2%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [188] 54.3% ------------------------------------------------------------------------- ??? [167] 100.0% [183] 274(0.2%) 274(0.2%) ??? ...ects/racket/contract/private/prop.rkt:489:4 ------------------------------------------------------------------------- setfindf [174] 100.0% [184] 218(0.2%) 218(0.2%) for-loop ...e/ztatlock/herbie/src/common.rkt:174:2 ------------------------------------------------------------------------- gather-multiplicative-terms [169]100.0% [185] 200(0.2%) 200(0.2%) curry* ...racket/collects/racket/function.rkt:44:2 ------------------------------------------------------------------------- ??? [179] 100.0% [186] 1112(1.0%) 1112(1.0%) any-wrap/traverse ...cket/utils/any-wrap.rkt:106:2 ------------------------------------------------------------------------- taylor [9] 47.8% free-variables [180] 52.2% [187] 418(0.4%) 418(0.4%) constant? ...ck/herbie/src/syntax/syntax.rkt:221:0 ------------------------------------------------------------------------- for-loop [182] 100.0% [188] 238(0.2%) 238(0.2%) for-loop ...cts/racket/private/set-types.rkt:178:5 -------------------------------------------------------------------------