Profiling results ----------------- Total cpu time observed: 126918ms (out of 127912ms) Number of samples taken: 554 (once every 229ms) (Hiding functions with self<1.0% and local<2.0%: 2 of 198 hidden) ========================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================= ??? [57] 100.0% [1] 109950(86.6%) 0(0.0%) profile-thunk14 ...t/pkgs/profile-lib/main.rkt:9:0 run [14] 100.0% ------------------------------------------------------------------------- ??? [57] 100.0% [2] 83668(65.9%) 0(0.0%) run-improve58 ...ock/herbie/src/mainloop.rkt:242:0 for-loop [15] 75.6% finalize-table! [18] 11.8% get-final-combination [19] 10.8% loop [68] 1.3% setup-prog [23] 0.5% ------------------------------------------------------------------------- simplify-alt [35] 0.6% loop [144] 1.8% ??? [57] 97.6% [3] 63134(49.7%) 0(0.0%) simplify ...lock/herbie/src/core/simplify.rkt:39:0 simplify-expr [16] 58.5% for-loop [17] 35.3% iterate-egraph!5 [27] 5.6% loop [31] 0.3% debug7 [179] 0.3% ------------------------------------------------------------------------- loop [144] 100.0% [4] 6124(4.8%) 0(0.0%) completely-simplify-alt ...erbie/src/glue.rkt:87:0 simplify-expr [16] 100.0% ------------------------------------------------------------------------- sort [70] 11.3% copying-mergesort [82] 88.7% [5] 1944(1.5%) 0(0.0%) jloop ...et/collects/racket/private/sort.rkt:85:19 ??? [109] 88.7% errors-score [117] 11.3% ------------------------------------------------------------------------- hash-ref! [130] 100.0% [6] 828(0.7%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:295:23 for-loop [20] 100.0% ------------------------------------------------------------------------- hash-ref! [130] 100.0% [7] 606(0.5%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:392:23 for-loop [21] 100.0% ------------------------------------------------------------------------- hash-ref! [130] 100.0% [8] 424(0.3%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:285:26 for-loop [22] 100.0% ------------------------------------------------------------------------- hash-ref! [130] 100.0% [9] 222(0.2%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:322:33 for-loop [24] 100.0% ------------------------------------------------------------------------- f94 [157] 100.0% [10] 202(0.2%) 0(0.0%) taylor-quotient ...erbie/src/core/taylor.rkt:328:0 simplify [151] 100.0% ------------------------------------------------------------------------- hash-ref! [130] 100.0% [11] 202(0.2%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:338:33 hash-ref! [130] 66.7% for-loop [25] 33.3% ------------------------------------------------------------------------- map [108] 100.0% [12] 200(0.2%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:221:0 make-multiplication-subnode [26]100.0% ------------------------------------------------------------------------- f94 [157] 100.0% [13] 200(0.2%) 0(0.0%) loop .../ztatlock/herbie/src/core/taylor.rkt:262:2 simplify [151] 100.0% ------------------------------------------------------------------------- profile-thunk14 [1] 100.0% [14] 109950(86.6%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:31:2 ??? [57] 100.0% ------------------------------------------------------------------------- run-improve58 [2] 100.0% [15] 63230(49.8%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:253:8 run-iter! [28] 100.0% ------------------------------------------------------------------------- completely-simplify-alt [4] 14.2% simplify [3] 85.8% [16] 43064(33.9%) 0(0.0%) simplify-expr ...herbie/src/core/simplify.rkt:68:0 iterate-egraph!5 [27] 96.0% loop [31] 3.0% mk-egraph [34] 1.0% ------------------------------------------------------------------------- simplify [3] 100.0% [17] 22262(17.5%) 724(0.6%) for-loop ...ock/herbie/src/core/simplify.rkt:61:12 iterate-egraph!5 [27] 93.9% loop [31] 2.8% ------------------------------------------------------------------------- run-improve58 [2] 100.0% [18] 9900(7.8%) 0(0.0%) finalize-table! ...k/herbie/src/mainloop.rkt:264:0 post-process [29] 100.0% ------------------------------------------------------------------------- run-improve58 [2] 100.0% [19] 9076(7.2%) 0(0.0%) get-final-combination ...ie/src/mainloop.rkt:269:0 split-table [30] 87.6% extract-alt [32] 12.4% ------------------------------------------------------------------------- ??? [6] 100.0% [20] 828(0.7%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:298:27 hash-ref! [130] 100.0% ------------------------------------------------------------------------- ??? [7] 100.0% [21] 606(0.5%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:396:33 for-loop [33] 100.0% ------------------------------------------------------------------------- ??? [8] 100.0% [22] 424(0.3%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:285:52 hash-ref! [130] 52.4% ??? [36] 47.6% ------------------------------------------------------------------------- run-improve58 [2] 100.0% [23] 400(0.3%) 0(0.0%) setup-prog /home/ztatlock/herbie/src/glue.rkt:46:0 simplify-alt [35] 100.0% ------------------------------------------------------------------------- ??? [9] 100.0% [24] 222(0.2%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:324:46 hash-ref! [130] 100.0% ------------------------------------------------------------------------- ??? [11] 100.0% [25] 202(0.2%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:341:46 hash-ref! [130] 100.0% ------------------------------------------------------------------------- make-multiplication-node [12] 100.0% [26] 200(0.2%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:231:0 for-loop [37] 100.0% ------------------------------------------------------------------------- simplify [3] 5.3% for-loop [17] 31.8% simplify-expr [16] 62.9% [27] 65762(51.8%) 424(0.3%) iterate-egraph!5 ...bie/src/core/simplify.rkt:95:0 one-iter [38] 96.2% map-enodes [43] 3.2% ------------------------------------------------------------------------- for-loop [15] 100.0% [28] 63230(49.8%) 0(0.0%) run-iter! ...tatlock/herbie/src/mainloop.rkt:223:0 simplify! [39] 96.4% finalize-iter! [44] 2.7% gen-series! [46] 0.3% localize-error [153] 0.3% gen-rewrites! [47] 0.3% ------------------------------------------------------------------------- finalize-table! [18] 100.0% [29] 9900(7.8%) 0(0.0%) post-process .../ztatlock/herbie/src/glue.rkt:95:0 loop [144] 68.5% for-loop [41] 27.0% localize-error [153] 2.4% ??? [52] 2.0% ------------------------------------------------------------------------- get-final-combination [19] 100.0% [30] 7950(6.3%) 0(0.0%) split-table .../ztatlock/herbie/src/glue.rkt:171:0 infer-splitpoints4 [40] 92.2% ??? [52] 7.8% ------------------------------------------------------------------------- simplify [3] 10.3% for-loop [17] 29.1% simplify-expr [16] 60.7% [31] 2146(1.7%) 0(0.0%) loop ...tatlock/herbie/src/core/simplify.rkt:203:2 pass [42] 100.0% ------------------------------------------------------------------------- get-final-combination [19] 100.0% [32] 1126(0.9%) 0(0.0%) extract-alt ...e/ztatlock/herbie/src/glue.rkt:57:0 loop [144] 100.0% ------------------------------------------------------------------------- for-loop [21] 100.0% [33] 606(0.5%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:398:39 hash-ref! [130] 100.0% ------------------------------------------------------------------------- simplify-expr [16] 100.0% [34] 426(0.3%) 0(0.0%) mk-egraph ...lock/herbie/src/core/egraph.rkt:123:0 expr->enode [45] 100.0% ------------------------------------------------------------------------- setup-prog [23] 100.0% [35] 400(0.3%) 0(0.0%) simplify-alt .../ztatlock/herbie/src/glue.rkt:84:0 simplify [3] 100.0% ------------------------------------------------------------------------- for-loop [22] 100.0% [36] 202(0.2%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:288:19 hash-ref! [130] 100.0% ------------------------------------------------------------------------- make-multiplication-subnode [26]100.0% [37] 200(0.2%) 0(0.0%) for-loop ...tlock/herbie/src/core/reduce.rkt:233:3 map [108] 100.0% ------------------------------------------------------------------------- iterate-egraph!5 [27] 100.0% [38] 63264(49.8%) 1928(1.5%) one-iter ...ock/herbie/src/core/simplify.rkt:106:0 for-loop [49] 59.2% loop [50] 36.7% apply-match [58] 1.0% ------------------------------------------------------------------------- run-iter! [28] 100.0% [39] 60946(48.0%) 0(0.0%) simplify! ...tatlock/herbie/src/mainloop.rkt:162:0 for-loop [48] 100.0% ------------------------------------------------------------------------- split-table [30] 100.0% [40] 7326(5.8%) 0(0.0%) infer-splitpoints4 ...ie/src/core/regimes.rkt:19:0 option-on-expr [51] 100.0% ------------------------------------------------------------------------- post-process [29] 100.0% [41] 2676(2.1%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:119:17 append-map [53] 100.0% ------------------------------------------------------------------------- loop [31] 100.0% [42] 2146(1.7%) 0(0.0%) pass ...tatlock/herbie/src/core/simplify.rkt:193:2 for-loop [54] 100.0% ------------------------------------------------------------------------- iterate-egraph!5 [27] 100.0% [43] 2074(1.6%) 0(0.0%) map-enodes ...ock/herbie/src/core/egraph.rkt:139:0 loop [144] 80.5% for-loop [152] 19.5% ------------------------------------------------------------------------- run-iter! [28] 100.0% [44] 1680(1.3%) 0(0.0%) finalize-iter! ...ck/herbie/src/mainloop.rkt:177:0 ??? [52] 100.0% ------------------------------------------------------------------------- mk-egraph [34] 29.0% expr->enode [45] 71.0% [45] 426(0.3%) 0(0.0%) expr->enode ...ck/herbie/src/core/egraph.rkt:124:2 expr->enode [45] 71.0% mk-enode! [98] 29.0% ------------------------------------------------------------------------- run-iter! [28] 100.0% [46] 202(0.2%) 0(0.0%) gen-series! ...tlock/herbie/src/mainloop.rkt:134:0 for-loop [55] 100.0% ------------------------------------------------------------------------- run-iter! [28] 100.0% [47] 200(0.2%) 0(0.0%) gen-rewrites! ...ock/herbie/src/mainloop.rkt:148:0 for-loop [56] 100.0% ------------------------------------------------------------------------- simplify! [39] 98.9% [48] 61608(48.5%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:166:6 ??? [57] 100.0% ------------------------------------------------------------------------- for-loop [49] 49.1% one-iter [38] 50.9% [49] 37462(29.5%) 8966(7.1%) for-loop ...ck/herbie/src/core/simplify.rkt:116:12 for-loop [49] 49.1% match-e [69] 37.7% ??? [112] 0.3% ------------------------------------------------------------------------- one-iter [38] 100.0% [50] 23214(18.3%) 200(0.2%) loop ...cket/collects/racket/private/map.rkt:53:19 apply-match [58] 99.1% ------------------------------------------------------------------------- infer-splitpoints4 [40] 100.0% [51] 7326(5.8%) 0(0.0%) option-on-expr ...erbie/src/core/regimes.rkt:106:0 sort-context-on-expr [59] 91.4% pick-errors [64] 8.6% ------------------------------------------------------------------------- debug7 [179] 7.4% post-process [29] 7.4% split-table [30] 23.1% finalize-iter! [44] 62.1% [52] 2704(2.1%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [61] 69.5% split-atab [65] 23.1% ??? [187] 7.4% ------------------------------------------------------------------------- f94 [157] 12.2% for-loop [41] 87.8% [53] 2676(2.1%) 202(0.2%) append-map ...acket/collects/racket/list.rkt:565:2 taylor-alt [60] 72.8% loop [144] 15.0% f94 [157] 10.7% ------------------------------------------------------------------------- pass [42] 100.0% [54] 2146(1.7%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:196:29 argmin [62] 50.4% for-loop [63] 39.3% make-sequence [66] 10.3% ------------------------------------------------------------------------- gen-series! [46] 100.0% [55] 202(0.2%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:140:7 taylor-alt [60] 100.0% ------------------------------------------------------------------------- gen-rewrites! [47] 100.0% [56] 200(0.2%) 0(0.0%) for-loop ...tatlock/herbie/src/mainloop.rkt:153:11 ??? [67] 100.0% ------------------------------------------------------------------------- for-loop [48] 18.5% run [14] 38.0% [57] 122336(96.4%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk14 [1] 38.0% run-improve58 [2] 27.8% simplify [3] 18.5% loop [68] 15.7% ------------------------------------------------------------------------- one-iter [38] 2.8% loop [50] 97.2% [58] 23674(18.7%) 202(0.2%) apply-match .../herbie/src/core/simplify.rkt:122:2 merge-egraph-nodes! [81] 29.9% match-e [69] 25.2% loop! [150] 14.6% for-loop [72] 11.0% update-leader! [95] 9.1% mk-enode! [98] 4.6% substitute-e [85] 3.8% reduce-to-single! [77] 1.0% ------------------------------------------------------------------------- option-on-expr [51] 100.0% [59] 6698(5.3%) 0(0.0%) sort-context-on-expr ...herbie/src/points.rkt:50:0 sort [70] 100.0% ------------------------------------------------------------------------- for-loop [55] 7.0% loop [144] 14.0% append-map [53] 79.0% [60] 2878(2.3%) 0(0.0%) taylor-alt ...e/ztatlock/herbie/src/glue.rkt:142:0 for-loop [71] 100.0% ------------------------------------------------------------------------- ??? [52] 100.0% [61] 1880(1.5%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:51:2 atab-add-altn [73] 100.0% ------------------------------------------------------------------------- for-loop [54] 100.0% [62] 1082(0.9%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 expression-cost [74] 100.0% ------------------------------------------------------------------------- for-loop [54] 100.0% [63] 844(0.7%) 844(0.7%) for-loop ...ck/herbie/src/core/simplify.rkt:183:13 ------------------------------------------------------------------------- option-on-expr [51] 100.0% [64] 628(0.5%) 0(0.0%) pick-errors ...k/herbie/src/core/regimes.rkt:173:0 for-loop [75] 100.0% ------------------------------------------------------------------------- ??? [52] 100.0% [65] 624(0.5%) 0(0.0%) split-atab ...k/herbie/src/core/alt-table.rkt:74:0 for-loop [76] 100.0% ------------------------------------------------------------------------- for-loop [54] 100.0% [66] 220(0.2%) 220(0.2%) make-sequence ...ects/racket/private/for.rkt:508:2 ------------------------------------------------------------------------- for-loop [56] 100.0% [67] 200(0.2%) 0(0.0%) ??? /home/ztatlock/herbie/src/alternative.rkt:90:0 rewriter [78] 100.0% ------------------------------------------------------------------------- run-improve58 [2] 2.7% ??? [57] 97.3% [68] 39068(30.8%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:122:2 loop [79] 46.1% make-exacts* [92] 31.4% loop [93] 22.5% ------------------------------------------------------------------------- apply-match [58] 12.7% for-loop [94] 13.7% for-loop [49] 73.5% [69] 34234(27.0%) 20172(15.9%) match-e ...tatlock/herbie/src/core/ematch.rkt:46:0 for-loop [80] 33.4% for-loop [94] 8.4% list-cartesian-product [97] 2.9% loop [144] 2.6% curry* [104] 0.6% ------------------------------------------------------------------------- localize-error [153] 5.9% sort-context-on-expr [59] 94.1% [70] 7118(5.6%) 0(0.0%) sort ...ket/collects/racket/private/sort.rkt:213:0 copying-mergesort [82] 72.6% loop [96] 24.3% jloop [5] 3.1% ------------------------------------------------------------------------- taylor-alt [60] 100.0% [71] 2878(2.3%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:144:2 location-do [83] 100.0% ------------------------------------------------------------------------- apply-match [58] 100.0% [72] 2614(2.1%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:136:10 loop! [150] 42.3% merge-egraph-nodes! [81] 33.1% substitute-e [85] 24.6% ------------------------------------------------------------------------- for-loop [61] 100.0% [73] 1880(1.5%) 0(0.0%) atab-add-altn ...rbie/src/core/alt-table.rkt:208:0 best-and-tied-at-points [84] 100.0% ------------------------------------------------------------------------- argmin [62] 100.0% [74] 1082(0.9%) 0(0.0%) expression-cost ...k/herbie/src/programs.rkt:212:0 compile [86] 100.0% ------------------------------------------------------------------------- pick-errors [64] 100.0% [75] 628(0.5%) 0(0.0%) for-loop ...lock/herbie/src/core/regimes.rkt:176:4 eval-prog [123] 100.0% ------------------------------------------------------------------------- split-atab [65] 100.0% [76] 624(0.5%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:75:2 for-loop [88] 35.6% for-loop [89] 32.4% for-loop [91] 32.1% ------------------------------------------------------------------------- apply-match [58] 100.0% [77] 238(0.2%) 0(0.0%) reduce-to-single! ...bie/src/core/egraph.rkt:324:0 for-loop [87] 100.0% ------------------------------------------------------------------------- ??? [67] 33.3% matcher [107] 66.7% [78] 200(0.2%) 0(0.0%) rewriter ...lock/herbie/src/core/matcher.rkt:123:2 for-loop [90] 100.0% ------------------------------------------------------------------------- loop [68] 100.0% [79] 17996(14.2%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:93:2 make-exacts* [92] 45.3% loop [93] 44.5% eval-prog [123] 10.2% ------------------------------------------------------------------------- match-e [69] 100.0% [80] 13348(10.5%) 6426(5.1%) for-loop ...tlock/herbie/src/core/ematch.rkt:59:11 for-loop [94] 35.6% list-cartesian-product [97] 15.4% loop [144] 4.4% curried [163] 0.8% curry* [104] 0.8% filter [103] 0.7% ------------------------------------------------------------------------- merge-egraph-nodes! [81] 1.4% for-loop [72] 10.9% apply-match [58] 87.7% [81] 7938(6.3%) 400(0.3%) merge-egraph-nodes! ...e/src/core/egraph.rkt:152:0 update-leader! [95] 72.4% for-loop [101] 11.1% loop! [150] 7.3% enode-merge! [105] 2.8% merge-egraph-nodes! [81] 1.4% ------------------------------------------------------------------------- copying-mergesort [82] 46.8% sort [70] 53.2% [82] 5166(4.1%) 0(0.0%) copying-mergesort .../racket/private/sort.rkt:91:4 copying-mergesort [82] 46.8% loop [96] 44.9% jloop [5] 8.3% ------------------------------------------------------------------------- for-loop [71] 42.1% location-do [83] 57.9% [83] 2878(2.3%) 0(0.0%) location-do ...tlock/herbie/src/programs.rkt:129:0 location-do [83] 57.9% approximate9 [99] 38.6% simplify [151] 3.5% ------------------------------------------------------------------------- atab-add-altn [73] 100.0% [84] 1880(1.5%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [100] 89.4% for-loop [106] 10.6% ------------------------------------------------------------------------- substitute-e [85] 7.8% for-loop [72] 33.8% apply-match [58] 58.4% [85] 1548(1.2%) 242(0.2%) substitute-e ...ck/herbie/src/core/ematch.rkt:71:0 mk-enode! [98] 84.4% substitute-e [85] 7.8% ------------------------------------------------------------------------- expression-cost [74] 100.0% [86] 1082(0.9%) 0(0.0%) compile .../ztatlock/herbie/src/programs.rkt:189:0 hash-ref! [130] 100.0% ------------------------------------------------------------------------- reduce-to-single! [77] 100.0% [87] 238(0.2%) 238(0.2%) for-loop ...tlock/herbie/src/core/egraph.rkt:325:8 ------------------------------------------------------------------------- for-loop [76] 100.0% [88] 222(0.2%) 0(0.0%) for-loop ...ck/herbie/src/core/alt-table.rkt:80:53 filter [103] 100.0% ------------------------------------------------------------------------- for-loop [76] 100.0% [89] 202(0.2%) 0(0.0%) for-loop ...ck/herbie/src/core/alt-table.rkt:86:30 ??? [102] 100.0% ------------------------------------------------------------------------- rewriter [78] 100.0% [90] 200(0.2%) 0(0.0%) for-loop ...ock/herbie/src/core/matcher.rkt:126:10 matcher [107] 100.0% ------------------------------------------------------------------------- for-loop [76] 100.0% [91] 200(0.2%) 0(0.0%) for-loop ...ck/herbie/src/core/alt-table.rkt:76:45 ??? [102] 100.0% ------------------------------------------------------------------------- loop [79] 39.9% loop [68] 60.1% [92] 20430(16.1%) 0(0.0%) make-exacts* ...tatlock/herbie/src/points.rkt:80:0 map [108] 48.8% loop [144] 42.6% eval-prog [123] 8.6% ------------------------------------------------------------------------- loop [79] 47.7% loop [68] 52.3% [93] 16798(13.2%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:83:4 map [108] 100.0% ------------------------------------------------------------------------- match-e [69] 43.5% for-loop [80] 56.5% [94] 11050(8.7%) 704(0.6%) for-loop ...tlock/herbie/src/core/ematch.rkt:65:37 match-e [69] 84.0% ??? [112] 9.6% ------------------------------------------------------------------------- apply-match [58] 27.2% merge-egraph-nodes! [81] 72.8% [95] 7894(6.2%) 848(0.7%) update-leader! ...herbie/src/core/egraph.rkt:217:0 for-loop [110] 83.9% custom-set-union! [118] 2.8% update-en-expr [158] 2.5% ------------------------------------------------------------------------- sort [70] 33.5% copying-mergesort [82] 66.5% [96] 5174(4.1%) 0(0.0%) loop ...cket/collects/racket/private/sort.rkt:64:8 ??? [109] 96.1% errors-score [117] 3.9% ------------------------------------------------------------------------- list-cartesian-product [97] 22.0% match-e [69] 25.0% for-loop [80] 53.1% [97] 3474(2.7%) 3050(2.4%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [97] 22.0% for-loop [115] 6.1% ------------------------------------------------------------------------- expr->enode [45] 15.1% apply-match [58] 38.5% substitute-e [85] 46.3% [98] 2818(2.2%) 1936(1.5%) mk-enode! ...lock/herbie/src/core/egraph.rkt:101:0 new-enode [114] 16.3% hash-has-key? [116] 15.0% ------------------------------------------------------------------------- location-do [83] 100.0% [99] 2676(2.1%) 0(0.0%) approximate9 ...ck/herbie/src/core/taylor.rkt:11:0 loop [111] 54.2% f94 [157] 45.8% ------------------------------------------------------------------------- best-and-tied-at-points [84] 100.0% [100] 1680(1.3%) 0(0.0%) errors /home/ztatlock/herbie/src/points.rkt:144:0 for-loop [113] 72.5% eval-prog [123] 27.5% ------------------------------------------------------------------------- merge-egraph-nodes! [81] 100.0% [101] 884(0.7%) 680(0.5%) for-loop ...tlock/herbie/src/core/egraph.rkt:232:6 update-en-expr [158] 23.1% ------------------------------------------------------------------------- for-loop [91] 32.1% for-loop [89] 32.4% filter [103] 35.6% [102] 624(0.5%) 0(0.0%) ??? .../ztatlock/herbie/src/core/regimes.rkt:291:8 eval-prog [123] 100.0% ------------------------------------------------------------------------- for-loop [80] 47.4% for-loop [88] 52.6% [103] 422(0.3%) 200(0.2%) filter ...t/collects/racket/private/list.rkt:256:2 ??? [102] 52.6% ------------------------------------------------------------------------- match-e [69] 49.8% for-loop [80] 50.2% [104] 402(0.3%) 200(0.2%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [120] 50.2% ------------------------------------------------------------------------- merge-egraph-nodes! [81] 100.0% [105] 220(0.2%) 0(0.0%) enode-merge! ...ck/herbie/src/core/enode.rkt:100:0 adopt-enode! [119] 100.0% ------------------------------------------------------------------------- best-and-tied-at-points [84] 100.0% [106] 200(0.2%) 200(0.2%) for-loop ...k/herbie/src/core/alt-table.rkt:124:16 ------------------------------------------------------------------------- for-loop [122] 40.0% for-loop [90] 60.0% [107] 200(0.2%) 0(0.0%) matcher ...tlock/herbie/src/core/matcher.rkt:159:2 for-loop [122] 40.0% rewriter [78] 40.0% cp-2 [121] 20.0% ------------------------------------------------------------------------- for-loop [37] 0.3% f94 [157] 7.5% make-exacts* [92] 34.3% loop [93] 57.8% [108] 29066(22.9%) 402(0.3%) map ...acket/collects/racket/private/map.rkt:21:13 loop [144] 92.3% f94 [157] 2.6% ??? [125] 2.0% parse-loop12 [140] 0.8% ??? [149] 0.7% taylor [172] 0.4% make-multiplication-node [12] 0.3% ------------------------------------------------------------------------- jloop [5] 25.7% loop [96] 74.3% [109] 6698(5.3%) 404(0.3%) ??? /home/ztatlock/herbie/src/points.rkt:52:27 eval-prog [123] 81.6% ??? [149] 12.4% ------------------------------------------------------------------------- update-leader! [95] 100.0% [110] 6624(5.2%) 0(0.0%) for-loop ...tlock/herbie/src/core/egraph.rkt:222:6 for-loop [124] 100.0% ------------------------------------------------------------------------- approximate9 [99] 100.0% [111] 1450(1.1%) 0(0.0%) loop ...e/ztatlock/herbie/src/core/taylor.rkt:82:4 hash-ref! [130] 100.0% ------------------------------------------------------------------------- for-loop [49] 17.2% for-loop [94] 82.8% [112] 1288(1.0%) 864(0.7%) ??? /home/ztatlock/herbie/src/core/ematch.rkt:50:5 for-loop [126] 32.9% ------------------------------------------------------------------------- errors [100] 100.0% [113] 1218(1.0%) 398(0.3%) for-loop ...e/ztatlock/herbie/src/points.rkt:147:4 ??? [149] 67.3% ------------------------------------------------------------------------- mk-enode! [98] 100.0% [114] 460(0.4%) 220(0.2%) new-enode ...atlock/herbie/src/core/enode.rkt:68:0 check-valid-enode5 [127] 52.2% ------------------------------------------------------------------------- list-cartesian-product [97] 100.0% [115] 424(0.3%) 424(0.3%) for-loop ...atlock/herbie/src/core/ematch.rkt:24:8 ------------------------------------------------------------------------- mk-enode! [98] 100.0% [116] 422(0.3%) 422(0.3%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ------------------------------------------------------------------------- loop [96] 47.6% jloop [5] 52.4% [117] 420(0.3%) 220(0.2%) errors-score ...atlock/herbie/src/points.rkt:154:0 loop [144] 47.6% ------------------------------------------------------------------------- update-leader! [95] 100.0% [118] 222(0.2%) 0(0.0%) custom-set-union! ...t/private/set-types.rkt:246:0 for-loop [128] 100.0% ------------------------------------------------------------------------- enode-merge! [105] 100.0% [119] 220(0.2%) 0(0.0%) adopt-enode! ...ock/herbie/src/core/enode.rkt:76:0 custom-set-union [160] 100.0% ------------------------------------------------------------------------- curry* [104] 100.0% [120] 202(0.2%) 202(0.2%) procedure-arity ...ket/private/norm-arity.rkt:7:27 ------------------------------------------------------------------------- matcher [107] 100.0% [121] 200(0.2%) 0(0.0%) cp-2 ...hare/racket/collects/racket/list.rkt:804:2 for-loop [129] 100.0% ------------------------------------------------------------------------- matcher [107] 100.0% [122] 200(0.2%) 0(0.0%) for-loop ...ock/herbie/src/core/matcher.rkt:175:21 matcher [107] 100.0% ------------------------------------------------------------------------- errors [100] 4.3% ??? [102] 5.8% for-loop [75] 5.8% make-exacts* [92] 16.3% loop [79] 17.1% ??? [109] 50.7% [123] 10780(8.5%) 5456(4.3%) eval-prog ...tatlock/herbie/src/programs.rkt:162:0 hash-ref! [130] 39.0% ??? [132] 6.5% go [133] 2.1% inductor [134] 1.9% ------------------------------------------------------------------------- for-loop [110] 100.0% [124] 6624(5.2%) 0(0.0%) for-loop ...tlock/herbie/src/core/egraph.rkt:223:8 hash-update! [131] 100.0% ------------------------------------------------------------------------- loop [144] 44.7% map [108] 55.3% [125] 1526(1.2%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [130] 44.7% f94 [157] 42.2% taylor-invert [135] 13.1% ------------------------------------------------------------------------- ??? [112] 100.0% [126] 424(0.3%) 424(0.3%) for-loop ...atlock/herbie/src/core/ematch.rkt:51:7 ------------------------------------------------------------------------- new-enode [114] 100.0% [127] 240(0.2%) 240(0.2%) check-valid-enode5 ...bie/src/core/enode.rkt:177:0 ------------------------------------------------------------------------- custom-set-union! [118] 100.0% [128] 222(0.2%) 222(0.2%) for-loop ...cts/racket/private/set-types.rkt:254:4 ------------------------------------------------------------------------- cp-2 [121] 100.0% [129] 200(0.2%) 200(0.2%) for-loop .../racket/collects/racket/list.rkt:805:4 ------------------------------------------------------------------------- for-loop [25] 0.3% ??? [36] 0.3% for-loop [24] 0.4% ??? [11] 0.6% for-loop [22] 0.9% for-loop [33] 1.4% localize-error [153] 1.8% for-loop [20] 1.8% ??? [141] 2.7% ??? [139] 5.6% loop [111] 5.6% compile [86] 6.1% ??? [125] 7.4% ??? [137] 8.5% eval-prog [123] 14.1% loop [144] 42.6% [130] 7414(5.8%) 1682(1.3%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [137] 51.0% bigfloat-hash [138] 11.6% parse-loop12 [140] 7.9% ??? [139] 5.6% ??? [141] 2.7% simplify [151] 2.7% f94 [157] 2.3% ??? [6] 1.8% ??? [7] 1.4% taylor [172] 1.3% ??? [8] 1.2% ??? [11] 0.9% ??? [9] 0.4% ------------------------------------------------------------------------- for-loop [124] 100.0% [131] 6624(5.2%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [136] 100.0% ------------------------------------------------------------------------- eval-prog [123] 100.0% [132] 700(0.6%) 220(0.2%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [142] 68.6% ------------------------------------------------------------------------- eval-prog [123] 100.0% [133] 224(0.2%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [143] 100.0% ------------------------------------------------------------------------- eval-prog [123] 33.3% inductor [134] 66.7% [134] 200(0.2%) 200(0.2%) inductor .../ztatlock/herbie/src/programs.rkt:73:2 inductor [134] 66.7% ------------------------------------------------------------------------- ??? [125] 100.0% [135] 200(0.2%) 0(0.0%) taylor-invert .../herbie/src/core/taylor.rkt:312:0 simplify [151] 100.0% ------------------------------------------------------------------------- hash-update! [131] 100.0% [136] 6624(5.2%) 0(0.0%) ??? .../ztatlock/herbie/src/core/egraph.rkt:225:24 for-loop [145] 100.0% ------------------------------------------------------------------------- hash-ref! [130] 100.0% [137] 5084(4.0%) 0(0.0%) ??? /home/ztatlock/herbie/src/programs.rkt:197:5 loop [144] 82.6% hash-ref! [130] 17.4% ------------------------------------------------------------------------- hash-ref! [130] 100.0% [138] 3600(2.8%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [146] 74.2% sig+exp->bigfloat [147] 25.8% ------------------------------------------------------------------------- hash-ref! [130] 100.0% [139] 1450(1.1%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:63:15 hash-ref! [130] 100.0% ------------------------------------------------------------------------- parse-loop12 [140] 7.8% map [108] 39.2% hash-ref! [130] 53.0% [140] 1288(1.0%) 404(0.3%) parse-loop12 ...s/racket/match/compiler.rkt:410:15 loop [144] 53.0% parse-loop12 [140] 7.8% parse-app [148] 7.8% f94 [157] 7.8% ------------------------------------------------------------------------- hash-ref! [130] 100.0% [141] 1028(0.8%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:42:15 hash-ref! [130] 100.0% ------------------------------------------------------------------------- ??? [132] 100.0% [142] 480(0.4%) 480(0.4%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ------------------------------------------------------------------------- go [133] 100.0% [143] 224(0.2%) 224(0.2%) loop ...llects/racket/private/qq-and-or.rkt:101:61 ------------------------------------------------------------------------- errors-score [117] 0.0% make-exacts* [92] 0.2% parse-loop12 [140] 0.4% map-enodes [43] 0.6% append-map [53] 0.7% f94 [157] 0.8% extract-alt [32] 0.8% match-e [69] 1.2% for-loop [80] 1.2% map [108] 1.6% post-process [29] 1.8% loop! [150] 3.5% ??? [137] 6.5% loop [144] 80.8% [144] 55360(43.6%) 1682(1.3%) loop ...cket/collects/racket/private/map.rkt:26:19 loop [144] 80.8% hash-ref! [130] 6.5% loop! [150] 3.0% ??? [149] 1.7% completely-simplify-alt [4] 1.3% curried [163] 0.8% simplify [3] 0.8% simplify [151] 0.8% taylor-alt [60] 0.7% for-loop [152] 0.6% localize-error [153] 0.4% ??? [125] 0.3% real->bigfloat [159] 0.0% ->flonum [164] 0.0% ??? [183] 0.0% ------------------------------------------------------------------------- ??? [136] 100.0% [145] 6624(5.2%) 5486(4.3%) for-loop ...lock/herbie/src/core/egraph.rkt:226:26 update-en-expr [158] 17.2% ------------------------------------------------------------------------- bigfloat-hash [138] 100.0% [146] 2670(2.1%) 2448(1.9%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 bigfloat->sig+exp [155] 8.3% ------------------------------------------------------------------------- bigfloat-hash [138] 100.0% [147] 930(0.7%) 472(0.4%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 integer->mpz [154] 49.2% ------------------------------------------------------------------------- parse-loop12 [140] 100.0% [148] 202(0.2%) 202(0.2%) parse-app .../collects/racket/private/kw.rkt:903:2 ------------------------------------------------------------------------- map [108] 0.5% for-loop [113] 2.2% ??? [109] 2.3% loop [144] 95.0% [149] 36704(28.9%) 966(0.8%) ??? /home/ztatlock/herbie/src/programs.rkt:168:4 ??? [156] 89.4% real->bigfloat [159] 4.2% ??? [187] 3.3% ->flonum [164] 0.5% ------------------------------------------------------------------------- merge-egraph-nodes! [81] 8.7% for-loop [72] 10.5% loop [144] 29.5% apply-match [58] 51.2% [150] 5242(4.1%) 1546(1.2%) loop! .../ztatlock/herbie/src/core/enode.rkt:163:2 loop [144] 41.4% custom-set-union [160] 18.8% set [161] 12.4% update-en-expr [158] 6.4% ------------------------------------------------------------------------- taylor-invert [135] 8.9% loop [13] 8.9% taylor-quotient [10] 9.0% location-do [83] 9.0% loop [144] 18.7% hash-ref! [130] 45.6% [151] 2254(1.8%) 0(0.0%) simplify ...atlock/herbie/src/core/reduce.rkt:18:0 f94 [157] 82.2% debug7 [179] 9.0% simplify* [168] 8.9% ------------------------------------------------------------------------- map-enodes [43] 19.5% loop [144] 80.5% [152] 2074(1.6%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:161:2 setfindf [162] 49.8% composed [171] 10.6% eval-const-expr [166] 10.6% compose [167] 9.7% ->flonum [164] 9.6% curried [163] 9.6% ------------------------------------------------------------------------- run-iter! [28] 18.3% post-process [29] 21.8% loop [144] 59.9% [153] 1102(0.9%) 0(0.0%) localize-error ...erbie/src/core/localize.rkt:47:0 hash-ref! [130] 61.9% sort [70] 38.1% ------------------------------------------------------------------------- sig+exp->bigfloat [147] 100.0% [154] 458(0.4%) 458(0.4%) integer->mpz ...math/private/bigfloat/gmp.rkt:87:0 ------------------------------------------------------------------------- bfcanonicalize [146] 100.0% [155] 222(0.2%) 0(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:370:0 new-mpz [165] 100.0% ------------------------------------------------------------------------- ??? [149] 100.0% [156] 32804(25.8%) 2492(2.0%) ??? ...acket/collects/racket/private/kw.rkt:400:14 ??? [183] 45.2% bf* [178] 20.1% bfcube [169] 15.3% ...higher-order.rkt:373:33 [170] 11.1% ...higher-order.rkt:369:33 [174] 0.7% ------------------------------------------------------------------------- composed [171] 2.1% parse-loop12 [140] 2.3% ??? [125] 4.6% append-map [53] 6.4% hash-ref! [130] 9.7% approximate9 [99] 10.4% map [108] 19.9% simplify [151] 21.5% f94 [157] 23.1% [157] 2918(2.3%) 642(0.5%) f94 ...t/collects/racket/match/compiler.rkt:499:40 map [108] 46.9% f94 [157] 23.1% append-map [53] 7.8% loop [144] 3.1% taylor [172] 2.3% taylor-quotient [10] 2.3% composed [171] 2.1% loop [13] 1.7% ------------------------------------------------------------------------- update-leader! [95] 9.1% for-loop [101] 9.2% loop! [150] 30.2% for-loop [145] 51.5% [158] 2208(1.7%) 2208(1.7%) update-en-expr ...herbie/src/core/egraph.rkt:211:0 ------------------------------------------------------------------------- loop [144] 11.7% ??? [149] 88.3% [159] 1732(1.4%) 1280(1.0%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [191] 26.1% ------------------------------------------------------------------------- adopt-enode! [119] 16.6% loop! [150] 83.4% [160] 1326(1.0%) 660(0.5%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [173] 33.5% for-loop [175] 16.7% ------------------------------------------------------------------------- loop! [150] 100.0% [161] 1304(1.0%) 1304(1.0%) set ...collects/racket/private/set-types.rkt:982:0 ------------------------------------------------------------------------- for-loop [152] 100.0% [162] 1032(0.8%) 1032(0.8%) setfindf ...e/ztatlock/herbie/src/common.rkt:173:0 ------------------------------------------------------------------------- for-loop [152] 22.6% for-loop [80] 25.1% loop [144] 52.4% [163] 886(0.7%) 886(0.7%) curried ...cket/collects/racket/function.rkt:71:18 ------------------------------------------------------------------------- ??? [149] 24.4% for-loop [152] 24.7% loop [144] 50.9% [164] 810(0.6%) 200(0.2%) ->flonum ...ock/herbie/src/syntax/syntax.rkt:224:0 ??? [176] 27.2% ??? [177] 24.4% ??? [190] 23.7% ------------------------------------------------------------------------- bigfloat->sig+exp [155] 100.0% [165] 222(0.2%) 222(0.2%) new-mpz ...-lib/math/private/bigfloat/gmp.rkt:73:0 ------------------------------------------------------------------------- for-loop [152] 100.0% [166] 220(0.2%) 220(0.2%) eval-const-expr ...k/herbie/src/programs.rkt:180:0 ------------------------------------------------------------------------- for-loop [152] 100.0% [167] 202(0.2%) 202(0.2%) compose ...collects/racket/private/list.rkt:385:12 ------------------------------------------------------------------------- simplify [151] 100.0% [168] 200(0.2%) 200(0.2%) simplify* ...tlock/herbie/src/core/reduce.rkt:23:0 ------------------------------------------------------------------------- ??? [156] 100.0% [169] 5006(3.9%) 0(0.0%) bfcube ...tlock/herbie/src/syntax/syntax.rkt:119:0 bf* [178] 95.6% ...ow-val-first.rkt:357:18 [182] 4.4% ------------------------------------------------------------------------- ??? [156] 100.0% [170] 3642(2.9%) 234(0.2%) ...higher-order.rkt:373:33 (unknown source) ??? [184] 68.7% ??? [187] 24.9% ------------------------------------------------------------------------- for-loop [152] 34.3% f94 [157] 65.7% [171] 642(0.5%) 220(0.2%) composed ...ollects/racket/private/list.rkt:321:16 f94 [157] 65.7% ------------------------------------------------------------------------- hash-ref! [130] 32.1% f94 [157] 32.4% map [108] 35.6% [172] 624(0.5%) 0(0.0%) taylor ...tatlock/herbie/src/core/taylor.rkt:157:0 debug-print [180] 64.4% debug7 [179] 35.6% ------------------------------------------------------------------------- custom-set-union [160] 100.0% [173] 444(0.3%) 444(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 ------------------------------------------------------------------------- ??? [156] 100.0% [174] 232(0.2%) 0(0.0%) ...higher-order.rkt:369:33 (unknown source) ??? [187] 100.0% ------------------------------------------------------------------------- custom-set-union [160] 100.0% [175] 222(0.2%) 0(0.0%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [181] 100.0% ------------------------------------------------------------------------- ->flonum [164] 100.0% [176] 220(0.2%) 220(0.2%) ??? ...-racket/utils/simple-result-arrow.rkt:47:15 ------------------------------------------------------------------------- ->flonum [164] 100.0% [177] 198(0.2%) 198(0.2%) ??? /home/ztatlock/herbie/src/config.rkt:29:0 ------------------------------------------------------------------------- bfcube [169] 42.0% ??? [156] 58.0% [178] 11390(9.0%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [183] 100.0% ------------------------------------------------------------------------- simplify [3] 32.1% simplify [151] 32.4% taylor [172] 35.6% [179] 624(0.5%) 202(0.2%) debug7 /home/ztatlock/herbie/src/debug.rkt:102:0 ??? [185] 35.6% ??? [52] 32.1% ------------------------------------------------------------------------- taylor [172] 100.0% [180] 402(0.3%) 402(0.3%) debug-print ...ztatlock/herbie/src/debug.rkt:107:0 ------------------------------------------------------------------------- for-loop [175] 100.0% [181] 222(0.2%) 222(0.2%) for-loop ...cts/racket/private/set-types.rkt:178:5 ------------------------------------------------------------------------- bfcube [169] 100.0% [182] 218(0.2%) 0(0.0%) ...ow-val-first.rkt:357:18 (unknown source) ??? [184] 100.0% ------------------------------------------------------------------------- loop [144] 1.8% bf* [178] 42.7% ??? [156] 55.5% [183] 26700(21.0%) 4976(3.9%) ??? ...-racket/utils/simple-result-arrow.rkt:26:12 bfadd [186] 58.3% ??? [190] 14.1% bfcbrt [188] 9.0% ------------------------------------------------------------------------- ...ow-val-first.rkt:357:18 [182] 8.0% ...higher-order.rkt:373:33 [170] 92.0% [184] 2720(2.1%) 0(0.0%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [187] 100.0% ------------------------------------------------------------------------- debug7 [179] 100.0% [185] 222(0.2%) 0(0.0%) ??? ...racket/collects/racket/private/kw.rkt:713:9 ??? [189] 100.0% ------------------------------------------------------------------------- ??? [183] 100.0% [186] 15556(12.3%) 11482(9.0%) bfadd ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [191] 26.2% ------------------------------------------------------------------------- ??? [52] 3.8% ...higher-order.rkt:369:33 [174] 4.4% ...higher-order.rkt:373:33 [170] 17.2% ??? [149] 22.9% ??? [184] 51.7% [187] 5264(4.1%) 194(0.2%) ??? ...ects/racket/contract/private/guts.rkt:638:8 ??? [190] 92.5% dict? [192] 3.8% ------------------------------------------------------------------------- ??? [183] 100.0% [188] 2392(1.9%) 1214(1.0%) bfcbrt ...lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [191] 49.2% ------------------------------------------------------------------------- ??? [185] 100.0% [189] 222(0.2%) 222(0.2%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ------------------------------------------------------------------------- ->flonum [164] 2.2% ??? [183] 42.7% ??? [187] 55.1% [190] 8838(7.0%) 3234(2.5%) ??? ...tract/private/arrow-higher-order.rkt:373:33 ??? [193] 60.9% ??? [194] 2.5% ------------------------------------------------------------------------- real->bigfloat [159] 7.9% bfcbrt [188] 20.7% bfadd [186] 71.4% [191] 5704(4.5%) 5704(4.5%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ------------------------------------------------------------------------- ??? [187] 100.0% [192] 200(0.2%) 200(0.2%) dict? ...ollects/racket/private/generic.rkt:146:11 ------------------------------------------------------------------------- ??? [190] 100.0% [193] 5382(4.2%) 3070(2.4%) ??? ...llects/racket/contract/combinator.rkt:178:4 any-wrap/traverse [195] 43.0% ------------------------------------------------------------------------- ??? [190] 100.0% [194] 222(0.2%) 0(0.0%) ??? ...ects/racket/contract/private/prop.rkt:489:4 ??? [196] 100.0% ------------------------------------------------------------------------- ??? [193] 100.0% [195] 2312(1.8%) 2312(1.8%) any-wrap/traverse ...cket/utils/any-wrap.rkt:106:2 ------------------------------------------------------------------------- ??? [194] 100.0% [196] 222(0.2%) 222(0.2%) ??? ...lects/racket/contract/private/orc.rkt:73:14 -------------------------------------------------------------------------