Originally published as JHC exPRESS on March 3, 2008. doi:10.1369/jhc.2008.950394
Volume 56 (6): 569-577, 2008 Copyright ©The Histochemical Society, Inc. Expression and Synthesis of Bone Morphogenetic Proteins by Osteoclasts: A Possible Path to Anabolic Bone Remodeling
Departments of Pathology and Laboratory Medicine (RG,SET,FB,NN,HCA) and Orthopedic Surgery (JW), University of Kansas Medical Center, Kansas City, Kansas; University of Missouri, Kansas City, Missouri (JZ); and Yale University School of Medicine, New Haven, Connecticut (BHS,KI) Correspondence to: H. Clarke Anderson, MD, University of Kansas Medical Center, Department of Pathology, Kansas City, KS 66160. E-mail: handerso{at}kumc.edu
Skeletal remodeling is a finely orchestrated process coupling bone formation to bone resorption. The dynamics of coupling is regulated by the microenvironment at the bone remodeling site, which in turn is influenced by the intercellular communication between cells like osteoclasts and osteoblasts. Understanding the dynamics of coupling is important in devising new therapeutic approaches to the treatment of skeletal diseases characterized by disturbances in the bone remodeling process. In this study, we report the localization of bone morphogenetic proteins (BMPs) in osteoclasts generated from primary cocultures of bone marrow cells from mouse femur and tibia with mouse calvarial osteoblasts, using immunocytochemistry and in situ hybridization. Positive staining was seen in osteoclasts for BMP-2, -4, -6, and -7. Real-time PCR was used to quantitatively confirm the expression of transcripts for BMP-2, BMP-4, and BMP-6 mRNA in murine osteoclasts. Finally, the presence of BMP-2, -4, -6, and-7 proteins was confirmed in osteoclast lysates by Western blotting. Overall, our data suggest a possible direct role for osteoclasts in promoting bone formation via expression and synthesis of BMPs, which then would play an important role in promoting the recruitment, proliferation, and differentiation of osteoblasts at bone resorption sites. (J Histochem Cytochem 56:569–577, 2008)
Key Words: bone morphogenetic proteins skeletal remodeling coupling osteoclasts osteoblasts
SKELETAL REMODELING depends upon the coupling of bone formation with bone resorption in a dynamically regulated process involving intercellular communication between osteoblasts and osteoclasts. Osteoblasts are bone-forming cells that originate from mesenchymal stem cells, whereas osteoclasts are multinucleate, bone-resorbing cells that originate from hematopoietic precursors of the monocyte-macrophage lineage. The remodeling process (Parfitt 1982 B ligand (RANK-L) (Takahashi et al. 1999
It is now well established that osteoclast differentiation is regulated by many systemic hormones and local cytokines, including tumor necrosis factor- In this study, we report the localization and expression of BMPs in osteoclasts generated from primary cocultures of bone marrow cells with mouse calvarial osteoblasts, using immunocytochemistry, in situ hybridization, quantitative real-time PCR, and Western blotting. Our working hypothesis is that BMPs expressed by osteoclasts recruit osteoblasts to a bone resorption site, thus initiating the anabolic phase of bone remodeling.
Osteoclastogenesis in Cocultured Mouse Calvarial Osteoblasts and Bone Marrow (BM) Primary osteoblast cultures were prepared from 1- or 2-day-old CD1 mouse calvaria (Ecarot-Charrier et al. 1983 -MEM mineralizing medium containing 10% FBS, 2.5 mM β-glycerophosphate, and 10–8 M 1 ,25-(OH)2 vitamin D3 for 2 days prior to coculture with bone marrow cells. Multiple-passaged osteoblasts up to the fifth passage supported the formation of multinucleate, TRAP-positive osteoclasts from bone marrow. Bone marrow was obtained by aspiration from femurs and tibiae of 8-week-old CD1 mice. Adherent nucleated marrow cells (0.5 x 106/8.6-cm2 surface area) were cocultured with confluent osteoblast cultures in phenol red–free -MEM medium containing 10% FBS and supplemented with 10–8 M 1 ,25-(OH)2 vitamin D3 and 10–6 M prostaglandin E2 at 37C for 15 days in a humidified atmosphere of 5% CO2. The medium was changed every other day. After 15 days, the cocultures were prepared for TRAP staining, BMP-immunocytochemistry, and in situ hybridization.
Separation of Osteoclasts from Osteoblast-BM Cocultures
TRAP Staining
In Situ Hybridization
Real-time RT-PCR Analyses Total RNA was extracted from adherent osteoclasts that were separated from osteoblasts as described above, using RNeasy Mini Kits (Qiagen; Santa Clara, CA). Total RNA was also extracted from mouse calvarial primary osteoblasts, and served as positive control. Reverse transcription reactions were performed in a 20-µl reaction volume containing 10x PCR buffer, MgCl2, dNTPs, murine leukemia virus reverse transcriptase, oligo dT, total RNA (1 µg) using the reaction conditions specified for the reverse transcription kit (Promega; Madison, WI). The cDNA was stored at –20C until further use.
Real-time quantitative PCR was performed in a 20-µl reaction volume using the standard protocols of Applied Biosystems 7500 Sequence Detection System and software (Applied Biosystems; Foster City, CA) using 1:10 diluted cDNA, Universal PCR Master Mix kit, SYBR green, and 300–900 nM of each primer. Primer pairs of BMP-2, BMP-4, BMP-6, and BMP-7 were obtained using a search in Prime Bank (BMP-2 ID#, 6680794a1; BMP-4 ID#, 6680796a2; BMP-6 ID#, 6680798a2; BMP-7 ID#, 31982487a2) (Wang and Seed 2003
Immunocytochemistry
Western Blotting
Statistical Analyses
TRAP Staining Osteoclasts generated from marrow cocultures with osteoblasts (as described in Materials and Methods), were recognized by their multinuclearity and positive TRAP staining (Figure 1 ).
In Situ Hybridization To detect the presence of BMP-2, -4, and -6 transcripts in the osteoclasts, a non-radioactive in situ hybridization was utilized. Hybridization with an anti-sense probe to BMP-2 and BMP-4 showed a positive signal, indicating the presence of BMP-2 and -4 mRNA, whereas the BMP-6 anti-sense probe showed a more intense expression of BMP-6 mRNA in cultured osteoclasts (Figures 2A –2C).
Immunocytochemistry Osteoclasts generated from marrow cocultures with osteoblasts showed positive immunostaining for BMP-2, -4, -6, and -7. Moderate to intense immunostaining for BMP-2, -4, -6, and -7 was detected within the cytoplasm of culture-generated osteoclasts (Figures 3A –3D). No immune reaction was detected in the presence of a non-immune serum-negative control (Figure 3E). The more conspicuous blue-violet color in the negative control is due to lack of peroxidase staining, whereas the brown peroxidase staining is indicative of a positive immune reaction, as shown in Figure 3.
Real-time RT PCR Real-time RT PCR analysis revealed that osteoclasts are able to synthesize mRNAs for BMP-2, -4, -6, and -7 (Figure 4 ). Expression of BMP-6 mRNA was the greatest of all the BMPs tested, at 18 times higher than expression in the osteoblast positive control (Figure 4).
Western Blot Analyses Western blots (Figure 5 ) confirmed the presence of BMPs at expected mature monomeric 18- to 21-kDa molecular mass (as seen in BMP-2, BMP-6, and BMP-7 expression in osteoclasts). Our finding of higher molecular forms of BMPs in osteoclasts might reflect the presence of proteolytically uncleaved precursor forms of BMPs or bands generated from posttranslational modifications such as glycosylation (partial or complete), as seen in other studies reporting BMP protein expression (Shoda et al. 1993 45 kDa, 69 kDa, and 90 kDa in cultured osteoclasts, as previously reported in other cells (Boden et al. 1997
Recently, evidence has begun to emerge for a direct anabolic role of osteoclasts (via non-matrix–derived bone-inducing factors) in stimulating bone formation (Henriksen et al. 2006
Our data also suggest that there is a preferential expression of BMP-6 mRNA by osteoclasts versus the expression of BMP-2, -4, and -7 (Figure 4). This increased expression of BMP-6 by osteoclasts might play a dual role in not only stimulating osteoblastic precursors to undergo osteoblastic differentiation (Friedman et al. 2006
Our working hypothesis that osteoclastic BMPs might contribute to the anabolic path of bone remodeling fits very well with previous reports on osteoclastic stimulation of osteoblasts. Marrow monocytes, which are the precursors of osteoclasts, are capable of stimulating osteoblastic differentiation by marrow stromal osteoprogenitor cells in coculture (Aubin 1999
Sims et al. (2004) In summary, our findings confirm that BMPs are expressed and translated in osteoclasts. We suggest that BMPs from osteoclasts might possibly be involved in the initiation of the anabolic phase of bone remodeling. Future research studies will focus on exploring the exact role of different osteoclastic BMPs, particularly BMP-6, in stimulating the differentiation of preosteoblasts and steering them to form a calcificable bone matrix.
This research was supported by United States Public Health Service, National Institutes of Health Grant DEO-5262, and University of Kansas Medical Center Bridging Funds.
Received for publication November 27, 2007; accepted February 15, 2008
Ahmed N, Sammons J, Carson RJ, Khokher MA, Hassan HT (2001) Effect of bone morphogenetic protein-6 on haemopoietic stem cells and cytokine production in normal human bone marrow stroma. Cell Biol Int 25:429–435[CrossRef][Medline] Akiyoshi T, Uchida K, Tateyama S (2004) Expression of bone morphogenetic protein-6 and bone morphogenetic protein receptors in myoepithelial cells of canine mammary gland tumors. Vet Pathol 41:154–163 Anderson HC, Hodges PT, Aguilera XM, Missana L, Moylan PE (2000) Bone morphogenetic protein (BMP) localization in developing human and rat growth plate, metaphysis, epiphysis, and articular cartilage. J Histochem Cytochem 48:1493–1502 Aubin JE (1999) Osteoprogenitor cell frequency in rat bone marrow stromal populations: role for heterotypic cell-cell interactions in osteoblast differentiation. J Cell Biochem 72:396–410[CrossRef][Medline] Baylink DJ, Finkelman RD, Mohan S (1993) Growth factors to stimulate bone formation. J Bone Miner Res 8(suppl 2):565–572 Boden SD, Hair G, Titus L, Racine M, McCuaig K, Wozney JM, Nanes MS (1997) Glucocorticoid-induced differentiation of fetal rat calvarial osteoblasts is mediated by bone morphogenetic protein-6. Endocrinology 138:2820–2828 Centrella M, McCarthy TL, Canalis E (1991) Transforming growth factor-β and remodeling of bone. J Bone Joint Surg Am 73:1418–1428 Chubinskaya S, Merrihew C, Cs-Szabo G, Mollenhauer J, McCartney J, Rueger DC, Kuettner KE (2000) Human articular chondrocytes express osteogenic protein-1. J Histochem Cytochem 48:239–250 Dai XM, Zong XH, Akhter MP, Stanley ER (2004) Osteoclast deficiency results in disorganized matrix, reduced mineralization, and abnormal osteoblast behavior in developing bone. J Bone Miner Res 19:1441–1451[CrossRef][Medline] Dhanyamraju R, Sipe J, Zhang J, Xu Y, Osdoby P, Insogna K, Anderson HC (2003) Localization of bone morphogenetic proteins (BMPs) in osteoclasts. Transactions of 49th Annual Meeting of the Orthopaedic Research Society, New Orleans, LA Ecarot-Charrier B, Glorieux FH, van der Rest M, Pereira G (1983) Osteoblasts isolated from mouse calvaria initiate matrix mineralization in culture. J Cell Biol 96:639–643 Feng JQ, Zhang J, Dallas SL, Lu Y, Chen S, Tan X, Owen M, et al. (2002) Dentin matrix protein 1, a target molecule for Cbfa1 in bone, is a unique bone marker gene. J Bone Miner Res 17:1822–1831[CrossRef][Medline] Friedman MS, Long MW, Hankenson KD (2006) Osteogenic differentiation of human mesenchymal stem cells is regulated by bone morphogenetic protein-6. J Cell Biochem 98:538–554[CrossRef][Medline] Garimella R, Tague SE, Zhang J, Anderson HC (2006) Expression and synthesis of bone morphogenetic proteins (BMPs) in osteoclast cultures. Transactions of the 52nd Annual Meeting of the Orthopedic Research Society, Chicago, IL (Paper No: 1656) Grimsrud CD, Romano PR, DSouza M, Puzas JE, Reynolds PR, Rosier RN, OKeefe RJ (1999) BMP-6 is an autocrine stimulator of chondrocyte differentiation. J Bone Miner Res 14:475–482[CrossRef][Medline] Groeneveld EH, Burger EH (2000) Bone morphogenetic proteins in human bone regeneration. Eur J Endocrinol 142:9–21[Abstract] Hadjidakis DJ, Androulakis II (2006) Bone remodeling. Ann N Y Acad Sci 1092:385–396[CrossRef][Medline] Hayden JM, Mohan S, Baylink DJ (1995) The insulin-like growth factor system and the coupling of formation to resorption. Bone 17:93S–98S[CrossRef][Medline] Henriksen K, Pedersen AV, Christiansen C, Martin T, Karsdal M (2006) Osteoclasts secrete non-bone derived signals that induce bone nodule formation. J Bone Miner Res 21(suppl 1):M198 Hogan BL (1996) Bone morphogenetic proteins: multifunctional regulators of vertebrate development. Genes Dev 10:1580–1594 Howard GA, Bottemiller BL, Turner RT, Rader JI, Baylink DJ (1981) Parathyroid hormone stimulates bone formation and resorption in organ culture: evidence for a coupling mechanism. Proc Natl Acad Sci USA 78:3204–3208 Iwaniec UT, Magee KA, Mitova-Caneva NG, Wronski TJ (2003) Bone anabolic effects of subcutaneous treatment with basic fibroblast growth factor alone and in combination with estrogen in osteopenic ovariectomized rats. Bone 33:380–386 Jones WK, Richmond EA, White K, Sasak H, Kusmik W, Smart J, Oppermann H, et al. (1994) Osteogenic protein-1 (OP-1) expression and processing in Chinese hamster ovary cells: isolation of a soluble complex containing the mature and pro-domains of OP-1. Growth Factors 11:215–225[Medline] Kaneko H, Arakawa T, Mano H, Kaneda T, Ogasawara A, Nakagawa M, Toyama Y, et al. (2000) Direct stimulation of osteoclastic bone resorption by bone morphogenetic protein (BMP)-2 and expression of BMP receptors in mature osteoclasts. Bone 27:479–486[CrossRef][Medline] Karsdal M, Martin T, Bollerslev J, Christiansen C, Henriksen K (2007) Are Non-Resorbing Osteoclasts Sources of Bone Anabolic Activity? J Bone Miner Res 22:487–494[CrossRef][Medline] Kochanowska IE, Wlodarski K, Wojtowicz A, Kinsner A, Ostrowski K (2002) BMP-4 and BMP-6 involvement in the osteogenic properties of the HeLa cell line. Exp Biol Med (Maywood) 227:57–62 Koh AJ, Demiralp B, Neiva KG, Hooten J, Nohutcu RM, Shim H, Datta NS, et al. (2005) Cells of the osteoclast lineage as mediators of the anabolic actions of parathyroid hormone in bone. Endocrinology 146:4584–4596 Livak KJ, Schmittgen TD (2001) Analysis of relative gene expression data using real-time quantitative PCR and the 2(- Lories RJ, Derese I, Ceuppens JL, Luyten FP (2003) Bone morphogenetic proteins 2 and 6, expressed in arthritic synovium, are regulated by proinflammatory cytokines and differentially modulate fibroblast-like synoviocyte apoptosis. Arthritis Rheum 48:2807–2818[CrossRef][Medline] Martin TJ, Rodan GA (2001) Coupling of bone resorption and formation during bone remodeling. In Marcus R, ed. Osteoporosis. San Diego, Academic Press, 361–372 Martin TJ, Sims NA (2005) Osteoclast-derived activity in the coupling of bone formation to resorption. Trends Mol Med 11:76–81[CrossRef][Medline] McCullough KA, Waits CA, Garimella R, Tague SE, Sipe JB, Anderson HC (2007) Immunohistochemical localization of bone morphogenetic proteins (BMPs) 2, 4, 6, and 7 during induced heterotopic bone formation. J Orthop Res 25:465–472[CrossRef][Medline] Mitlak BH, Finkelman RD, Hill EL, Li J, Martin B, Smith T, DAndrea M, et al. (1996) The effect of systemically administered PDGF-BB on the rodent skeleton. J Bone Miner Res 11:238–247[Medline] Mohan S, Baylink DJ (1991) The role of IGF-II in the coupling of bone formation to resorption. In Spencer EM, ed. Modern Concepts of Insulin-like Growth Factors. New York, Elsevier, 19–174 Mundy GR (1993) Hormonal factors which regulate bone resorption. In Mundy GR, Martin TJ, eds. Handbook of Experimental Pharmacology: Physiology and Pharmacology of Bone. Heidelberg, Springer-Verlag, 215–238 Mundy GR, Bonewald LF (1990) Role of TGF β in bone remodeling. Ann N Y Acad Sci 593:91–97[Medline] Mundy GR, Elefteriou F (2006) Boning up on ephrin signaling. Cell 126:441–443[CrossRef][Medline] Nakamura M, Udagawa N, Matsuura S, Mogi M, Nakamura H, Horiuchi H, Saito N, et al. (2003) Osteoprotegerin regulates bone formation through a coupling mechanism with bone resorption. Endocrinology 144:5441–5449 Okamoto M, Murai J, Yoshikawa H, Tsumaki N (2006) Bone morphogenetic proteins in bone stimulate osteoclasts and osteoblasts during bone development. J Bone Miner Res 21:1022–1033[CrossRef] Onishi T, Ishidou Y, Nagamine T, Yone K, Imamura T, Kato M, Sampath TK, et al. (1998) Distinct and overlapping patterns of localization of bone morphogenetic protein (BMP) family members and a BMP type II receptor during fracture healing in rats. Bone 22:605–612[Medline] Parfitt AM (1982) The coupling of bone formation to bone resorption: a critical analysis of the concept and of its relevance to the pathogenesis of osteoporosis. Metab Bone Dis Relat Res 4:1–6[CrossRef][Medline] Parfitt AM (2004) What is the normal rate of bone remodeling? Bone 35:1–3 Reddi H (1995) Bone morphogenetic proteins. Adv Dent Res 9(suppl 3):13 Rickard DJ, Hofbauer LC, Bonde SK, Gori F, Spelsberg TC, Riggs BL (1998) Bone morphogenetic protein-6 production in human osteoblastic cell lines. Selective regulation by estrogen. J Clin Invest 101:413–422[Medline] Ripamonti U, Duneas N (1998) Tissue morphogenesis and regeneration by bone morphogenetic proteins. Plast Reconstr Surg 101:227–239 Robinson JA, Riggs BL, Spelsberg TC, Oursler MJ (1996) Osteoclasts and transforming growth factor-β: estrogen-mediated isoform-specific regulation of production. Endocrinology 137:615–621[Abstract] Sammons J, Ahmed N, El-Sheemy M, Hassan HT (2004) The role of BMP-6, IL-6, and BMP-4 in mesenchymal stem cell-dependent bone development: effects on osteoblastic differentiation induced by parathyroid hormone and vitamin D(3). Stem Cells Dev 13:273–280[CrossRef][Medline] Schwalbe M, Sanger J, Eggers R, Naumann A, Schmidt A, Hoffken K, Clement JH (2003) Differential expression and regulation of bone morphogenetic protein 7 in breast cancer. Int J Oncol 23:89–95[Medline] Schwartz Z, Lohmann CH, Wieland M, Cochran DL, Dean DD, Textor M, Bonewald LF, et al. (2000) Osteoblast proliferation and differentiation on dentin slices are modulated by pretreatment of the surface with tetracycline or osteoclasts. J Periodontol 71:586–597[CrossRef][Medline] Sheu TJ, Schwarz EM, Martinez DA, OKeefe RJ, Rosier RN, Zuscik MJ, Puzas JE (2003) A phage display technique identifies a novel regulator of cell differentiation. J Biol Chem 278:438–443 Sheu TJ, Schwarz EM, OKeefe RJ, Rosier RN, Puzas JE (2002) Use of a phage display technique to identify potential osteoblast binding sites within osteoclast lacunae. J Bone Miner Res 17:915–922[CrossRef][Medline] Shoda A, Murakami K, Ueno N (1993) Presence of high molecular weight forms of BMP-2 in early Xenopus embryos. Growth Factors 8:165–172[Medline] Simic P, Culej JB, Orlic I, Grgurevic L, Borovecki F, Vukicevic S (2005) BMP-6 restores bone in osteoporotic aged rats and, unlike estradiol and PTH, restores trabecular bone in ovariectomized BMP-6 knockout mice. J Bone Miner Res 20(suppl 1):8 Simic P, Culej JB, Orlic I, Grgurevic L, Draca N, Spaventi R, Vukicevic S (2006) Systemically administered bone morphogenetic protein-6 restores bone in aged ovariectomized rats by increasing bone formation and suppressing bone resorption. J Biol Chem 281:25509–25521 Sims NA, Jenkins BJ, Quinn JM, Nakamura A, Glatt M, Gillespie MT, Ernst M, et al. (2004) Glycoprotein 130 regulates bone turnover and bone size by distinct downstream signaling pathways. J Clin Invest 113:379–389[CrossRef][Medline] Solloway MJ, Dudley AT, Bikoff EK, Lyons KM, Hogan BL, Robertson EJ (1998) Mice lacking Bmp6 function. Dev Genet 22:321–339[CrossRef][Medline] Suzuki A, Nishimatsu S, Shoda A, Takebayashi K, Murakami K, Ueno N (1993) Biochemical properties of amphibian bone morphogenetic protein-4 expressed in CHO cells. Biochem J 291(Pt II):413–417[Medline] Takahashi N, Udagawa N, Suda T (1999) Role of osteoclast differentiation factor, the new member of the TNF ligand family, in osteoclast differentiation and function Seikagaku 71:241–253 Udagawa N, Itoh K, Li X, Ozawa H, Takahashi N (2002) Expression of osteoblast differentiation factor in mature osteoclasts. J Bone Miner Res 17:S344 Vukicevic S, Latin V, Chen P, Batorsky R, Reddi AH, Sampath TK (1994) Localization of osteogenic protein-1 (bone morphogenetic protein-7) during human embryonic development: high affinity binding to basement membranes. Biochem Biophys Res Commun 198:693–700[CrossRef][Medline] Wang X, Seed B (2003) A PCR primer bank for quantitative gene expression analysis. Nucleic Acids Res 31:e154 Whyte MP, Obrecht SE, Finnegan PM, Jones JL, Podgornik MN, McAlister WH, Mumm S (2002) Osteoprotegerin deficiency and juvenile Pagets disease. N Engl J Med 347:175–184 Wordinger RJ, Agarwal R, Talati M, Fuller J, Lambert W, Clark AF (2002) Expression of bone morphogenetic proteins (BMP), BMP receptors, and BMP associated proteins in human trabecular meshwork and optic nerve head cells and tissues. Mol Vis 8:241–250[Medline] Wozney JM (1992) The bone morphogenetic protein family and osteogenesis. Mol Reprod Dev 32:160–167[CrossRef][Medline] Wozney JM, Rosen V (1998) Bone morphogenetic protein and bone morphogenetic protein gene family in bone formation and repair. Clin Orthop Relat Res 346:26–37[Medline] Wutzl A, Brozek W, Lernbass I, Rauner M, Hofbauer G, Schopper C, Watzinger F, et al. (2006) Bone morphogenetic proteins 5 and 6 stimulate osteoclast generation. J Biomed Mater Res A 77:75–83 Yasuda H, Shima N, Nakagawa N, Yamaguchi K, Kinosaki M, Mochizuki S, Tomoyasu A, et al. (1998) Osteoclast differentiation factor is a ligand for osteoprotegerin/osteoclastogenesis-inhibitory factor and is identical to TRANCE/RANKL. Proc Natl Acad Sci USA 95:3597–3602 Ye L, MacDougall M, Zhang S, Xie Y, Zhang J, Li Z, Lu Y, et al. (2004) Deletion of dentin matrix protein-1 leads to a partial failure of maturation of predentin into dentin, hypomineralization, and expanded cavities of pulp and root canal during postnatal tooth development. J Biol Chem 279:19141–19148 Zhao GQ (2003) Consequences of knocking out BMP signaling in the mouse. Genesis 35:43–56[CrossRef][Medline] Zoricic S, Maric I, Bobinac D, Vukicevic S (2003) Expression of bone morphogenetic proteins and cartilage-derived morphogenetic proteins during osteophyte formation in humans. J Anat 202:269–277[Medline]
This article has been cited by other articles:
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||