Hum. Reprod. Advance Access originally published online on March 3, 2006
Human Reproduction 2006 21(7):1901-1906; doi:10.1093/humrep/del047
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Maternal lead exposure and the secondary sex ratio
1 Harvard School of Public Health, Harvard University, Boston, MA, USA 2 Department of Obstetrics and Gynecology, University of Calgary, Calgary, Alberta, Canada 3 Instituto Nacional de Salud Publica, Mexico City, Mexico and 4 Channing Laboratory, Department of Medicine, Brigham and Womens Hospital/Harvard Medical School, Harvard University, Boston, MA, USA
5 To whom correspondence should be addressed at: Department of Obstetrics and Gynecology, University of Calgary, 1403, 29th Street NW, Calgary, Alberta, Canada T2N 2T9. E-mail: john.jarrell{at}calgaryhealthregion.ca
| Abstract |
|---|
|
|
|---|
BACKGROUND: A reduction in the secondary sex ratio may be associated with exposure to environmental toxicants. Little data exists relating this outcome to lead exposure, a well-known reproductive toxicant. METHODS: We studied 1980 women having singleton births from 1994 to 1995 and from 1997 to 2001 who participated in a cohort study of lead exposure and infant outcomes in Mexico City. Levels of lead were measured in maternal and cord blood using graphite furnace atomic absorption spectroscopy, and levels of lead in maternal patella and tibia bone (a reflection of cumulative exposure) were measured using noninvasive K-X-ray fluorescence measurements. Using logistic regression models, we evaluated the relations of these measures to secondary sex ratio in the offspring, adjusting for maternal age, parity and year of infants birth. RESULTS: We found no consistent association between any of the lead measures and secondary sex ratio. Results were unchanged when we adjusted for infants year of birth, maternal age and parity. CONCLUSIONS: Despite a large sample size and the use of sensitive biomarkers, we did not find evidence that maternal and fetal lead exposure is associated with a lower secondary sex ratio among newborns.
Key words: bone lead/lead/lead measurements/pregnancy/secondary sex ratio
| Introduction |
|---|
|
|
|---|
Over recent decades, many countries have witnessed a decline in the relative number of male infants born, expressed as a decline in secondary sex ratio (ratio of live-born males to live-born females) or by the percentage of live births that are male. Several reports have indicated a secular trend of fewer males in Canada, the USA, England and Wales, Denmark, Germany and The Netherlands (Feitosa and Krieger, 1992
Changes in the sex ratio have been postulated to represent pathology involving the conceptus (Jongbloet et al., 2001
). Differential preclinical loss of males could occur, because the male conceptus may be more susceptible to environmental stressors affecting mothers, such as poor nutrition, stress from warfare and major environmental disasters (Zorn et al., 2002
; Cagnacci et al., 2004
). Such stressors may affect particular windows of early embryonic development during which successful implantation is allowed or denied (Kochhar et al., 2001
).
On several occasions, declining sex ratios have been attributed to environmental chemicals. The proportion of male births dropped significantly following paternal exposure to dioxin (Mocarelli et al., 1996
., 2000
) and also dropped significantly among babies born to male workers during the testicular recovery period from their exposure to dibromochloropropane, now known as a testicular toxicant (Potashnik et al., 1984
). Previous studies have also observed declining sex ratios in association with maternal exposures. In southeastern Turkey, exposure of women to hexachlorobenzene has been linked to a reduced proportion of male births 45 years later (Jarrell et al., 2002
), and women exposed to high concentrations of PCBs from fish consumption had a significantly reduced proportion of male births (Weisskopf et al., 2003
). However, a reduction in sex ratio in Finland occurred prior to the manufacture and deployment of any of these industrial chemicals (Vartiainen et al., 1999
). Most recently, a significant decline in the sex ratio has been identified among First Nations community near Sarnia, Ontario, from 1984 to 2003. This reduction has been posed as potentially due to the close proximity to several major industrial units involved with chemical production (Mackenzie et al., 2005
).
Lead is one of the most significant reproductive toxicants. Identified as a potential cause of the fall of Rome through infertility and abortion, lead toxicity remains a serious threat in the environment from many sources (Gilfillan, 1965
). In males, exposure to lead has been associated with reduced sperm counts, morphology and function (Chowdhury et al., 1986
; Apostoli et al., 1998
; Bonde et al., 2002a
; De Rosa et al., 2003
). In women, lead has been associated with longer time to pregnancy (Guerra-Tamayo et al., 2003
), although others have not observed this (Bonde and Kolstad, 1997
). In addition, prior exposure to lead is associated with spontaneous abortion and a number of adverse infant outcomes with respect to physical and mental development (Borja-Aburto et al., 1999
; Hertz-Picciotto, 2000
).
Limited information is available regarding the association of lead with the secondary sex ratio. Such an impact of lead is consistent with previous theoretical factors that control the sex ratio (James, 1997
). In England and Wales, Dickinson and Parker (1994)
found an occupationally associated reduction in the sex ratio of the offspring, which they attributed to both lead and alcohol.
Historically, lead exposure has been high in Mexico City (largely from the combustion of leaded gasoline and the use of lead-glazed ceramics) (Ferias et al., 1996
; Borja-Aburto et al., 1999
). Mexico began to phase out the use of leaded gasoline in 1986, which it completed in 1997, and unleaded gasoline was introduced in 1990 (Cortez-Lugo et al., 2003
). The decline in sex ratio in Mexico over the past 50 years has been reported as the most dramatic among WHO countries (Grech et al., 2003b). In the light of these trends and the potential that lead alters human fertility, it was of interest to determine whether sensitive markers of lead exposure among Mexican women are associated with the sex of the progeny.
| Materials and methods |
|---|
|
|
|---|
This study incorporated participants from two cohorts of lead assessment in pregnancy. Members of cohort 1 were enrolled from 1994 to 1995, and 1393 motherinfant pairs had at least one lead biomarker measure. Members of cohort 2 were enrolled between 1997 and 2002, and 587 motherinfant pairs had at least one lead biomarker measure. Details of recruitment procedures and eligibility criteria have been published elsewhere for cohort 1 and cohort 2 (Gonzalez-Cossio et al., 1997
Blood lead measurements
Maternal and umbilical cord blood samples were collected within 12 h after delivery. Blood samples were analysed for lead by atomic absorption spectroscopy (PerkinElmer, Norwalk, CT, USA) at the metal laboratory of the American British Cowdray Hospital in Mexico City. Analyses of external blinded quality-control samples were provided throughout the study by the Wisconsin State Laboratory of Hygiene (WSLH) Cooperative Blood Lead Proficiency Testing Program (PBPTP) (Madison, WI, USA). The laboratory performed with an accuracy within 5% and a coefficient of variation <15%.
Bone lead tests
Noninvasive measurements of lead in bone constitute a relatively new biological estimate of cumulative lead burden in contrast to blood lead levels, which mostly reflect lead exposure (Hu et al., 1998
). Measurements of maternal bone lead were undertaken in our study at the American British Cowdray Hospital 1 month following delivery. Using a spot source 109Cd K-XRF instrument (Abiomed, Danvers, MA, USA), we measured maternal bone lead levels at mid tibia shaft (cortical) and patella (trabecular). Thirty-minute measurements were taken at each bone site after the skin had been washed with 50% isopropyl alcohol. The K-XRF beam collimator was sited perpendicular to the bone surface for the tibia and 30° in the lateral direction for the patella. Tibia and patella bone lead measurements with estimated uncertainties greater than 10 and 15 µg/g bone, respectively, were excluded as these measurements usually reflect excessive patient movement during the measurement (Hu et al., 1990
; Aro et al., 1994
). Such procedures are standard in the analysis of bone lead data (Hu et al., 1998
). The details of this procedure have been previously reported (Aro et al., 2000
).
Statistical analysis
We undertook separate analyses for each measure of lead (maternal blood lead, cord blood lead and patella and tibia bone lead). We divided the concentrations of lead in these compartments into quintiles, and then, using logistic regression, we modeled the relative odds that an infant was male (versus female) across quintiles of lead. For tests of trends across quintiles, the median lead level in each quintile was assigned to all subjects in that quintile. We considered maternal age (and squared maternal age), parity and year of infants birth as potential confounders. All analyses were undertaken using SAS.
| Results |
|---|
|
|
|---|
There were 1980 children in our cohorts, for whom we had at least one lead exposure measure either from the mother (blood lead at delivery or bone lead) or from the child (cord blood lead). Among these children, the sex ratio was 1.11, which is a male percentage of 52.5%. A summary of information of the clinical variables in relation to quintile of maternal blood lead measurement is presented in Table I. All lead measures generally increased with increasing quintile of maternal blood lead, but there was little difference in year of childs birth or mothers age at delivery. There appeared to be fewer nulliparous women with increasing quintile. In Table II, lead biomarker levels across categories of the covariates are shown for all lead measures.
|
|
The unadjusted sex ratio appeared to increase somewhat over the first three quintiles of maternal blood lead, although there was no significant trend over all five quintiles (ptrend = 0.40). After adjusting for age of the mother at the childs birth, the square of this age, the year of the childs birth and the mothers parity, the odds that an infant was male were significantly elevated for the third quintile of maternal blood lead, as compared with the lowest quintile [odds ratio (OR) = 1.47, 95% CI = 1.072.01]. We found no consistent association, however, between the odds of a male child and any of the lead biomarkers, and with the exception above, the adjusted OR for a male child was not significantly different from 1 for any other quintile of lead biomarker (Figures 1
|
|
|
|
| Discussion |
|---|
|
|
|---|
Lead remains one of the most significant environmental agents associated with altered human reproduction (Castellino et al., 1995
This study is strengthened by the size of the study population, the multiple and sensitive approaches to the measurement of lead exposure and the standardized techniques of lead quantification. Mexico began phasing out leaded gasoline in 1987, and gasoline was eliminated in 1997, which has resulted in lower overall exposures to lead during a protracted period of decline in the nations sex ratio (Cortez-Lugo et al., 2003
). Thus, it is possible that our results are confounded by unmeasured secular phenomena such as additional exposures and socioeconomic factors. The births in our study occurred over a narrow time window, and we adjusted for year of birth, reducing the impact of any such bias. We did not have data on paternal age, which is associated with sex ratio in some studies. However, the impact of this covariate on the estimated association between lead and sex ratio is anticipated to be limited (Jacobsen et al., 1999
).
In order to explore the impact of lead on the sex ratio of the current cohort, measures of lead were evaluated in maternal blood, cord blood and maternal bone lead (Gonzalez-Cossio et al., 1997
; Ettinger et al., 2004
). The maternal blood lead levels were obtained post-partum and not at the time of conception. However, the use of all maternal and cord blood and patella and tibia bone lead levels provides for a broad evaluation of lead exposure in pregnancy in general. Although there were no blood measurements taken at the time of conception, bone lead may represent an appropriate surrogate (Aro et al., 2000
). When compared with maternal blood measurement, bone lead measurement has been shown to be a better predictor of the adverse outcomes in pregnancy, including low birthweight (Gonzalez-Cossio et al., 1997
), low infant weight gain, lower head circumference and lower birth length (Hernandez-Avila et al., 2002
) and lower scores of the Bayley Scales of Mental Development at age 2 years (Gomaa et al., 2002
). As lead is known to be released from maternal bone during pregnancy, the measurement of plasma lead at the time of conception and the first trimester, when most pregnancy losses occur, may provide an improved approach to the assessment of lead exposure in relation to eventual sex ratio of the progeny (Hu, 2002
).
There has been a substantial interest in the changes noted in sex ratio during the past century, particularly in the potential explanations for secular changes. There is considerable debate on the validity of a causal relationship of environmental exposure to hormonally active chemicals or endocrine disruptors to the secondary sex ratio, with some reflection that the changes observed over time are statistical variants (Gini, 1955
; Dodds and Armson, 1997
; James, 1998
). The inherent complexity in the endocrine disruption hypothesis has been explored by a comprehensive review by Krimski (2001)
. The observed alterations in sex ratio may require further elaboration prior to becoming established as a component of this hypothesis. In the present study, we did not observe an association of lead with the sex ratio. Notably, however, there was a significant increase in the odds that a child was male in the third quartile of maternal blood lead. Such a finding may reflect chance, particularly as it is not substantiated through our other measures of lead, but it also may represent an inverted U-shaped effect summarized by Calabrese and Baldwin (2001)
and may reflect the inherent complexity of endocrine disruption noted by Krimski (2001)
.
In summary, in a community of pregnant women with a wide range of contamination with lead, we found no evidence that maternal or cord blood levels of lead were associated with the secondary sex ratio.
| Acknowledgements |
|---|
|
|
|---|
Support for the study was provided by the March of Dimes, US NIEHS R01ES07821, NIEHS P42 ES-05947 Project 1 (with funding from US EPA), NIEHS Center Grant 2 P30 ES-00002, from Conjejo National de Ciencia y Tecnologia (CONACyT) Grant 4150 M9405 and from CONSERVA, Department of Federal District, Mexico.
We acknowledge the support of Hongshu Guan. This work was conducted when Dr Jarrell was a visiting scholar at the Harvard School of Public Health, supported by the Royal College of Physicians and Surgeons of Canada.
| References |
|---|
|
|
|---|
Allan BB, Brant R, Seidel J, Jarrell JF. (1997) Declining sex ratios in Canada. CMAJ 156:3741.[Abstract]
Apostoli P, Kiss P, Porru S, Bonde JP, Vanhoorne M. (1998) Male reproductive toxicity of lead in animals and humans. ASCLEPIOS Study Group. Occup Environ Med 55:364374.
Aro A, Amarasiriwardena C, Lee M, Kim R, Hu H. (2000) Validation of K x-ray fluorescence bone lead measurements by inductively coupled plasma mass spectrometry in cadaver legs. Med Phys 27:119123.[CrossRef][Web of Science][Medline]
Aro A, Todd AC, Amarasiriwardena C, Hu H. (1994) Improvements in the calibration of 109Cd K x-ray fluorescence systems for measuring bone lead in vivo. Phys Med Biol 39:1222632271.[CrossRef][Web of Science][Medline]
Barker DJ, Gluckman PD, Godfrey KM, Harding JE, Owens JA, Robinson JS. (1993) Fetal nutrition and cardiovascular disease in adult life. Lancet 341:938941.[CrossRef][Web of Science][Medline]
Bonde JP and Kolstad H. (1997) Fertility of Danish battery workers exposed to lead. Int J Epidemiol 26:12811288.
Bonde JP, Joffe M, Apostoli P, Dale A, Kiss P, Spano M, Caruso F, Giwercman A, Bisanti L, Porru S, et al. (2002a) Sperm count and chromatin structure in men exposed to inorganic lead: lowest adverse effect levels. Occup Environ Med 59:234242.
Borja-Aburto VH, Hertz-Picciotto I, Rojas LM, Farias P, Rios C, Blanco J. (1999) Blood lead levels measured prospectively and risk of spontaneous abortion. Am J Epidemiol 150:590597.
Cagnacci A, Renzi A, Arangino S, Alessandrini C, Volpe A. (2004) Influences of maternal weight on the secondary sex ratio of human offspring. Hum Reprod 19:442444.
Calabrese EJ and Baldwin LA. (2001) Hormesis: U-shaped dose responses and their centrality in toxicology. Trends Pharmacol Sci 22:285291.[CrossRef][Medline]
Castellino N, Castellino P, Sannolo N. (1995) Inorganic Lead Exposure (Lewis Publishers, Boca Raton, FL.).
Cetin I, Cozzi V, Antonazzo P. (2003) Fetal development after assisted reproduction a review. Placenta 24:Suppl. B, S104S113.
Chowdhury AR, Chinoy NJ, Gautam AK, Rao RV, Parikh DJ, Shah GM, Highland HN, Patel KG, Chatterjee BB. (1986) Effect of lead on human semen. Adv Contracept Deliv Syst 2:208210.[Medline]
Cortez-Lugo M, Tellez-Rojo MM, Gomez-Dantes H, Hernandez-Avila M. (2003) Trends in atmospheric concentrations of lead in the metropolitan area of Mexico city, 19881998. Salud Publica Mex 45:196202.
De Rosa M, Zarrilli S, Paesano L, Carbone U, Boggia B, Petretta M, Maisto A, Cimmino F, Puca G, Colao A, et al. (2003) Traffic pollutants affect fertility in men. Hum Reprod 18:10551061.
Dickinson H and Parker L. (1994) Do alcohol and lead change the sex ratio? J Theor Biol 169:313315.[CrossRef][Web of Science][Medline]
Dodds L and Armson BA. (1997) Is Canadas sex ratio in decline? CMAJ 156:4648.[Abstract]
Ettinger AS, Tellez-Rojo MM, Amarasiriwardena C, Gonzalez-Cossio T, Peterson KE, Hu H, Hernandez-Avila M. (2004) Levels of lead in breast milk and their relation to maternal blood and bone lead levels at one month postpartum. Environ Health Perspect 112:926931.[Web of Science][Medline]
Feitosa MF and Krieger H. (1992) Demography of the human sex ratio in some Latin American countries, 19671986. Hum Biol 64:523530.[Web of Science][Medline]
Ferias P, Borja-Aburto VH, Rios C, Hertz-Picciotto I, Rojas-Lopez M, Chavez-Ayala R. (1996) Blood lead levels in pregnant women of high and low socioeconomic status in Mexico City. Environ Health Perspect 104:10701074.[Web of Science][Medline]
Gilfillan SC. (1965) Lead poisoning and the fall of Rome. J Occup Med 7:5360.[Medline]
Gini C. (1955) Sulla probabilita chextermini di una serie erratica sieno tutti crescenti (o non decrescenti) ovvero tutti decrescenti (o on crescenti) con applocazioni ai rapporti dei sessi nascite umane in intervalli successivi e alle dispozizioni dei sessi nelle fratellanze umane. Metron 17:141.
Gomaa A, Hu H, Bellinger D, Schwartz J, Tsaih SW, Gonzalez-Cossio T, Schnaas L, Peterson K, Aro A, Hernandez-Avila M. (2002) Maternal bone lead as an independent risk factor for fetal neurotoxicity: a prospective study. Pediatrics 110:110118.
Gonzalez-Cossio T, Peterson KE, Sanin LH, Fishbein E, Palazuelos E, Aro A, Hernandez-Avila M, Hu H. (1997) Decrease in birth weight in relation to maternal bone-lead burden. Pediatrics 100:856862.
Goyer RA. (1990) Transplacental transport of lead. Environ Health Perspect 89:101105.[Web of Science][Medline]
Grech V, Vassallo-Agius P, Savona-Ventura C. (2003) Secular trends in sex ratios at birth in North America and Europe over the second half of the 20th century. J Epidemiol Community Health 57:612615.
Guerra-Tamayo JL, Hernandez-Cadena L, Tellez-Rojo MM, Mercado-Garcia AS, Solano-Gonzalez M, Hernandez-Avila M, Hu H. (2003) Time to pregnancy and lead exposure. Salud Publica Mex 45:Suppl. 2, S189S195.[Medline]
Hernandez-Avila M, Peterson KE, Gonzalez-Cossio T, Sanin LH, Aro A, Schnaas L, Hu H. (2002) Effect of maternal bone lead on length and head circumference of newborns and 1-month-old infants. Arch Environ Health 57:482488.[Web of Science][Medline]
Hertz-Picciotto H. (2000) The evidence that lead increases the risk for spontaneous abortion. Am J Ind Med 38:300309.[CrossRef][Web of Science][Medline]
Hu H. (2002) Invited commentary: lead, bones, women and pregnancy the poison within? Am J Epidemiol 156:10881091.
Hu H, Milder FL, Burger DE. (1990) X-ray fluorescence measurements of lead burden in subjects with low-level community lead exposure. Environ Health Perspect 94:107110.
Hu H, Rabinowitz M, Smith D. (1998) Bone lead as a biological marker in epidemiologic studies of chronic toxicity: conceptual paradigms. Environ Health Perspect 106:18.[Web of Science][Medline]
Jacobsen R, Moller H, Mouritsen A. (1999) Natural variation in the human sex ratio. Hum Reprod 14:1231203125.
James WH. (1997) Paternal lead exposure, offspring birth weight, and sex ratio. Am J Ind Med 32:315316.[CrossRef][Web of Science][Medline]
James WH. (1998) Was the widespread decline in sex ratios at birth caused by reproductive hazards? Hum Reprod 13:10831084.
Jarrell JF, Gocmen A, Akyol D, Brant R. (2002) Hexachlorobenzene exposure and the proportion of male births in Turkey 19351990. Reprod Toxicol 16:6570.[CrossRef][Web of Science][Medline]
Jongbloet PH, Roeleveld N, Groenewoud HM. (2002) Where the boys arent: dioxin and the sex ratio. Environ Health Perspect 110:13.[Web of Science][Medline]
Jongbloet PH, Zielhuis GA, Groenewoud HM, Pasker-De Jong PC. (2001) The secular trends in male:female ratio at birth in postwar industrialized countries. Environ Health Perspect 109:749752.[Web of Science][Medline]
Kochhar HP, Peippo J, King WA. (2001) Sex related embryo development. Theriogenology 55:314.[CrossRef][Web of Science][Medline]
Krimski S. (2001) An epistemological inquiry into the endocrine disruptor hypothesis. Ann N Y Acad Sci 948:130142.[Web of Science][Medline]
Mackenzie CA, Lockridge A, Keith M. (2005) Declining sex ratio in a first nation community. Environ Health Perspect 113:12951298.[Web of Science][Medline]
Manning JT, Anderton RH, Shutt M. (1997) Parental age gap skews child sex ratio. Nature 389:344.[CrossRef][Medline]
Mocarelli P, Brambilla P, Gerthoux PM, Patterson DG Jr, Needham LL. (1996) Change in sex ratio with exposure to dioxin. Lancet 348:409.[CrossRef][Web of Science][Medline]
Mocarelli P, Gerthoux PM, Ferrari E, Patterson DG Jr, Kieszak SM, Brambilla P, Vincoli N, Signorini S, Tramacere P, Carreri V, et al. (2000) Paternal concentrations of dioxin and sex ratio of offspring. Lancet 355:18581863.[CrossRef][Web of Science][Medline]
Moller H. (1996) Change in male:female ratio among newborn infants in Denmark. Lancet 348:828829.[Medline]
Moynihan JB and Breathnach CS. (1999) Changes in male:female ratio among newborn infants in Ireland. APMIS 107:365368.[Web of Science][Medline]
Potashnik G, Goldsmith J, Insler V. (1984) Dibromochloropropane-induced reduction of the sex-ratio in man. Andrologia 16:213218.[Web of Science][Medline]
van den Broek JM. (1997) Change in male proportion among newborn infants. Lancet 349:805.[Medline]
van der Pal-de Bruin KM, Verloove-Vanhorick SP, Roeleveld N. (1997) Change in male:female ratio among newborn babies in Netherlands. Lancet 349:62.[Medline]
Vartiainen T, Kartovaara L, Tuomisto J. (1999) Environmental chemicals and changes in sex ratio: analysis over 250 years in Finland. Environ Health Perspect 107:813815.[Web of Science][Medline]
Weisskopf MG, Anderson HA, Hanrahan LP. Great Lakes Consortium. (2003) Decreased sex ratio following maternal exposure to polychlorinated biphenyls from contaminated Great Lakes sport-caught fish: a retrospective cohort study. Environ Health 2:2.[CrossRef][Medline]
Zorn B, Sucur V, Stare J, Meden-Vrtovec H. (2002) Decline in sex ratio at birth after 10-day war in Slovenia: brief communication. Hum Reprod 17:31733177.
Submitted on November 24, 2005; resubmitted on January 14, 2006; accepted on January 20, 2006.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
M. G. Weisskopf, J. Weuve, J. Jarrell, H. Hu, M. M. Tellez-Rojo, and M. Hernandez-Avila Reply: Maternal lead exposure, secondary sex ratio and dose-exposure fallacy Hum. Reprod., October 1, 2007; 22(10): 2792 - 2793. [Full Text] [PDF] |
||||
![]() |
L. A. Wise, L. Titus-Ernstoff, J. R. Palmer, R. N. Hoover, E. E. Hatch, K. M. Perez, W. C. Strohsnitter, R. Kaufman, D. Anderson, and R. Troisi Time to Pregnancy and Secondary Sex Ratio in Men Exposed Prenatally to Diethylstilbestrol Am. J. Epidemiol., October 1, 2007; 166(7): 765 - 774. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. H. Jongbloet and N. Roeleveld Maternal lead exposure, secondary sex ratio and dose-exposure fallacy Hum. Reprod., October 1, 2007; 22(10): 2792 - 2792. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||





