Next Article in Journal
Public Willingness to Pay for Green Lifestyle in China: A Contingent Valuation Method Based on Integrated Model
Previous Article in Journal
Relational Competence, School Adjustment and Emotional Skills: A Cross-Sectional Study in a Group of Junior and High School Students of the Sicilian Hinterland
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

COVID-19 Pandemic Impact on the Maternal Mortality in Kazakhstan and Comparison with the Countries in Central Asia

by
Olzhas Zhamantayev
,
Gaukhar Kayupova
,
Karina Nukeshtayeva
,
Nurbek Yerdessov
,
Zhanerke Bolatova
* and
Anar Turmukhambetova
School of Public Health, Karaganda Medical University, Gogol Street 40, Karaganda 100008, Kazakhstan
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(3), 2184; https://doi.org/10.3390/ijerph20032184
Submission received: 12 December 2022 / Revised: 18 January 2023 / Accepted: 23 January 2023 / Published: 25 January 2023
(This article belongs to the Section Public Health Statistics and Risk Assessment)

Abstract

:
Maternal mortality ratio is one of the sensitive indicators that can characterize the performance of healthcare systems. In our study we aimed to compare the maternal mortality ratio in the Central Asia region from 2000 to 2020, determine its trends and evaluate the association between the maternal mortality ratio and Central Asia countries’ total health expenditures. We also compared the maternal mortality causes before and during the pandemic in Kazakhstan. The data were derived from the public statistical collections of each Central Asian country. During the pre-pandemic period, Central Asian nations had a downward trend of maternal mortality. Maternal mortality ratio in Central Asian countries decreased by 38% from 47.3 per 100,000 live births in 2000 to 29.5 per 100,000 live births in 2020. Except for Uzbekistan, where this indicator decreased, all Central Asian countries experienced a sharp increase in maternal mortality ratio in 2020. The proportion of indirect causes of maternal deaths in Kazakhstan reached 76.3% in 2020. There is an association between the maternal mortality ratio in Central Asian countries and their total health expenditures expressed in national currency units (r max = −0.89 and min = −0.66, p < 0.01). The study revealed an issue in the health data availability and accessibility for research in the region. The findings suggest that there must be additional efforts from the local authorities to enhance the preparedness of Central Asian healthcare systems for the new public health challenges and to improve health data accessibility.

1. Introduction

The COVID-19 pandemic has had a significant impact on healthcare systems around the world. Various findings highlight that restrictions, quarantines, and overwhelming pressure on healthcare systems have caused some dramatic changes in different health performance indicators, such as healthcare utilization and, excess mortality, etc. The pandemic has disrupted essential healthcare services, including maternal and newborn care, leading to an increase in maternal mortality (MM) [1,2]. Maternal mortality ratio (MMR) is a key indicator that can characterize the overall state of healthcare systems and it can be used to assess and compare countries’ socioeconomic performance and healthcare effectiveness [3,4].
There are several middle-income countries such as Kazakhstan, Uzbekistan, Kyrgyzstan, Tajikistan, and Turkmenistan in the Central Asia (CA) region that share common issues and trends in economy and politics [5,6]. Some of them have experienced similar obstacles in healthcare during the COVID-19 pandemic, such as a lack of affordable PCR testing or management of chronic diseases at the beginning of the pandemic [7,8]. In addition, Kazakhstan, Uzbekistan, and Kyrgyzstan have a relatively low share (2.5–5%) of GDP spent on healthcare, whereas many high-income countries have much more significant amounts (more than 7%) of GDP on healthcare [9,10].
WHO reports that 94% of all maternal deaths occur in low and lower-middle-income countries, and MMR dropped by about 38% worldwide between 2000 and 2017 [11,12]. Moreover, several years before the pandemic about 86% of all maternal mortality (MM) cases were associated with direct obstetric causes (maternal hemorrhage, maternal hypertensive disorders, and other maternal disorders) [13,14]. Conversely, three-fifths of maternal deaths in Georgia from 2014 to 2017 were related to indirect causes, with infectious diseases being the most frequent one and almost half of the maternal deaths were linked to pre-existing medical conditions [15]. The UN’s Sustainable Development Goal 3.1 aims to reduce the global MMR to less than 70 per 100,000 live births. Meanwhile, this promising goal can be compromised by the fact that only 84% of births in the world were assisted by skilled health professionals (doctors, nurses, and midwives) during 2015–2021. This indicator has reached 95% in Tajikistan, 99.8% in Kyrgyzstan, 99.9% in Kazakhstan, and 100% in Uzbekistan [16,17]. In comparison to these countries, the level of births attended by skilled health personnel was 96.2% in Germany, 98% in Canada, and some middle and high-income African countries had only 90% in 2018 [17,18]. There are studies that found an association between the MMR and government health expenditures or funds allocation on providing sufficient health coverage. The increased health expenditure potentially reduces maternal and infant mortality across lower- and middle-income countries. Lower-middle-income countries reported significantly higher rates of maternal mortality than high-income countries [19,20,21,22]
Scientific evidence on the influence of the COVID-19 pandemic on maternal mortality and pregnancy course varies among the different studies. Chmielewska et al. identified significant increases in stillbirth and maternal death during pandemic versus before the pandemic [2]. Some researchers concluded that COVID-19 infection did not significantly affect the course of pregnancy or pregnancy outcomes [23,24,25,26], and unusual frequency of pregnancy-related complications due to SARS-CoV-2 infection was also not revealed [27]. However, pregnant women with COVID-19 may have more adverse health outcomes and experience socio-economic issues [28,29]. SARS-CoV-2 infection among pregnant and postpartum women was associated with an increased risk for a serious morbidity related to hypertensive disorders of pregnancy, postpartum hemorrhage, or death [30,31]. There are findings showing that maternal deaths have increased approximately five times among hospitalized patients during the COVID-19 Delta wave and SARS-CoV-2 infection in pregnancy is associated with reduced risk of complications during the omicron-dominant period compared with the delta-dominant period [32,33]. Several studies identified an association of COVID-19 infection with higher rates of cesarean section in pregnant women and their mortality [34,35,36]. Pre-existing comorbidities such as obesity, diabetes, asthma, and advanced maternal age played a role in the increased complications risk of COVID-19 and maternal mortality [37,38,39].
In 2021, Brazil reported 223% more maternal deaths caused by COVID-19 than in 2020. Authors identified delays in diagnosis, hospitalization, and providing intensive care as three main barriers that impede effective healthcare responses to pregnant women with COVID-19 [40]. The projected MMR in Mexico for 2020 (before the pandemic) was 29.5 per 100,000 live births, yet in fact it was 42.4 that year [41].
Our study aims to compare the MMR situation in CA countries, assess its trends from 2000 to 2020, analyze the association between MMR and total health expenditures (THE) expressed in national currency units in CA countries, and compare the causes of MM before and during the COVID-19 pandemic in Kazakhstan.

2. Materials and Methods

2.1. Data Sources

MMR is estimated as the number of maternal deaths per 100,000 live births. It is defined as the death of women who are pregnant or who are within 42 days of the termination of pregnancy, regardless of the length and location of the pregnancy, from any cause related to or aggravated by the pregnancy or its management, but not from an accident or accidental causes [42].
We conducted a retrospective study of the data set of four CA countries, including Uzbekistan, Kyrgyz Republic, Tajikistan, and Kazakhstan, from the official state statistical profiles and reports of each country [43,44,45,46]. We excluded Turkmenistan data from our analysis due to data unavailability.
The annual statistical report “Population health and healthcare organizations’ performance in the Republic of Kazakhstan” was used to derive data about the MMR, pregnancy complications, causes of maternal deaths, obstetrician-gynecologists’ density, and maternal beds per 1000 born in Kazakhstan from 2000 to 2020. The health data collection policy in Kazakhstan complies with international recommendations to ensure the comparability of statistical data (measurement, recording, classification, sources linking and reporting) [47].
Maternal mortality statistics in Kyrgyzstan are maintained by the Department of Social and Environmental Statistics of the National Statistical Committee, and data are collected and processed in cooperation with the Ministry of Health and the Ministry of Social Care. The competent authorities carry out control of the received data, prepare and verify summary information. Maternal mortality statistics are published in the annual reports of the National Statistical Committee.
The collection of data on maternal mortality in Uzbekistan and Tajikistan is carried out by the Confidential Study Report on Maternal Deaths by United Nations Population Fund (UNFPA) in Uzbekistan and the Statistics Agency of Tajikistan. The review of compiled health statistics, including maternal mortality, is carried out in accordance with international recommendations by the competent authorities and published in annual health statistical reports [47].
The Global Health Expenditures Database was used to derive data about total health expenditures (THE) of CA countries in national currency units (NCU) [48].

2.2. Maternal Mortality Registration Process in CA Countries

According to the Order of the Minister of Health of the Republic of Kazakhstan, the heads of local health facilities, from the moment of MM case registration, are required to notify the authorized regional body within two hours by telephone. Then, within 24 h, they report it to the Ministry of Health and its territorial divisions with the available results (medical records, clinical, laboratory, and instrumental examination). The “protocol of post-mortem examination” must be submitted to the territorial divisions within seven working days from the date of MM registration. Control over the registration and accounting of MM is carried out by the regional head of the health department. The Republican E-Health Center provides monthly summary information on MM cases by the eighth day of each month following the reporting month, indicating the final diagnosis and the ICD-10 code (rules for the provision of information [49]).
Pathological anatomical autopsies are performed in all cases of MM by physicians specializing in “pathological anatomy (adult, pediatric) with pathohistological examination of the sectional material, at the pathology bureaus, centralized pathology departments within 24 h after the death”. Upon completion of the entire pathologic examination, all maternal deaths are subject to a clinicopathologic anatomic review. The pathological and anatomical diagnosis shall be made in accordance with the ICD. The Department of the Ministry of Health of Kazakhstan ensures the timely monitoring of MM cases along the route of pregnant women/parturient women/puerperal/women after the termination of pregnancy if there are legal grounds in accordance with the legislation of the Republic of Kazakhstan. In addition, the department provides information on the results of inspections to the authorized body for taking urgent measures to reduce maternal mortality [50].
The Ministry of Health of Kyrgyzstan collects up-to-date information on women who died from complications of pregnancy, childbirth, and the postpartum period on a monthly basis and submits it to the national statistical committee, where the fact of registration of these cases in the registry offices is being clarified. “The signal certificate of death of a pregnant woman/a woman in labor/a puerperal woman” is filled in in all healthcare organizations (regardless of whether this organization provides obstetric services or not). It is filled in by entering data in the appropriate paragraphs or rounding off the corresponding codes. In the case of death of a woman in a hospital, it is indicated during what time from the moment of admission to the hospital the death occurred. It reflects information about the medical staff who took delivery. Other important conditions that contribute to death, but are not associated with the disease or pathological condition that led to it, are also coded. The certificate is transferred within 3 days to the regional medical information center, where data will be entered into the MM register. A head of a healthcare organization is responsible for the timeliness of the submitted data, the quality of filling in the certificates, and the completeness and timely entry of information into the database [51].
Information on the process of registering a case of maternal death in Tajikistan and Uzbekistan is not presented in this study due to its unavailability.

2.3. Data Analysis

We used linear regression analysis to identify statistically significant trends of MMR in CA countries from 2000 to 2020 in this study. Pearson correlation analysis was used to assess the associations between the observed national MMRs and the CA countries’ total health expenditures in NCU. R-studio soft version 1.2.5033, Posit, PBC, Vienna, Austria was used for the statistical analysis in this study, and a two-sided p-value of <0.01 was considered significant. We used the following code in R:
Correlation <- cor(data$x, data$y, method = ‘pearson’)
Checking the results: >correlation

3. Results

3.1. MM Situation in CA Countries and Its Trends from 2000 to 2020

In general, Figure 1 shows a general downward trend in all four countries, but fluctuation year-on-year from 2000 to 2020. The highest level of MMR in the CA region was 47.3 per 100,000 live births (95% CI: 29.0, 65.5) in 2000, and the lowest level of MMR was 20.4 per 100,000 live births (95% CI: 12.5, 28.4) in 2019 (Appendix A, Table A1). Overall, MMR in CA countries decreased by 38% from 47.3 (95% CI: 29.01, 65.5) per 100,000 live births in 2000 to 29.5 (95% CI: 15.8, 43.1) per 100,000 live births in 2020. In 2020, the MMR in CA countries increased by 44% in comparison to 2019. It is worth noting that throughout this period, Kyrgyzstan had the highest MMR among the CA countries. In addition, the fluctuations of MMR have taken place in the previous periods of time. There were increases between 2001–2002, 2004–2005, 2008–2009 and 2013–2014 which were comparable in scale to the increase between 2019 and–2020.
Overall, there is a 20-year decreasing trend of MMR in Kyrgyzstan. Linear regression analysis results of a 20-year period of MMR decline in Kyrgyzstan showed a coefficient of −1.31 (95% CI: −1.91, −0.70, p-value < 0.001) and an intercept of 2671.28 (p < 0.001). The trend of the yearly MMR in Kyrgyzstan was −1.31, which indicates an average annual decline of 1.31 maternal deaths per 100,000 live births per year. The peak of MMR was in 2009, reaching 63.5 per 100,000 live births. From 2011, this indicator tended to decline year after year from 54.8 (2011) to 24.8 (2019). However, during the pandemic, the MMR there sharply increased up to 36.1 per 100,000 live births, increasing by 45.5% in 2020 in comparison to previous year.
During the last two decades, progress was made in managing maternal deaths in Tajikistan. Similar to Kyrgyzstan, Tajikistan has a downward trend year after year, from 49.6 per 100,000 live births in 2000 to 23.6 in 2019 with some fluctuations in 2005–2006 and 2007–2008. The indicator decreased by 47.5% from 2000 to 2019. During the pandemic, the MMR slightly increased by 13.1% in 2020, reaching 26.7 per 100,000 live births. Linear regression analysis results of the 20-year period of the MMR in Tajikistan showed a coefficient of −1.15 (95% CI: −1.44, −0.88, p-value < 0.001) and an intercept of 2360.37 (p < 0.001). The trend of the yearly MMR in Tajikistan was −1.15, which indicates an average annual decline of 1.20 maternal deaths per 100,000 live births.
According to the national statistics of Uzbekistan, COVID-19 did not affect the MMR. It is one of the few countries where MMR did not increase recently. As COVID-19 hit the world, this indicator in Uzbekistan was lower in 2020 (18.5 per 100,000 live births) than a year before (19.6 per 100,000 live births), decreasing by 6%. The MMR decreased from 33.1 (2000) to 22.4 (2008) and peaked reaching 30.4 in 2009. Since that period, it has been steadily declining, but compared to the developed countries of the world, it is still relatively high. Linear regression analysis results of the 20-year period of the MMR in Uzbekistan showed a coefficient of −0.79 (95% CI: −0.99, −0.61, p-value < 0.001) and an intercept of 1628.38 (p < 0.001). The trend of the yearly MMR in Uzbekistan was −0.79, which indicates an average annual decline of 0.79 maternal deaths per 100,000 live births.
Kazakhstan has the lowest MMR among CA countries since 2000. Like the countries mentioned above, it also has had a downward trend during the last decade. However, this indicator increased sharply by 2.6 times in 2020 (36.5 per 100,000 live births) compared to 2019, and it showed the highest hand among CA countries that year. It was a record peak in the history of Kazakhstan over the past ten years (Figure 2). Moreover, a sharp increase in maternal deaths in Kazakhstan has leveled with the MMR in Kyrgyzstan.
According to Table 1, the absolute number of THE increased in all CA countries from 2000 to 2019. These values have been increasing in every country since 2015, except for Kyrgyzstan. Pearson correlation analysis showed that the MMR of each CA country was negatively correlated with the absolute number of THE in NCU (r = −0.86 for Kazakhstan, r = −0.70 for Kyrgyzstan, r = −0.66 for Uzbekistan, and r = −0.91 for Tajikistan, p < 0.01).

3.2. The Comparison of the MM Causes before and during the Pandemic in Kazakhstan

The MMR in Kazakhstan decreased by 4.4 times between 2000 (60.9 per 100,000 live births) and 2019 (13.7 per 100,000 live births), followed by a sharp increase of 2.7 times in 2020 (36.5 per 100,000 live births, Figure 1) during the COVID-19 outbreak. Linear regression analysis results of the MMR in Kazakhstan showed a coefficient of −2.13 (95% CI: −2.8, −1.41, p-value < 0.001) and an intercept of 4300.89 (p < 0.001). The trend of the yearly MMR in Kazakhstan was −2.13, which indicates an average annual decline of 2.13 maternal deaths per 100,000 live births.
In Figure 3, the main causes of maternal mortality are provided. In Kazakhstan, during 2000–2020, the main reasons for maternal mortality were broken down into the following categories according to ICD: indirect causes (O10, O24, O98, O99), hemorrhage (O67, O46, O44, O45, O72), abortion (O03–O07), hypertensive disorders (O10–O16), sepsis (O85), uterine rupture (O71.1), ectopic pregnancy (O00), and other (O21.1, O22, O71, O73, O87, O88, O90).
Abortion and hemorrhage were the leading causes of maternal deaths in 2000. (28% and 21%, respectively). Afterwards, the MM structure changed, with indirect causes becoming the leading cause of death, reaching a peak in 2020 (76% among all causes). There has also been a remarkable decrease in mortality from hemorrhage, abortion, pregnancy hypertensive disorders, and sepsis since 2000 until 2020 (in total there are 18 MM cases due to these causes in 2020 (Figure 3).
The obstetrician-gynecologists’ density per 1000 births (including stillbirths) decreased from 13.9 in 2000 to 7.3 in 2020. The situation is similar with the maternal beds density, there is a significant decrease from 39.5 in 2000, to 15.5 per 1000 born in 2020 (Appendix A, Table A1). It is worth noting that the indicators mentioned above did not show a significant decrease during the coronavirus pandemic, as a decrease was observed throughout the study period.
Another observed trend is a year-by-year steady increase in the number of women registered for prenatal care from 223,515 in 2000 to 435,358 in 2020. Prenatal care coverage, including early registration for up to 12 weeks of pregnancy, was at the critically low level of 66.5% twenty years ago and rose to 83.9% in 2020. Pregnancy complications such as hypertensive disorders and anemia are still the most common in Kazakhstan. The number of pregnancy complications has been declining for 22 years, including the pandemic period (Appendix A, Table A3).

4. Discussion

According to the results of our study, the MMR in Kazakhstan and other CA countries has been decreasing annually on average for the last twenty years. In the year of the pandemic there was an increase of MMR in all CA countries, except for Uzbekistan. In Kazakhstan the MMR decreased by 50% over 23 years with indirect causes, pregnancy hypertensive disorders being the leading causes of MM. Overall, the positive trends were a result of an effective policy on maternal care in the region: all countries have embarked on primary health care reforms, nursing training upgrade, and involvement of local communities and NGOs in the development of quality improvement programs in the national health plans. There was also an emphasis on the introduction of the evidence-based medicine and multisectoral approach in all health sectors, including maternal care in the region [52,53].
In the past 10 years, indirect causes have become one of the leading causes of maternal deaths in different parts of the world [14,15]. Moreover, in a pandemic year, every three out of four deaths were due to this cause. Thoma et al. found that MM increased by 33.3% in the United States during the pandemic. Viral, respiratory, and circulatory system diseases were the major causes of MM there [54]. Indirect causes have become the main cause of death among pregnant women and mothers in Kazakhstan since 2012.
The CA countries have one of the highest percentages of births attended by skilled health professionals worldwide, almost reaching 100% [17,18]. According to Amorim et al., in developing countries, as opposed to developed countries, high fertility and limited resources for health services will identify an increased risk of MM due to COVID-19 and they highlight the need for appropriate measures for adequate prenatal and postnatal care [55]. The average total fertility rate (TFR) in Kazakhstan, Kyrgyzstan, Uzbekistan and Tajikistan (3.0) in 2020 was higher than in the world (2.3), and higher than in EU (1.5). There was a steady growth of the fertility rate in three countries (Kazakhstan, Kyrgyzstan, and Uzbekistan) over a twenty-year period 2000–2020 (Appendix A, Table A2) [56].
There are few publications which attempt to assess the quality and completeness of the data sources in the CA region. All countries have eHealth centers that collect and publish annual health statistics information. The legibility of data is considered good in Kazakhstan and Kyrgyzstan [57,58].
There are quality councils in Kyrgyzstan which have little support in terms of tools, statistical benchmarks or local patient-based data for systematic peer review and improvement. United Nations experts identified the need for capacity development support in implementing measures to manage quality, and to raise awareness of the importance of quality management throughout the national statistical system [59,60]. The efficiency of data harvesting and processing could be improved by stimulating electronic data collection in all CA countries [61].
The THE varies across the CA countries. There are increased investments in this field but still the level is incomparable to middle-income countries from other parts of the world. Currently, only Tajikistan has achieved the level recommended by WHO (7% and more of GDP spent on healthcare) [48]. According to studies most of the countries with high excess mortality rates due to COVID-19 have insufficient investments in healthcare systems [22,39,41,62]. We believe that the limited financing of maternal care could have had an influence on the increased MMR in some CA countries, especially during the COVID-19 pandemic.

Limitations

Moreover, some statistical indicators regarding MM, such as causes of MM, obstetricians’, and maternal beds’ density per 1000 born, and prenatal care coverage were not available in CA countries’ state statistical sources. The quality of surveillance systems and data quality may differ across the selected countries.
Furthermore, due to limited data on the monetary resources expressed in NCUs it is not clear how much is exactly allocated for maternal care.
Nowadays limited investments in data systems of some CA countries compromise the evaluations of maternal mortality there.

5. Conclusions

Preventing MM and morbidity has become a global goal. The MMR is the indicator, which sums up the efforts on managing the medical, social, economic, environmental, cultural and organizational factors. In general, the MMR in CA countries has been declining on average for the last decades. The fluctuations of MMR have taken place in the previous periods of time. In Kazakhstan, the rate increased by two and a half times in the year of the pandemic compared to the previous year, although there had been a downward trend since 2000. Indirect causes have become the main cause of maternal deaths since 2012 in Kazakhstan, and in 2020, their share grew by 19%. The MMR of every CA country taken for analysis was negatively correlated with the absolute number of THE expressed in NCU. The COVID-19 pandemic can be the reason for the recent sharp increase in MM; however, more time and data are needed to draw any specific conclusions about its impact on maternal mortality. Meanwhile, it exposed problems in CA countries’ healthcare systems such as lack of data availability and low investments in the healthcare sector.

Author Contributions

Conceptualization, O.Z. and G.K.; methodology, Z.B. and K.N.; formal analysis, O.Z., G.K., K.N., N.Y. and Z.B.; writing—original draft preparation, O.Z., G.K., K.N., N.Y. and Z.B.; writing—review and editing, G.K. and A.T., visualization, N.Y.; supervision, A.T.; project administration, A.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Ministry of Health of the Republic of Kazakhstan, grant number BR11065386.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors appreciate the support of Rozhdestvensky Alexander, Director of the branch of the Republican Center for Electronic Health of Karaganda, and Tulegenova Bibigul, Deputy Head of the Karaganda region Health Department in collecting data.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Mean MMR in CA countries 2000–2020, per 100,000 live births.
Table A1. Mean MMR in CA countries 2000–2020, per 100,000 live births.
YearsMean MMR95.0% Lower CI for Mean
MMR
95.0% Upper CI for Mean
MMR
200047.229.065.5
200144.232.056.4
200246.428.864.1
200341.227.155.3
200437.627.048.2
200542.721.563.8
200642.321.962.7
200739.118.859.3
200836.714.758.7
200943.120.265.9
201034.810.559.1
201133.06.559.5
201229.04.054.0
201325.47.842.9
201428.53.853.1
201525.49.041.7
201622.111.233.0
201722.911.634.2
201821.711.731.6
201920.412.428.3
202029.415.743.1
Table A2. Number of maternal mortality cases and total fertility rate in Central Asian countries from 2000 to 2020.
Table A2. Number of maternal mortality cases and total fertility rate in Central Asian countries from 2000 to 2020.
YearTajikistanKazakhstanKyrgyzstanUzbekistan
MM CasesTFRMM CasesTFRMM CasesTFRMM CasesTFR
20001004.01341.8442.42302.6
20011003.91081.9792.42302.5
2002833.81182.0862.42302.5
2003683.61042.0852.52202.4
2004643.51002.2852.62102.5
2005643.41142.2662.52202.4
2006613.41382.4672.72102.4
2007593.41532.5642.72102.6
2008573.42042.7702.82102.6
2009603.41342.5862.92102.5
2010553.5842.6753.11332.4
2011543.5662.6823.11442.3
2012523.4522.6763.21262.2
2013513.4492.6563.11362.4
2014503.5472.7813.21372.5
2015493.5512.7633.21392.5
2016473.4522.8483.11262.5
2017463.3492.84931502.4
2018*3.3562.8493.31552.6
2019*3.3552.9433.31602.8
2020*3.21563.16131562.9
* data not available.
Table A3. Kazakhstan’s maternal care related indicators.
Table A3. Kazakhstan’s maternal care related indicators.
YearMMRBeds *Obstetricians *Women Accessing Prenatal Care, %Women Accessing Postnatal Care, %Share of Pregnancy ComplicationsPregnancy, Postnatal Complications ***
Pregnancy Hypertensive Disorders, %CVD **, %Anemia, %
200060.9039.513.966.596.616.63.960.33320.2
200148.6039.413.86796.719.1463.54263.9
200250.5038.713.568.892.926.73.861.14921.5
200342.103713.169.296.321.9463.44547.3
200436.9034.512.470.19618.23.658.86368.5
200540.5034.212.171.797.316.83.655.86787.4
200645.6032.313.972.396.1143.354.87817.4
200746.8031.51171.49813.93.149.78012.7
200831.2028.210.271.294.710.82.643.28075.1
200936.8028.510.27391.210.52.844.98367.3
201022.7026.810.564.890.59.72.549.48517.7
201117.4026.310.367.389.57.2247.47598.3
201213.502510.372.991.25.43.535.57091.1
201312.6024.110.475.1944.43.430.36495.3
201411.7022.610.175.494.743.529.16223.4
201512.502210.379.298.54.46.538.34617.6
201612.7021.29.581.699.14.55.634.44591.5
201712.5021.29.782.799.34.2631.87128.2
201813.9020.79.484.998.93.95.730.77448.3
201913.7020.27.687.498.13.75.328.26239.7
202036.5019.57.383.9983.25.8276071.4
* per 1000 born. ** cardiovascular disease. *** per 100,000 population.

References

  1. Moynihan, R.; Sanders, S.; Michaleff, Z.A.; Scott, A.M.; Clark, J.; To, E.J.; Jones, M.; Kitchener, E.; Fox, M.; Johansson, M.; et al. Impact of COVID-19 pandemic on utilization of healthcare services: A systematic review. BMJ Open 2021, 11, e045343. [Google Scholar] [CrossRef]
  2. Chmielewska, B.; Barratt, I.; Townsend, R.; Kalafat, E.; van der Meulen, J.; Gurol-Urganci, I.; O’Brien, P.; Morris, E.; Draycott, T.; Thangaratinam, S.; et al. Effects of the COVID-19 pandemic on maternal and perinatal outcomes: A systematic review and meta-analysis. Lancet Glob. Health 2021, 9, e759–e772. [Google Scholar] [CrossRef] [PubMed]
  3. Aziz, N.; He, J.; Sarker, T.; Sui, H. Exploring the Role of Health Expenditure and Maternal Mortality in South Asian Countries: An Approach towards Shaping Better Health Policy. Int. J. Environ. Res. Public Health 2021, 18, 11514. [Google Scholar] [CrossRef]
  4. Dahab, R.; Sakellariou, D. Barriers to Accessing Maternal Care in Low Income Countries in Africa: A Systematic Review. Int. J. Environ. Res. Public Health 2020, 17, 4292. [Google Scholar] [CrossRef]
  5. Duarte, P. Central Asia: The Bends of History and Geography. Rev. Relac. Int. Estrateg. Segur. 2014, 9, 21–35. [Google Scholar] [CrossRef] [Green Version]
  6. World Bank Group. International Development, Poverty, & Sustainability. Available online: https://www.worldbank.org/en/home (accessed on 20 September 2022).
  7. Organisation for Economic Co-operation and Development. COVID-19 crisis response in Central Asia. 2020. Available online: https://www.oecd.org/coronavirus/policy-responses/covid-19-crisis-response-in-central-asia-5305f172/ (accessed on 23 September 2022).
  8. Balakrishnan, V.S. COVID-19 response in central Asia. Lancet Microbe 2020, 1, e281. [Google Scholar] [CrossRef] [PubMed]
  9. Health Spending as Percent of GDP—Country Rankings. Available online: https://www.theglobaleconomy.com/rankings/health_spending_as_percent_of_gdp/WB-high/ (accessed on 3 December 2022).
  10. Weaver, M.R.; Nandakumar, V.; Joffe, J.; Barber, R.M.; Fullman, N.; Singh, A.; Sparks, G.W.; Yearwood, J.; Lozano, R.; Murray, C.J.L.; et al. Variation in Health Care Access and Quality Among US States and High-Income Countries with Universal Health Insurance Coverage. JAMA Netw Open 2021, 4, e2114730. [Google Scholar] [CrossRef]
  11. World Health Organization. Trends in Maternal Mortality 2000 to 2017: Estimates by WHO, UNICEF, UNFPA, World Bank Group and the United Nations Population Division. 2019. Available online: https://www.unfpa.org/sites/default/files/pub-pdf/Maternal_mortality_report.pdf (accessed on 4 October 2022).
  12. World Health Organization. Maternal Mortality. Evidence Brief Progress towards Achieving the Sustainable Development Goals. Available online: https://apps.who.int/iris/bitstream/handle/10665/329886/WHO-RHR-19.20-eng.pdf (accessed on 22 September 2022).
  13. GBD 2015 Maternal Mortality Collaborators. Global, regional, and national levels of maternal mortality, 1990–2015: A systematic analysis for the Global Burden of Disease Study 2015. Lancet 2016, 388, 1775–1812. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Say, L.; Chou, D.; Gemmill, A.; Tunçalp, Ö.; Moller, A.B.; Daniels, J.; Gülmezoglu, A.M.; Temmerman, M.; Alkema, L. Global causes of maternal death: A WHO systematic analysis. Lancet Glob. Health 2014, 2, e323–e333. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Skhvitaridze, N.; Anda, E.E.; Brenn, T.; Kintraia, N.; Gamkrelidze, A. Scoping maternal care through the lens of maternal deaths: A retrospective analysis of maternal mortality in Georgia. Sex Reprod. Healthc. 2020, 26, 100560. [Google Scholar] [CrossRef]
  16. Statistical Agency under the President of the Republic of Tajikistan; Ministry of Health and Social Protection of Population of the Republic of Tajikistan; ICF. Tajikistan Demographic and Health Survey 2017; Statistical Agency: Dushanbe, Tajikistan; ICF: Rockville, AR, USA, 2018; Available online: http://dhsprogram.com/pubs/pdf/FR341/FR341.pdf (accessed on 22 September 2022).
  17. WHO. SDG Target 3.1 Maternal Mortality. Available online: https://www.who.int/data/gho/data/themes/topics/sdg-target-3-1-maternal-mortality (accessed on 22 September 2022).
  18. Berhan, Y.; Berhan, A. Skilled Health Personnel Attended Delivery as a Proxy Indicator for Maternal and Perinatal Mortality: A Systematic Review. Ethiop. J. Health Sci. 2014, 24, 69–80. [Google Scholar] [CrossRef] [Green Version]
  19. Chen, L.; Feng, P.; Shaver, L.; Wang, Z. Maternal mortality ratio in China from 1990 to 2019: Trends, causes and correlations. BMC Public Health 2021, 21, 1536. [Google Scholar] [CrossRef] [PubMed]
  20. Owusu, P.A.; Sarkodie, S.A.; Pedersen, P.A. Relationship between mortality and health care expenditure: Sustainable assessment of health care system. PLoS ONE 2021, 16, e0247413. [Google Scholar] [CrossRef] [PubMed]
  21. Sheikh, J.; Lawson, H.; Allotey, J.; Yap, M.; Balaji, R.; Kew, T.; Stallings, E.; Coomar, D.; Gaetano-Gil, A.; Zamora, J.; et al. Global variations in the burden of SARS-CoV-2 infection and its outcomes in pregnant women by geographical region and country’s income status: A meta-analysis. BMJ Glob. Health 2022, 7, e010060. [Google Scholar] [CrossRef]
  22. Meh, C.; Sharma, A.; Ram, U.; Fadel, S.; Correa, N.; Snelgrove, J.W.; Shah, P.; Begum, R.; Shah, M.; Hana, T.; et al. Trends in maternal mortality in India over two decades in nationally representative surveys. BJOG 2022, 129, 550–561. [Google Scholar] [CrossRef]
  23. Di Toro, F.; Gjoka, M.; Di Lorenzo, G.; De Santo, D.; De Seta, F.; Maso, G.; Risso, F.M.; Romano, F.; Wiesenfeld, U.; Levi-D’Ancona, R.; et al. Impact of COVID-19 on maternal and neonatal outcomes: A systematic review and meta-analysis. Clin. Microbiol. Infect. 2021, 27, 36–46. [Google Scholar] [CrossRef]
  24. Sunder, A.; Varghese, B.; Darwish, B.; Shaikho, N.; Rashid, M. Impacts and effects of COVID-19 infection in pregnancy. Saudi Med. J. 2022, 43, 67–74. [Google Scholar] [CrossRef] [PubMed]
  25. Januszewski, M.; Ziuzia-Januszewska, L.; Jakimiuk, A.A.; Wierzba, W.; Gluszko, A.; Zytynska-Daniluk, J.; Jakimiuk, A.J. Is the Course of COVID-19 Different during Pregnancy? A Retrospective Comparative Study. Int. J. Environ. Res. Public Health 2021, 18, 12011. [Google Scholar] [CrossRef]
  26. Naqvi, S.; Naqvi, F.; Saleem, S.; Thorsten, V.R.; Figueroa, L.; Mazariegos, M.; Garces, A.; Patel, A.; Das, P.; Kavi, A.; et al. Health care in pregnancy during the COVID -19 pandemic and pregnancy outcomes in six low-and-middle-income countries: Evidence from a prospective, observational registry of the Global Network for Women’s and Children’s Health. BJOG Int. J. Obstet. Gynaecol. 2022, 129, 1298–1307. [Google Scholar] [CrossRef]
  27. Al-Hajjar, S.; Ibrahim, L.; Kurdi, W.; Tulbah, M.; Alnemer, M.; Bin Jabr, M.; Elsaidawi, W.; Binmanee, A.; Ali, M.; Bukhari, H.; et al. Observational cohort study of perinatal outcomes of women with COVID-19. J. Infect. Public Health 2022, 15, 1503–1507. [Google Scholar] [CrossRef]
  28. Kotlar, B.; Gerson, E.; Petrillo, S.; Langer, A.; Tiemeier, H. The impact of the COVID-19 pandemic on maternal and perinatal health: A scoping review. Reprod. Health 2021, 18, 10. [Google Scholar] [CrossRef] [PubMed]
  29. Villar, J.; Ariff, S.; Gunier, R.B.; Thiruvengadam, R.; Rauch, S.; Kholin, A.; Roggero, P.; Prefumo, F.; Vale, M.S.D.; Cardona-Perez, J.A.; et al. Maternal and Neonatal Morbidity and Mortality Among Pregnant Women with and Without COVID-19 Infection. JAMA Pediatr. 2021, 175, 817–826. [Google Scholar] [CrossRef] [PubMed]
  30. Lokken, E.M.; Huebner, E.M.; Taylor, G.G.; Hendrickson, S.; Vanderhoeven, J.; Kachikis, A.; Coler, B.; Walker, C.L.; Sheng, J.S.; Al-Haddad, B.J.; et al. Disease severity, pregnancy outcomes, and maternal deaths among pregnant patients with severe acute respiratory syndrome coronavirus 2 infection in Washington State. Am. J. Obstet. Gynecol. 2021, 225, 77.e1–77.e14. [Google Scholar] [CrossRef]
  31. Metz, T.D.; Clifton, R.G.; Hughes, B.L.; Sandoval, G.J.; Grobman, W.A.; Saade, G.R.; Manuck, T.A.; Longo, M.; Sowles, A.; Clark, K.; et al. Association of SARS-CoV-2 Infection with Serious Maternal Morbidity and Mortality from Obstetric Complications. JAMA 2022, 327, 748–759. [Google Scholar] [CrossRef]
  32. Tekin, A.B.; Yassa, M.; Ilter, P.B.; Yavuz, E.; Önden, B.; Usta, C.; Budak, D.; Günkaya, O.S.; Çavuşoğlu, G.; Taymur, B.D.; et al. COVID-19 related maternal mortality cases in associated with Delta and Omicron waves and the role of lung ultrasound. J. Turk. Soc. Obstet. Gynecol. 2022, 19, 88–97. [Google Scholar] [CrossRef]
  33. Stock, S.J.; Moore, E.; Calvert, C.; Carruthers, J.; Denny, C.; Donaghy, J.; Hillman, S.; Hopcroft, L.E.M.; Hopkins, L.; Goulding, A.; et al. Pregnancy outcomes after SARS-CoV-2 infection in periods dominated by delta and omicron variants in Scotland: A population-based cohort study. Lancet Respir. Med. 2022, 10, 1129–1136. [Google Scholar] [CrossRef] [PubMed]
  34. Karimi, L.; Makvandi, S.; Vahedian-Azimi, A.; Sathyapalan, T.; Sahebkar, A. Effect of COVID-19 on Mortality of Pregnant and Postpartum Women: A Systematic Review and Meta-Analysis. J. Pregnancy 2021, 2021, 1–33. [Google Scholar] [CrossRef]
  35. Bisht, R.; Kandalgaonkar, V.P.; Shinde, K.K. Cesarean Section Rate among COVID-19 Mothers and Its Classification through Robson’s Criteria. J. South Asian Fed. Obstet. Gynaecol. 2021, 13, 342–346. [Google Scholar] [CrossRef]
  36. Michels, B.D.; Marin, D.F.D.; Iser, B.P.M. Increment of Maternal Mortality Among Admissions for Childbirth in Low-risk Pregnant Women in Brazil: Effect of COVID-19 Pandemic? Rev. Bras. Ginecol. Obstet. 2022, 44, 740–745. [Google Scholar] [CrossRef] [PubMed]
  37. Takemoto, M.L.; Menezes, M.O.; Andreucci, C.B.; Knobel, R.; Sousa, L.A.; Katz, L.; Fonseca, E.B.; Nakamura-Pereira, M.; Magalhães, C.G.; Diniz, C.S.; et al. Clinical characteristics and risk factors for mortality in obstetric patients with severe COVID-19 in Brazil: A surveillance database analysis. BJOG: Int. J. Obstet. Gynaecol. 2020, 127, 1618–1626. [Google Scholar] [CrossRef] [PubMed]
  38. Hessami, K.; Homayoon, N.; Hashemi, A.; Vafaei, H.; Kasraeian, M.; Asadi, N. COVID-19 and maternal, fetal and neonatal mortality: A systematic review. J. Matern. Neonatal Med. 2020, 35, 2936–2941. [Google Scholar] [CrossRef]
  39. La Verde, M.; Riemma, G.; Torella, M.; Cianci, S.; Savoia, F.; Licciardi, F.; Scida, S.; Morlando, M.; Colacurci, N.; De Franciscis, P. Maternal death related to COVID-19: A systematic review and meta-analysis focused on maternal co-morbidities and clinical characteristics. Int. J. Gynecol. Obstet. 2021, 154, 212–219. [Google Scholar] [CrossRef]
  40. Diniz, D.; Brito, L.; Rondon, G. Maternal mortality and the lack of women-centered care in Brazil during COVID-19: Preliminary findings of a qualitative study. Lancet Reg. Health Am. 2022, 10, 100239. [Google Scholar] [CrossRef] [PubMed]
  41. Lumbreras-Marquez, M.I.M.; Campos-Zamora, M.M.; Seifert, S.M.; Kim, J.M.; Lumbreras-Marquez, J.M.; Vazquez-Alaniz, F.; Fields, K.G.M.; Farber, M.K.M. Excess Maternal Deaths Associated with Coronavirus Disease 2019 (COVID-19) in Mexico. Obstet. Gynecol. 2020, 136, 1114–1116. [Google Scholar] [CrossRef] [PubMed]
  42. WHO. Maternal Mortality Ratio per 100,000 Live Births. Available online: https://www.who.int/data/gho/indicator-metadata-registry/imr-details/26 (accessed on 22 September 2022).
  43. Ministry of Healthcare of the Republic of Kazakhstan. Kazakhstan Ministry of Health. Statistical Industry Data. Available online: https://www.gov.kz/memleket/entities/dsm/activities/directions?lang=en (accessed on 22 October 2022).
  44. Center of eHealth of Ministry of Health Republic of Kyrgyzstan. eHealth. Available online: http://cez.med.kg (accessed on 22 October 2022).
  45. Agency of Statistics under President of the Republic of Tajikistan. Demographic Yearbook of the Republic of Tajikistan. Available online: https://www.stat.tj/en/news/publications/demographic-yearbook-of-the-republic-of-tajikistan (accessed on 28 October 2022).
  46. United Nations Population Fund. Uzbekistan. Available online: https://uzbekistan.unfpa.org/en (accessed on 28 October 2022).
  47. World Health Organization. Maternal Mortality Measurement: Guidance to Improve National Reporting. 2022. Available online: https://apps.who.int/iris/handle/10665/360576 (accessed on 28 October 2022).
  48. WHO. Global Health Expenditure Database. Available online: https://apps.who.int/nha/database (accessed on 26 September 2022).
  49. Ministry of Justice of the Republic of Kazakhstan. Rules for the Provision of Maternal Mortality Information. Available online: https://adilet.zan.kz/kaz/docs/V2000021181 (accessed on 6 January 2022).
  50. Minister of Health of the Republic of Kazakhstan. Standard of Pathological and Anatomical Diagnostics in the Republic of Kazakhstan. 2020. Available online: https://adilet.zan.kz/kaz/docs/V2000021790 (accessed on 6 January 2022).
  51. Ministry of Health of the Kyrgyz Republic. On Improving the Completeness of Registration, Timely Reporting of Maternal Deaths to the Appropriate Authorities and the Reliability of the Maternal Mortality Indicator. 2011. Available online: https://online.zakon.kz/Document/?doc_id=31028500 (accessed on 6 January 2022).
  52. Rechel, B.; Ahmedov, M.; Akkazieva, B.; Katsaga, A.; Khodjamurodov, G.; McKee, M. Lessons from two decades of health reform in Central Asia. Health Policy Plan. 2011, 27, 281–287. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Dominis, S.; Yazbeck, A.S.; Hartel, L.A. Keys to Health System Strengthening Success: Lessons from 25 Years of Health System Reforms and External Technical Support in Central Asia. Health Syst. Reform 2018, 4, 160–169. [Google Scholar] [CrossRef]
  54. Thoma, M.E.; Declercq, E.R. All-Cause Maternal Mortality in the US Before vs During the COVID-19 Pandemic. JAMA Netw. Open 2022, 5, e2219133. [Google Scholar] [CrossRef] [PubMed]
  55. Amorim, M.M.R.; Takemoto, M.L.S.; da Fonseca, E.B. Maternal deaths with coronavirus disease 2019: A different outcome from low- to middle-resource countries? Am. J. Obstet. Gynecol. 2020, 223, 298–299. [Google Scholar] [CrossRef] [PubMed]
  56. World Bank Group. Fertility Rate, Total (Births per Woman). Available online: https://data.worldbank.org/indicator/SP.DYN.TFRT.IN?locations=KZ-TJ-KG-UZ (accessed on 7 January 2022).
  57. Laatikainen, T.; Inglin, L.; Chonmurunov, I.; Stambekov, B.; Altymycheva, A.; Farrington, J.L. National electronic primary health care database in monitoring performance of primary care in Kyrgyzstan. Prim. Health Care Res. Dev. 2022, 23. [Google Scholar] [CrossRef]
  58. Obermann, K.; Chanturidze, T.; Richardson, E.; Tanirbergenov, S.; Shoranov, M.; Nurgozhaev, A. Data for development in health: A case study and monitoring framework from Kazakhstan. BMJ Glob. Health 2016, 1, e000003. [Google Scholar] [CrossRef]
  59. World Health Organization. Quality of Care Review in Kyrgyzstan, Working Document. 2018. Available online: https://www.euro.who.int/__data/assets/pdf_file/0004/383890/kgz-qoc-eng.pdf (accessed on 9 January 2023).
  60. United Nations Economic Commission for Europe (UNECE), Eurostat (the Statistical Office of the European Union) and the Statistical Office of the European Free Trade Association (EFTA). Global Assessment of the National Statistical System of Kyrgyzstan. Available online: https://www.efta.int/sites/default/files/images/publications/GA%20Kyrgyzstan%20Final%20EN.pdf (accessed on 9 January 2023).
  61. United Nations Economic Commission for Europe (UNECE), the European Free Trade Association (EFTA) and the European Commission (Eurostat). Global Assessment of the National Statistical System of Tajikistan. Available online: https://unece.org/DAM/stats/documents/technical_coop/GA_Tajikistan_ENG.pdf (accessed on 9 January 2023).
  62. Rana, R.H.; Alam, K.; Gow, J. Health expenditure, child and maternal mortality nexus: A comparative global analysis. BMC Int. Health Hum. Rights 2018, 18, 29. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Maternal mortality ratio in CA countries, per 100,000 live births, 2000–2020.
Figure 1. Maternal mortality ratio in CA countries, per 100,000 live births, 2000–2020.
Ijerph 20 02184 g001
Figure 2. Maternal mortality in CA countries per 100,000 live births in 2020.
Figure 2. Maternal mortality in CA countries per 100,000 live births in 2020.
Ijerph 20 02184 g002
Figure 3. MMR structure by the cause of death in Kazakhstan from 2000 to 2020.
Figure 3. MMR structure by the cause of death in Kazakhstan from 2000 to 2020.
Ijerph 20 02184 g003
Table 1. Total health expenditures of Central Asia countries in national currency units from 2000 to 2019 in millions.
Table 1. Total health expenditures of Central Asia countries in national currency units from 2000 to 2019 in millions.
YearKazakhstan
(Tenge)
Kyrgyzstan
(Som)
Uzbekistan
(Sum)
Tajikistan
(Somoni)
2000108.1642.885209.47477
2001112.8273.160323.361115
2002136.5053.461480.187148
2003171.7204.885639.818224
2004233.8125.852744.062296
2005296.1647.517954.605375
2006347.0889.4591236.557467
2007347.3499.8371605.195708
2008489.53812.2672226.2251041
2009595.12113.8822949.0051208
2010596.96315.3163866.2301417
2011734.98820.3264986.8641762
2012942.01226.4206561.8902163
2013958.60629.0908183.9442647
20141180.23129.4828278.2743040
20151243.08730.77710,483.1033343
20161607.52030.54512,043.2553815
20171659.88532.81515,359.1884416
20181741.98828.52821,563.5904984
20191938.19227.82628,753.0295496
r−0.86−0.70−0.66−0.89
p<0.001<0.001<0.01<0.001
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhamantayev, O.; Kayupova, G.; Nukeshtayeva, K.; Yerdessov, N.; Bolatova, Z.; Turmukhambetova, A. COVID-19 Pandemic Impact on the Maternal Mortality in Kazakhstan and Comparison with the Countries in Central Asia. Int. J. Environ. Res. Public Health 2023, 20, 2184. https://doi.org/10.3390/ijerph20032184

AMA Style

Zhamantayev O, Kayupova G, Nukeshtayeva K, Yerdessov N, Bolatova Z, Turmukhambetova A. COVID-19 Pandemic Impact on the Maternal Mortality in Kazakhstan and Comparison with the Countries in Central Asia. International Journal of Environmental Research and Public Health. 2023; 20(3):2184. https://doi.org/10.3390/ijerph20032184

Chicago/Turabian Style

Zhamantayev, Olzhas, Gaukhar Kayupova, Karina Nukeshtayeva, Nurbek Yerdessov, Zhanerke Bolatova, and Anar Turmukhambetova. 2023. "COVID-19 Pandemic Impact on the Maternal Mortality in Kazakhstan and Comparison with the Countries in Central Asia" International Journal of Environmental Research and Public Health 20, no. 3: 2184. https://doi.org/10.3390/ijerph20032184

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop