Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Hypertensive disorders of pregnancy (HDP) management pathways: results of a Delphi survey to contextualise international recommendations for Indonesian primary care settings

BMC Pregnancy and Childbirth volume 21, Article number: 269 (2021) Cite this article

Abstract

Background

Hypertensive disorders of pregnancy (HDP) are a significant contributor to the high maternal mortality rate in Indonesia. At the moment, limited guidelines are available to assist primary care providers in managing HDP cases. A previous review of 16 international HDP guidelines has identified opportunities for improving HDP management in Indonesian primary care, but it has not determined the suitability of the recommendations in practice. This study aims to achieve consensus among the experts regarding the recommendations suitability and to develop HDP pathways in Indonesian primary care.

Methods

Maternal health experts, including GPs, midwives, nurses, medical specialists and health policy researchers from Indonesia and overseas were recruited for the study. They participated in a consensus development process that applied a mix of quantitative and qualitative questions in three Delphi survey rounds. At the first and second-round survey, the participants were asked to rate their agreement on whether each of 125 statements about HDP and HDP management is appropriate for use in Indonesian primary care settings. The third-round survey presented the drafts of HDP pathways and sought participants’ agreement and further suggestions. The participants’ agreement scores were calculated with a statement needing a minimum of 70% agreement to be included in the HDP pathways. The participants’ responses and suggestions to the free text questions were analysed thematically.

Results

A total of 52 participants were included, with 48, 45 and 37 of them completing the first, second and third round of the survey respectively. Consensus was reached for 115 of the 125 statements on HDP definition, screening, management and long-term follow-up. Agreement scores for the statements ranged from 70.8–100.0%, and potential implementation barriers of the pathways were identified. Drafts of HDP management pathways were also agreed upon and received suggestions from the participants.

Conclusions

Most evidence-based management recommendations achieved consensus and were included in the developed HDP management pathways, which can potentially be implemented in Indonesian settings. Further investigations are needed to explore the acceptability and feasibility of the developed HDP pathways in primary care practice.

Peer Review reports

Background

Hypertensive disorders of pregnancy (HDP) cover a range of diagnoses, including chronic hypertension, gestational hypertension, white coat hypertension and preeclampsia/eclampsia [1]. Every day, in low-and middle-income countries (LMICs) many women die due to HDP [2] and in Indonesia, HDP remains a major cause of maternal mortality with approximately three maternal deaths daily [3, 4]. With its current increasing trend, HDP in Indonesia may soon replace postpartum hemorrhage as the most common cause of direct maternal mortality [3, 4].

Research shows that maternal mortality from HDP is preventable if the women receive appropriate management. However, many maternal deaths from HDP in Indonesia are not well anticipated due to lack of practice guidelines in primary care [5]. Current Indonesian primary care guidelines merely recommend general practitioners (GPs) to refer women with HDP to hospitals [6–8], but details of further management such as screening, monitoring, and long-term postpartum follow-up treatment for HDP women are lacking [9]. Meanwhile, Indonesian disparities in health due to community beliefs, inadequate obstetrician availability and challenging geographical locations complicate referrals from primary care leading to delays in accessing appropriate hospital management [4, 10, 11]. For these reasons, there is an urgent need to upgrade Indonesian primary care providers’ practice with the aim to prevent severe HDP complications and optimise patient initial treatment before hospitalisation.

This research is part of a larger study to improve the quality of HDP management in Indonesian primary care by developing HDP management pathways appropriate for this settings [12]. The management pathways are designed to enable the providers to have structured, practical and collaborative guidance that subsequently improves their practice behaviour [13–16]. Our previous review has identified evidence-based practices for improving HDP management in Indonesian primary care [17], and our previous interviews with keystakeholders have explored the way HDP is managed in Indonesian primary care [9, 18]. However, to adopt the recommendations to develop HDP management pathway as an intervention to improve the providers’ practice would require a further contextualisation process. Our review findings indicate that not all recommendations based on the international HDP guidelines can directly be adopted into the Indonesian context due to different practice environments, such as different professional authority, facilities, policies or public insurance (JKN/Jaminan Kesehatan Nasional) regulations [9, 17].

As well, our interviews with Indonesian key stakeholders in primary care also emphasise a need for further considerations when developing HDP management pathways for Indonesian primary care. Public primary care clinics (Puskesmas/Pusat Kesehatan Masyarakat) in Indonesia have to undertake maternal surveillance and maternal audit processes in the community in addition to provide individual patient treatment [9, 18]. There are also community health workers (cadres) involved in the maternal health activities, but their job description in the current Indonesian guidelines remains unclear [19, 20]. Therefore, suggestions arising from the interviews also need to be further explored for their use in the HDP pathways. This research then aims to establish experts’ consensus on the identified 125 international and local HDP management recommendations to develop HDP management pathways for Indonesian primary health care settings.

Methods

Study design: consensus development using Delphi technique

Consensus is usually defined as ‘general agreement’ [21]. Consensus development is an essential stage in a guideline or pathway development to determine general experts’ agreement regarding recommendations used in the pathways [21] or to determine the feasibility of international recommendations to be used in a local practice setting where their supporting implementation evidence is limited [22].

One of the most common consensus development methods in pathway development is the Delphi technique, in which the experts provide their judgments directly or indirectly through surveys or interviews [23]. In this study, three rounds of anonymous online Delphi survey were used to develop consensus on the applicability of 125 statements based on international HDP management recommendations and our previous interviews to develop HDP pathways, with respect to their readiness to be used by GPs, midwives and nurses in Indonesian primary care settings [17].

Survey statements

The HDP statements tested in the survey were informed by our review of international evidence-based HDP guidelines [12, 17] and our exploratory interviews with Indonesian primary care stakeholders [9, 18]. The 125 statements were divided into 62 statements for the first-round survey (topics included in this round: HDP definitions, risks, screening and diagnosis, prevention and long-term follow-up), and 63 statements for the second-round survey (topics included in this round: HDP management, monitoring, facilities and surveillance for women with HDP). The complete survey questionnaires are provided in Supplementary file 1.

Participants

Indonesian and international experts in maternal health identified through the authors’ professional networks and snowballing recruitment process were invited to participate in the study. The participants’ inclusion criteria were [12]:

  1. (i)

    GPs, midwives, nurses, specialists, local health officers, maternal health researchers or policymakers.

  2. (ii)

    Have a minimum of  two-years of research and/or working experience in maternal health;

  3. (iii)

    Have an academic background in health sciences;

  4. (iv)

    Familiar with the context of primary care in Indonesia or LMICs; and

  5. (v)

    Keen to participate in all survey rounds.

Recruitment

All prospective participants were recruited by email and/or WhatsApp messenger [24] containing a link for the recruitment pages. The recruitment pages were provided bilingually in Bahasa Indonesia and English, and the participants were able to choose their preferred language. Prospective participants who did not meet the inclusive criteria were excluded and only those who satisfied the criteria were able to carry on to the survey’s online plain language statement (PLS) and electronically sign the consent page. The participants’ identity was confidential to other participants and was only be identifiable by researchers in this study.

Data collection

The data collection applied three rounds of online survey using the University of Melbourne REDCap (Research Electronic Data Capture) platform [25], and each survey round consisted of:

  • a questionnaire asking participants to provide their judgement on the HDP statements on a five-point Likert scale [26, 27] (1 = strong disagreement, 2 = disagreement, 3 = indicated neutral position, 4 = agreement, and 5 = strong agreement). Participants were asked to rate their judgment on (i) whether the recommendation was useful to improve HDP management in primary care and (ii) whether the recommendation was likely to be applicable in practice in Indonesia or needed to be contextualised;

  • free-text questions to ask the participants further suggestions related to the tested statements.

Participants were given 3 weeks to complete each round. They received short messages and email reminders in 1 week and 3 days before the survey was closed. Once a round was completed, participants who completed it were sent a link to the next survey round.

First-round survey

After completing the PLS and consent pages, the participants were sent with the first-round survey link asking them to rate 62 statements: HDP definitions (n = 7), risk factors (n = 16), screening and diagnosis (n = 16), prevention (n = 10), and long-term follow up (n = 13) in primary care. Other than the basic free-text questions above, these additional three questions about HDP management in primary care were also presented exclusively in the first-round to gain insights regarding the roles of primary care providers in HDP management [12]:

  1. (i)

    What are the roles of Indonesian primary care in HDP management?

  2. (ii)

    What potential practices that can be conducted by primary care providers in HDP management?

  3. (iii)

    What are the barriers and facilitators of HDP management in Indonesian primary care?

Second-round survey

This round tested 63 statements regarding HDP management (n = 14), monitoring (n = 31), required facilities (n = 8), and surveillance (n = 10) in primary care. The survey pages also contained results of the first-round survey and participants were able to review and revise their responses on statements that had not reached consensus in the first-round survey.

Pathways development

Statements that reached consensus at the first and second-round survey were used to develop HDP pathways that were initially drafted and designed by the first author. However, drafts of the pathways were also discussed and received suggestions from all project investigators before their presentations to participants in the third-round survey.

Third-round survey

The third-round survey asked for the participants’ agreement and suggestions on the HDP management pathway drafts. Results of the second-round survey were presented, and the participants were able to review and revise their responses on statements that had not reached consensus in the first and second-round survey. Statements that reached consensus at this round, including the participants’ suggestions were used to finalise the HDP management pathways.

Data analysis

The participants’ agreement scores in each survey were analysed descriptively using Microsoft Excel software. The participants’ responses were calculated for each statement to generate total agreement scores, standard deviation and interquartile ranges (IQR). IQR was chosen for determining the spread of the data considering that the survey only had five ordinal options (5-point Likert scale) and the limited number of participants in the study [28]. The minimum requirement set for each round was: at least 60% participation and the statements had to have at least 70% agreement to be included in the HDP pathway [23].

The free-text responses and suggestions from the participants were imported into the Nvivo 12 software [29] and analysed thematically [30]. The free-text responses in Bahasa Indonesia had also been translated into English, imported into Nvivo and coded for any significant survey responses. The codes were grouped based on their similarities and patterns, and were then used to establish themes and overarching themes. The themes and overarching themes were also discussed and mutually agreed by all project investigators. Presentation of this study adheres the standard of reporting intervention development studies (GUIDED) (Supplementary file 2) [31].

Language validation

All of the survey statements and questions were initially created in English. They were then translated into Bahasa Indonesia by the first author and presented to participants based on their language preference. Participants’ responses written in Bahasa Indonesia were also translated into English to enable analysis and discussion between the project investigators. All questionnaires and a quarter of the free-text responses were also back-translated into English and were reviewed by another two native Indonesian speakers to ensure their translation validation.

Survey validation

The recruitment and survey pages were tested to ensure internal validation. Each of the survey pages had a minimum of ten trials by the project investigators and validation participants before its distribution to the survey participants.

Results

The surveys were conducted from November 2018 to May 2019. A total of 52 participants agreed to participate, of these, 48 (92.3%), 45 (93.4%), and 37 (82.2%) participants completed the first, second, and third-round of surveys. The participants’ baseline demographic data are presented in Table 1.

Table 1 Summary of the participants’ demographic background
Full size table

First-round survey

Around 85.5% of the tested statements reached consensus at this round and the participants’ agreement scores ranged from 39.6 to 100.0%. Even, some statements achieved 100.0% agreement, such as ‘routine blood pressure measurement for HDP screening’ and ‘pregnant women have to be informed and counseled about HDP risk factors’. Ten statements did not reach 70.0% agreement and these statements were then brought forward into the second-round survey (Please refer to Table 2 and Suplementary file 3).

Table 2 Summary of agreement scoresa
Full size table

Free text-responses in the first-round highlighted the roles of primary care physicians in HDP management, and the most prominent theme emerging in the analysis was authority (with 219 quotes). Most participants believed that primary care providers have responsibilities to conduct antenatal care (ANC), identify women with increased risks of HDP and refer patients who are at risk to obstetricians. They also had to not only provide HDP clinical management in primary care but also care coordination with hospitals.

The participants also conceded that routine ANC had already been well applied in Indonesian primary care practice and blood pressure monitoring and dipstick urine tests been routinely conducted as preeclampsia screening. However, some participants claimed that primary care had limited resources available in practice, for instance, only nifedipine was available as a medicine for pregnancy hypertension and the doctors’ limited time for pregnancy consultation.

Interestingly, many of the clinician participants also indicated their own doubt with the quality of HDP management they currently provide in practice, particularly the referral timing and patient monitoring procedures. They also expected guidance and skills upgrades on such HDP management in primary care (Table 3).

Table 3 Quotes from the participants’ free-text questions responses in the survey
Full size table

Second-round survey

Most of the tested statements (92.0%) reached consensus in this round. Similar to the first-round survey results, the statements’ agreement scores were high, particularly on statements related to community surveillance and home visits for women with HDP (mean agreement scores: 98.0%). Five statements did not reach consensus in this round and the statements were re-tested in the third-round survey (Please refer to Table 2 and Supplementary file 3).

Seven participants also revised their responses to statements in the first-round survey and increased the agreement scores to above 70.0% for four statements: ‘systemic lupus erythematosus as a risk factor for preeclampsia’ (72.9%), ‘serum creatinine as a baseline examination for women with preeclampsia risk factors’ (70.8%), ‘aspirin 75-150mg is given daily at bedtime’ (70.8%) and ‘GPs can prescribe low dose aspirin prescription for preeclampsia prophylaxis’ (70.8%).

Some participants in free-text questions raised further opinions regarding the authority of HDP in primary care, such as suggesting different management of mild and severe preeclampsia based on their usual practice and a need for a government policy to facilitate the pathways’ implementation (Table 3). Again, a participant also wrote another limitation in practice, i.e. that only a few kind of medicines available in primary care.

Pathways development

The HDP management pathways drafts had been developed from statements that reached consensus from the first and the second-round survey. HDP management pathways drafts were presented in three flowcharts: (i) HDP diagnosis, (ii) HDP management, and (iii) HDP maternal surveillance flowchart in primary care. The HDP management pathway itself was divided into five sections: (i) screening for preeclampsia risk factors at the first pregnancy visit, (ii) HDP screening activities during routine ANC, (iii) HDP management and monitoring, (iv) delivery plans for women with HDP, and (v) postpartum follow up for women with HDP in primary care.

The project investigators also considered and discussed statements that had not achieved consensus at the first and second-round survey. The pathways accommodated statements related to contraception and antihypertensive medication used for women with HDP history, and were later accommodated using information tables (that are not included in this publication). One statement was also considered not to be re-tested in the third-round survey, i.e., IVF as a risk factor for preeclampsia.

Third-round

Most participants agreed on the HDP management pathway drafts. The pathways’ agreement scores ranged from 78.4% for HDP monitoring to 89.2% for preeclampsia risk factors screening (Table 2 and Supplementary file 3). Eleven participants revised their responses on statements that had not received consensus at the previous rounds. Their revised responses, however, only changed agreement score for platelet count as baseline data for pregnant women with risks of preeclampsia (from 66.7 to 70.8%). The complete final agreement score for each statement and the diagnosis flowchart are attached as Supplementary file 3 and Fig. 1.

Fig. 1
figure 1

Diagnosis flowchart for women with HDP

Full size image

There were participants’ suggestions obtained in the third-round survey requesting improvement on the triage for pregnant women by accommodating recommendations for preeclampsia prevention after the 20th week of pregnancy. A further suggestion was also obtained for the HDP surveillance pathway to respect the patients’ confidentiality when sharing their medical information from private to public primary care clinics/Puskesmas. It was previously mentioned at the surveillance pathway draft that any HDP cases should be referred to Puskesmas  to record their surveillance data and be followed-up by cadres, such as by doing home visits or receiving supports from community leaders. The suggestion for patient confidentiality was then used to improve statements listed in the surveillance pathway (Table 3).

Another participant in this round also expressed his disagreement on HDP pathway development through the survey. He mentioned that the pathways drafts were way too complicated and they should not be developed through surveys. There were also, again, a suggestion to differentiate management of mild and severe preeclampsia and further pressure to refer women with HDP to hospitals.

Final revised pathways

The pathways drafts were revised after receiving the participants’ suggestions. The preeclampsia triage during the first antenatal visit was improved by providing statements if aspirin was initiated before the 16th week and after the 20th week of pregnancy. A statement was also included in the HDP surveillance pathway regarding respecting patients’ confidentiality. The participants’ suggestion to differentiate management of mild-moderate and severe preeclampsia was not accommodated in this stage. The final HDP management pathways and surveillance pathways in primary care are presented in Figs. 2 and 3.

Fig. 2
figure 2

Hypertensive disorders of pregnancy (HDP) management pathway in primary care

Full size image
Fig. 3
figure 3

Surveillance pathway for women with hypertensive disorders of pregnancy (HDP) in primary care

Full size image

Discussion

This study is the first study to seek experts’ consensus and opinions on a set of HDP management recommendations for the Indonesian primary care setting. Despite some identified challenges that may limit the implementation of the developed pathways in primary care, the surveys demonstrated that almost all of the HDP recommendations and the developed HDP management pathways have reached consensus for their implementation in Indonesia.

he developed pathways provide step-by-step clinical guidance on HDP management embedded in the routine ANC and can shift the clinicians’ focus to early signs, symptoms and risk factors for preeclampsia. The developed pathways also have abilities to equip GPs and midwives in Indonesia with comprehensive HDP guidance in primary care that have been expected by key stakeholders in our exploratory consultation, particularly, when referral to the hospital could not be made immediately [9, 18. The pathways are also able to complement a preeclampsia management model recently developed for LMICs that covers principles of the management but lack of detailed clinical recommendations for primary care [32]. The pathways can also complement other HDP guidelines in Indonesia and other LMICs-which were published more than a decade ago and focused only on preeclampsia management and secondary care [6, 33].

Potential challenges that may limit the recommendations uptakes in practice have also been identified in the survey, such as tensions of interprofessional authority between the clinicians and clinical inertia of HDP management in primary care. It was implied in the survey of the participants’ hesitance to agree on some HDP management conducted by GPs and midwives, such as low-dose aspirin prescriptions in primary care. Even though, aspirin medicine has benefits of reducing risks of preterm preeclampsia [34–36], and relatively safe for pregnant women [37, 38]. Low dose aspirin tablets are also widely available in Indonesian Puskesmas [39]. The participants also seem to resign on the fact that only nifedipine is available in Puskesmas, and hesitate to agree on other antihypertensive prescriptions in primary care, such as methyldopa and labetalol, that are only available in the hospitals or accessible through prescription in private pharmacies [40].

Different practice recommendations based on the existing Indonesian HDP guidelines compared to the international guidelines may also influence the pathways uptake in practice. Some participants recommended different preeclampsia management based on its severity category of mild versus severe preeclampsia. In an Indonesian guideline, pregnant women with blood pressure ≥ 140/90 mmHg and positive (+ 1) proteinuria or increased creatinine level are categorised as having mild to moderate preeclampsia. In comparison, women with severe preeclampsia are those who have blood pressure ≥ 160/90 mmHg, positive (+ 2) proteinuria and/or preeclampsia symptoms such as headache or visual disturbance [8]. However, recent international guidelines on preeclampsia have recommended avoiding those categorisations above in practice, as they are often confusing and that women with preeclampsia can deteriorate very rapidly into more severe conditions [1, 41, 42]. As those categorisations are still common in Indonesian practice, it is therefore not surprising that some participants in the survey suggested formal policy changes to secure practices of additional preeclampsia management in primary care. While some obstetrician participants also voiced their opinions that the pathways should be developed by more competent experts, even though, they have been informed that recommendations in the survey were extracted from international HDP guidelines and backed-up by recent evidence [12, 17].

The clinicians’ hesitance and clinical inertia above are likely influenced by gaps of medical training for GPs and other clinicians in primary care, hierarchical culture and late adoption of evidence-based practices in Indonesian health care. GPs in Indonesia are only required to complete a medical doctor degree in a university to be able to practice in primary care. In contrast, specialists are required to undertake another three to four-years of specialty training at a hospital. This training gap then gives the misconception that GPs are less competent and confident than specialists resulting in the GPs’ low status in the eyes of patients and specialists [43–45], while obstetricians are perceived as having the highest authorities and the ultimate source of maternal care updates.

However, gaps in evidence-based practice above can be improved by introducing and implementing the developed HDP pathways in primary care. The GPs, midwives and nurses in Indonesia have important roles of HDP management due to their gate-keeping roles and accessible practices across Indonesian territory [43]. if they are not well supported and encouraged to perform more HDP management, then who will be able to appropriately manage HDP women in the first place considering challenges of referral and disparities in Indonesian health care.

Strengths and limitations of the study

Delphi technique in this survey is not bound by geographical locations of the participants and offers flexible opportunities for them to share their opinions and minimising bias of dominant experts [23, 46]. The process is anonymous and hence has the advantage of minimising challenges of the hierarchical culture that we would anticipate among Indonesian health care professionals [47–49].

Although the sample size in this study was small, the recruitment of participants with various backgrounds and experiences has captured broad views and opinions from the experts [50]. The survey has also optimised the participants’ interaction by providing them opportunities to view and revise their responses at the previous rounds. Results validity of the study is justified by the high survey participation rates in each round and the high percentages of agreed statements completed with good agreement scores [23, 51].

There were some statements that were not re-tested in the third-round survey due to local contextual considerations. In-vitro fertilisation (IVF) was not re-tested due to its irrelevance in the Indonesian population context as IVF is usually accessed by subfertile-married couples [52, 53]. Contraception and antihypertensive medication were further accommodated using two tables in the supplementary materials (that are not included in this publication) aiming to provide more comprehensive educational information for the targeted audience in primary care.

Suggestion for further research

Further research is desired to investigate the pathways acceptability in practice and to confirm the suitability of aspirin prescription for anemic women. Towards the end of the study, new evidence emerged to indicate that anaemia in pregnancy might also be a risk factor for preeclampsia in LMICs [54, 55]. This possible risk factor is directly relevant to situations in Indonesia where anemia prevalence is high due to malnutrition, genetics, or infections, such as malaria and hookworm, which cause inflammation in the placenta [54–57]. The use of aspirin in anaemic women, however, is not currently supported in any of the existing international HDP guidelines [17] or tested in the survey. Therefore, the management of anaemic women with any preeclampsia risk factors would require further careful clinical consideration.

Conclusion

Most of HDP management recommendations extracted from international HDP guidelines [17] achieved consensus in this study and the developed HDP management pathways are potentially implementable in Indonesian primary care. Further research is needed to explore the pathways’ acceptability and feasibility in Indonesian practice and to investigate the appropriateness of anemia as another preeclampsia risk factors in LMICs, including the use of low-dose aspirin in anemic pregnant women with other underlying preeclampsia risk factors.

Availability of data and materials

Supplementary files of the statements tested in the questionnaire and final agreement scores of the HDP statements are included in this publication. However, raw qualitative data and survey response materials are not shared due to protect the participants’ confidentiality.

Abbreviations

ANC:

Antenatal care

HDP:

Hypertensive disorders of pregnancy

GPs:

General practitioners

IQR:

Interquartile ranges

IVF:

In-vitro Fertilisation

JKN:

Jaminan Kesehatan Nasional (Indonesian public health insurance)

LMICs:

Low-and middle-income countries

Puskesmas:

Pusat Kesehatan Masyarakat (Public primary care clinic)

REDCap:

Research electronic data capture

References

  1. Brown MA, Magee LA, et al. The hypertensive disorders of pregnancy: ISSHP classification, diagnosis & management recommendations for international practice. Pregnancy Hypertens. 2018;13:291–310. https://doi.org/10.1016/j.preghy.2018.05.004.

    Article  CAS  PubMed  Google Scholar 

  2. World Health Organization (WHO). Maternal Mortality Key Facts: WHO; 2018. Available from: http://www.who.int/news-room/fact-sheets/detail/maternal-mortality.7 June 2018. [cited 2018]

  3. Indonesia Ministry of Health. Indonesian Health Profile (2014) in Bahasa Indonesia. Jakarta: Ministry of Health; 2015. http://www.depkes.go.id/resources/download/pusdatin/profil-kesehatan-indonesia/profil-kesehatan-indonesia-2014.pdf

    Google Scholar 

  4. Baharuddin M, Amelia D, et al. Maternal death reviews: A retrospective case series of 90 hospital-based maternal deaths in 11 hospitals in Indonesia. Int J Gynecol Obstetr. 2019;144(S1):59–64. https://doi.org/10.1002/ijgo.12736.

    Article  Google Scholar 

  5. Say L, Chou D, Gemmill A, Tunçalp Ö, Moller A-B, Daniels J, et al. Global causes of maternal death: a WHO systematic analysis. Lancet Glob Health. 2014;2(6):e323–33. https://doi.org/10.1016/S2214-109X(14)70227-X.

  6. Kulonprogo Local Health Office. Referral Manual for Pregnancy, Labor, Delivery and Newborn Care, according to the Technical Procedure of Jampersal and Situation at Kulonprogo District Series Editor, editor^editors. Kulon Progo Yogyakarta. 2012. p.  73. http://kebijakankesehatanindonesia.net/v13/images/manualrujuk/MANUAL%20RUJUKAN%20KEHAMILAN%20KULON%20RPOGO%20FINAL.pdf. Accessed 19 Sept 2019.

  7. Perhimpunan Obstetri dan Ginekologi Indonesia, Maternal, Himpunan Kedokteran Feto. Pedoman Nasional Pelayanan Kedokteran. 2018. http://pogi.or.id/publish/download/pnpk-dan-ppk/. Accessed 28 May 2018.

  8. World Health Organization-South-East Asia Regional Office (WHO-SEARO), Kementerian Kesehatan Republik Indonesia, et al.2013. Buku Saku Pelayanan Kesehatan Ibu di Fasilitas Kesehatan Dasar dan Rujukan. http://www.searo.who.int/indonesia/documents/976-602-235-265-5-buku-saku-pelayanan-kesehatan-ibu.pdf?ua=1

    Google Scholar 

  9. Ekawati FM, Licqurish S, et al. Management of hypertensive disorders of pregnancy (HDP) in Indonesian primary care settings: the views of stakeholders. Aust J Prim Health. Abstracts of the AAAPC Annual Research Conference, Adelaide. 2019;25( 3):XIV.

  10. D'Ambruoso L, Martha E, et al. Maternal mortality and severe morbidity in rural Indonesia Part 1: The community perspective. Soc Med. 2013;7(2):47.

    Google Scholar 

  11. Farah Diba, Ichsan, Ichsan, et al. Healthcare providers’ perception of the referral system in maternal care facilities in Aceh, Indonesia: a cross-sectional study. BMJ open. 2019;9(12):1–8. https://bmjopen.bmj.com/content/bmjopen/9/12/e031484.full.pdf.

  12. Fitriana Murriya Ekawati, Licqurish, Sharon, et al. Developing management pathways for hypertensive disorders of pregnancy (HDP) in Indonesian primary care: a study protocol. Reproductive Health. 2019;16(1):12. https://doi.org/10.1186/s12978-019-0674-0

  13. National Health and Medical Research Council (NHMRC).1998. A guide to the development, implementation and evaluation of clinical practice guidelines. https://www.nhmrc.gov.au/guidelines-publications/cp30

    Google Scholar 

  14. National Health and Medical Research Council (NHMRC). 2000. How to put the evidence into practice: implementation and dissemination strategies Handbook series on preparing clinical practice guidelines. https://www.nhmrc.gov.au/guidelines-publications/cp71

    Google Scholar 

  15. Campbell H, Hotchkiss R, et al. Integrated care pathways. BMJ. 1998;316(7125):133.

    Article  CAS  Google Scholar 

  16. De Bleser L, Depreitere R, et al. Defining pathways. J Nurs Manag. 2006;14(7):553–63. https://doi.org/10.1111/j.1365-2934.2006.00702.x.

    Article  PubMed  Google Scholar 

  17. Ekawati FM, Emilia O, et al. Opportunities for improving hypertensive disorders of pregnancy (HDP) management in primary care settings: A review of international published guidelines in the context of pregnancy care in Indonesia. Pregnancy Hypertens. 2020;19:195–204. https://doi.org/10.1016/j.preghy.2020.01.012.

    Article  PubMed  Google Scholar 

  18. Ekawati FM, Emilia O, et al. The elephant in the room: an exploratory study of hypertensive disorders of pregnancy (HDP) management in Indonesian primary care settings. BMC Fam Pract. 2020;21(1):242. https://doi.org/10.1186/s12875-020-01303-w.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Ministry of Health Republic Indonesia. Maternal death surveillance guideline (Pedoman surveilans kematian ibu). Series Editor, editor^editors. Jakarta: Ministry of Health Republic Indonesia; 2016. Date. Number of 70 p.https://indonesia.unfpa.org/sites/default/files/pub-pdf/MHH_MDSR_NationalGuidelines_20161222_final.pdf. 12 February 2019

    Google Scholar 

  20. Joint Committee on Reducing Maternal and Neonatal Mortality in Indonesia; Development, and Cooperation; Policy and Global Affairs; National Research Council; Indonesian Academy of Sciences. Reducing maternal and neonatal mortality in Indonesia : saving lives, saving the future: Washington, DC : The National Academies Press; 2013.

  21. World Health Organization (WHO).2014. WHO Handbook for Guideline Development. http://apps.who.int/medicinedocs/documents/s22083en/s22083en.pdf

    Google Scholar 

  22. Minas H, Jorm AF. Where there is no evidence: use of expert consensus methods to fill the evidence gap in low-income countries and cultural minorities. Int J Ment Health Syst. 2010;4(1):33.

    Article  Google Scholar 

  23. Keeney S, McKenna H, et al. The Delphi Technique in Nursing and Health Research. [electronic resource]. Hoboken: Wiley; 2010. p. 1.

    Google Scholar 

  24. Koum J, Acton B. WhatsApp. 2009. updated Joined Facebook since 2014. Available from: https://www.whatsapp.com/about/. Page. Accessed 5 June 2020.

  25. REDcap University of Melbourne. Available from: https://clinicalresearch.mdhs.unimelb.edu.au/about/health-informatics/redcap. Accessed 30 Sept 2018.

  26. Norman G. Likert scales, levels of measurement and the “Laws” of statistics. Adv Health Sci Educ. 2010;15(5):625–32. https://doi.org/10.1007/s10459-010-9222-y.

    Article  Google Scholar 

  27. Dawes J. Do data characteristics change according to the number of scale points used? Int J Mark Res. 2008;50(1):61–77. https://doi.org/10.1177/147078530805000106.

    Article  Google Scholar 

  28. Birko S, Dove ES, et al. Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation. Plos One. 2015;10(8):e0135162. https://doi.org/10.1371/journal.pone.0135162.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. QSR International.2019. Nvivo (software) version 12.2.0 (3262). https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/support-services/nvivo-downloads

    Google Scholar 

  30. Patton MQ. Qualitative research & evaluation methods / Michael Quinn Patton. Thousand Oaks: Sage Publications, c2002. 3rd ed; 2002.

    Google Scholar 

  31. Duncan E, O’Cathain A, et al. Guidance for reporting intervention development studies in health research (GUIDED): an evidence-based consensus study. BMJ Open. 2020;10(4):e033516. https://doi.org/10.1136/bmjopen-2019-033516.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Charlotte E, Warren H, Ismail SM, et al. A primary health care model for managing pre-eclampsia and eclampsia in low-and middle-income countries. Reprod Health. 2020;17(1):1–7.

    Article  Google Scholar 

  33. R. Perez-Cuevas, Fraser, W., et al. Critical pathways for the management of preeclampsia and severe preeclampsia in institutionalised health care settings. BMC Pregnancy Childbirth. 2003;3(no pagination).

  34. Roberge S, Bujold E, et al. Aspirin for the prevention of preterm and term preeclampsia: systematic review and metaanalysis. Am J Obstetr Gynecol. 2018;218(3):287–293. e281.

    Article  CAS  Google Scholar 

  35. Roberge S, Nicolaides K, et al. The role of aspirin dose on the prevention of preeclampsia and fetal growth restriction: systematic review and meta-analysis. Am J Obstetr Gynecol. 2017;216(2):110–120. e116.

    Article  CAS  Google Scholar 

  36. Roberge S, Bujold E, et al. Meta-analysis on the effect of aspirin use for prevention of preeclampsia on placental abruption and antepartum hemorrhage. Am J Obstet Gynecol. 2018;218(5):483–9. https://doi.org/10.1016/j.ajog.2017.12.238.

    Article  CAS  PubMed  Google Scholar 

  37. Matthew K. Hoffman, Goudar, Shivaprasad S, et al. low-dose aspirin for the prevention of preterm delivery in nulliparous women with a singleton pregnancy (ASPIRIN): a randomised, double-blind, placebo-controlled trial. Lancet. 2020;395(10220):285–93.

    Article  Google Scholar 

  38. Michael L. LeFevre. Low-Dose Aspirin Use for the Prevention of Morbidity and Mortality From Preeclampsia: U.S. Preventive Services Task Force Recommendation Statement. Ann Intern Med. 2014;161(11):819–826.https://doi.org/10.7326/m14-1884

  39. Kementerian Kesehatan RI. Keputusan Menteri Kesehatan Republik Indonesia Nomor HK.01.07/MENKES/813/2019 Tentang Formularium Nasional. SeriesEditor, editor^editors.  2019. p. 154. http://hukor.kemkes.go.id/uploads/produk_hukum/KMK_No__HK_01_07-MENKES-813-2019_ttg_Formularium_Nasional.pdf. Accessed 22 Jan 2020.

  40. Kementerian Kesehatan RI. Keputusan Menteri Kesehatan Republik Indonesia Nomor HK.01.07/MENKES/659/2017 Tentang Formularium Nasional. Series Editor, editor^editors. Jakarta: Kementerian Kesehatan; 2017. http://hukor.kemkes.go.id/uploads/produk_hukum/KMK_No._HK_.01_.07-MENKES-659-2017_ttg_Formularium_Nasional_.pdf. Accessed 4 Sept 2019.

  41. The American Congress of Obstetricians and Gynecologists.2013. Hypertension in Pregnancy. https://www.acog.org/~/media/Task%20Force%20and%20Work%20Group%20Reports/public/HypertensioninPregnancy.pdf

    Google Scholar 

  42. World Health Organization. Managing complications in pregnancy and childbirth: a guide for midwives and doctors: World Health Organization; 2017.  https://apps.who.int/iris/bitstream/handle/10665/255760/9789241565493-eng.pdf. Accessed 20 May 2018.

  43. Fitriana Murriya Ekawati, Claramita, Mora, et al. Patients’ experience of using primary care services in the context of Indonesian universal health coverage reforms. Asia Pac Fam Med. 2017;16:4. https://doi.org/10.1186/s12930-017-0034-6

  44. Claramita M, Ekawati FM, et al. Preparatory graduate professional training in general practice by using the'experiential learning'framework. Asia Pac Fam Med. 2018;17(1):4.

    Article  Google Scholar 

  45. Ekawati FM, Claramita M, et al. The Indonesian general practitioners’ perspectives on formal postgraduate training in primary care. Asia Pac Fam Med. 2018;17(1):10.

    Article  Google Scholar 

  46. Jay R Avella. Delphi panels: research design, procedures, advantages, and challenges. Int J Dr Stud. 2016;11(1):305–21.

  47. World Health Organization (WHO). WHO handbook for guideline development: World Health Organization; 2014. https://apps.who.int/iris/handle/10665/145714. Accessed 19 Apr 2018.

  48. Murphy MK. Consensus development methods and their use in clinical guideline development. Health Technol Assess. 1998;2:1–88.

    Google Scholar 

  49. Claramita M, Riskiyana R, et al. Interprofessional communication in a socio-hierarchical culture: development of the TRI-O guide. J Multidiscip Healthc. 2019;12:191–204. https://doi.org/10.2147/JMDH.S196873.

    Article  PubMed  PubMed Central  Google Scholar 

  50. McMillan S, King M, et al. How to use the nominal group and Delphi techniques. Int J Clin Pharm. 2016;38(3):655–62. https://doi.org/10.1007/s11096-016-0257-x.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Vernon W. The Delphi technique: A review. Int J Ther Rehabil. 2009;16(2):69–76. https://doi.org/10.12968/ijtr.2009.16.2.38892.

    Article  Google Scholar 

  52. Bennett LR, Wiweko B, et al. Indonesian infertility patients’ health seeking behaviour and patterns of access to biomedical infertility care: an interviewer administered survey conducted in three clinics. Reprod Health. 2012;9(1):24.

    Article  Google Scholar 

  53. Taylor E. Purvis. Assisted reproduction in Indonesia: policy reform in an Islamic culture and developing nation. Reprod BioMed Online. 2015;31(5):697–705.

    Article  Google Scholar 

  54. Akbar MIA, Bachnas MA, et al. The massive problem of preeclampsia in indonesia: In need of a redesigned national health care system. Pregnancy Hypertens. 2018;13:S16.

    Article  Google Scholar 

  55. Bilano VL, Ota E, et al. Risk Factors of Pre-Eclampsia/Eclampsia and Its Adverse Outcomes in Low- and Middle-Income Countries: A WHO Secondary Analysis. Plos One. 2014;9(3):e91198. https://doi.org/10.1371/journal.pone.0091198.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Abdelaziem A, Ali R, Duria A, et al. Severe anaemia is associated with a higher risk for preeclampsia and poor perinatal outcomes in Kassala hospital, eastern Sudan. BMC Res Notes. 2011;4:311. https://doi.org/10.1186/1756-0500-4-311.

    Article  Google Scholar 

  57. Steketee RW, Nahlen BL, et al. The burden of malaria in pregnancy in malaria-endemic areas. Am J Trop Med Hyg. 2001;64(1_suppl):28–35.

    Article  CAS  Google Scholar 

Download references

Acknowledgments

Survey data in this study were collected and managed using REDCap electronic data capture tools hosted by the University of Melbourne.

Funding

The first author receives a scholarship from Indonesian Endowment Fund for Education from The Indonesian Ministry of Finance. The scholarship provides allowance for her doctoral study, as well as allowance during data collection, analysis and manuscript writing.

Author information

Authors and Affiliations

  1. Department of Family and Community Medicine, Universitas Gadjah Mada, Sleman, Yogyakarta, Indonesia

    Fitriana Murriya Ekawati

  2. Department of General Practice, University of Melbourne, Level 2, 780 Elizabeth Street, Melbourne, Victoria, 3000, Australia

    Fitriana Murriya Ekawati, Jane Gunn & Phyllis Lau

  3. School of Nursing and Midwifery, Monash University, Clayton, Victoria, Australia

    Sharon Licqurish

  4. University of Melbourne Department of Obstetrics and Gynaecology, Royal Women’s Hospital, Parkville, Victoria, Australia

    Shaun Brennecke

  5. Pregnancy Research Centre, Department of Maternal-Fetal Medicine, Royal Women’s Hospital, Parkville, Victoria, Australia

    Shaun Brennecke

Authors
  1. Fitriana Murriya Ekawati
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sharon Licqurish
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jane Gunn
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shaun Brennecke
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Phyllis Lau
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study design and manuscript writings. FE recruited the participants, conducted the study, analysed the data and prepared the first manuscript draft. JG, SB, SL and PL were involved in data analysis and provided significant feedback for the manuscript writing. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Fitriana Murriya Ekawati.

Ethics declarations

Ethics approval and consent to participate

Ethics approval for this study has been obtained from The Human Ethics Sub Committee, The University of Melbourne (Research ID number 1853074.1). All participants provided their written consent to participate via the online survey by clicking the buttons to acknowledge that they have read the project information and e-signing the consent page.

Consent for publication

All participants had provided for their responses to be published in a peer-reviewed journal or conferences.

Competing interests

All authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplementary file 1.

Survey questionnaires. This file contains Microsoft Words/PDF version of questionnaire statements used in the first and second round surveys (online).

Additional file 2: Supplementary file 2.

GUIDED Checklist. This file contains GUIDED checklist used for reporting HDP pathways as the interventions developed in this study for improving HDP management in Indonesian primary care.

Additional file 3: Supplementary file 3.

Statements that had not achieved consensus at the first and second-round survey, and the final agreement scores for each of the statements in the survey. This file contains two tables: Table 1. Statements that had not achieved consensus at the first and second-round survey, and Table 2. Final agreement scores for all statements tested in the survey.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ekawati, F.M., Licqurish, S., Gunn, J. et al. Hypertensive disorders of pregnancy (HDP) management pathways: results of a Delphi survey to contextualise international recommendations for Indonesian primary care settings. BMC Pregnancy Childbirth 21, 269 (2021). https://doi.org/10.1186/s12884-021-03735-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12884-021-03735-3

Keywords

BMC Pregnancy and Childbirth

ISSN: 1471-2393

Contact us