STRENGTHS AND LIMITATIONS OF THIS STUDY
-
This study highlights the need for equitable, inclusive and sustainable approaches to guideline development.
-
Recommendations were developed based on consensus from over 400 clinicians, patients and patient representatives.
-
Actioning these recommendations has the potential to improve the transparency and accountability of the guideline development process within the UK Kidney Association.
-
Further research could refine the present consensus statements to try and further explore the variances seen.
Background
The standard for best practice in modern healthcare is based on the ever-expanding body of evidence provided by clinical trials, studies and evidence synthesis.1 2 Treatment pathways across many clinical areas are directed by the creation of clinical practice guidelines (CPGs), intended to reduce variation of care and optimise patient outcomes.3 The area of nephrology is no different, with a myriad of national and international guidelines all designed to help healthcare professionals, commissioners and providers of healthcare and people with kidney disease, their families and carers.4–6 However, the development of CPGs is a complex undertaking, with challenges in selecting areas of review, prioritising their importance, development methodology and implementing the uptake of recommendations into clinical practice.
Many international and national organisations have their own CPG development groups and standards with examples including the WHO, the National Institute for Health and Care Excellence (NICE), the Scottish Intercollegiate Guidelines Network (SIGN) and the Australian National Health and Medical Research Council. There have also been attempts to standardise the CPG development process by the Guidelines International Network (GIN) and the Institute of Medicine (IOM).7 8 Overall, these standards are similar in that they advocate for transparency in the CPG development process, as well as the need for external peer review and stakeholder consultation.7 9 However, the exact stepwise process for each differs, with varying stages and processes. Within nephrology it has similarly been highlighted that guidelines can often lack uniformity; importantly this can have a knock-on effect with the development of robust quality metrics, as one of the key components of metric validity is discordance with the latest evidence.10 Only by producing guidelines that are meaningful to all stakeholders can we then drive meaningful improvements in patient-centred care.
Alongside standards proposed by GIN and IOM, many development and implementation toolkits have been created to measure the strength and quality of CPGs. Internationally recognised models such as Grading of Recommendations Assessment, Development and Evaluation (GRADE) and Appraisal of Guideline Research and Evaluation (AGREE/AGREE II) assist developers in summarising evidence to provide recommendations, and to measure the strength of their recommendations in a structured way.11 12 GRADE standards are currently recommended by WHO, and used by NICE and SIGN.13 14 However, the use of ratification toolkits is not universal and up to 50% of guidelines may be considered unreliable or biased on the basis of having unclear development processes.2
Despite the use of more rigorous development tools, many guidelines are still underused, representing a significant guideline-implementation gap. Evidence suggests that implementation can take up to 17 years and ultimately, only 14% of guideline recommendations are translated into clinical practice.1 As such, some have questioned the effort, relevance and utility of these (often cumbersome) pieces of documentation. However, successful implementation is important, research suggests correct utilisation of NICE guidelines for treating kidney disease has the potential to increase early patient referrals and lower long-term treatment costs.15 16 Research into implementation strategies report similar barriers to guideline uptake, including lack of time, skills, and knowledge, funding issues, complex and impractical guidelines, and resistance to change within the healthcare community.3 14 17 18 However, research does suggest that guidelines can be successfully integrated into clinical practice through the use of multi-faceted approaches to implementation, combining communication, education and practical design strategies.17–21 Limited research in nephrology indicates that educational interventions have helped to improve guideline adherence, physician competence and kidney function in diabetes patients with chronic kidney disease (CKD).22
A key part of CPG development and implementation is engaging stakeholders, including empowering people with long-term conditions like kidney disease to take part in joint decision-making processes.2 23 24 Previous barriers to this have been identified, including lack of understanding in how to incorporate the views of those living with kidney disease into guidelines, and how to effectively communicate with, and educate, people living with kidney disease.14 25 GIN has recently developed a toolkit to help developers engage with the public and patients and to try and overcome some of these barriers.23 In line with this, many now see the inclusion of patient and carer contributions as a fundamental part of the legitimacy and transparency of CPGs.13 18 24 26 It has also been suggested that patient input into CPG development will help improve the impact of guidelines and encourage their use.25
Due to the lack of standardised methods to develop CPGs, and the variability with which they are implemented, this research was undertaken on behalf of the UK Kidney Association (UKKA) Clinical Practice Guidelines Committee with the aim to ascertain how pertinent topics in kidney care within the UK should be chosen, prioritised, designed and implemented. The research was designed using a modified Delphi method in order to gather consensus from healthcare practitioners (HCPs) across multiple clinical specialties in primary and secondary care who have input into the management of people with CKD, as well as those people living with CKD, to ensure a breadth of stakeholder opinions were heard.
Methods
The study was conducted using a modified Delphi methodology (see online supplemental figure A.1), overseen by an independent facilitator (Triducive Partners) and is reported in accordance with the ACCORD guidelines.27 Initially, a scoping meeting was conducted in October 2022 between the UKKA Clinical Practice Guidelines Committee and the independent facilitator to agree the aims and scope of the project and discuss potential steering group members. A multi-professional panel of experts in renal healthcare (the study authors) from across the UK were selected on account of their leadership in UK societies, clinical expertise and standing as patient representatives. The group was invited by the UKKA Clinical Practice Guidelines Committee via email. Nine individuals agreed to participate, this number was chosen to ensure the accuracy and reliability of the study by representing all stakeholders without overcomplicating the process.28
Supplemental material
During round 1, the group convened in January 2023 to discuss challenges in designing and implementing UKKA guidelines, using the nominal group technique. In this session, the panel created a list of problem areas which need to be addressed within guideline development. The panel discussed these areas and consolidated them into a final list covering:
-
Value of guidelines to healthcare professionals.
-
Value of guidelines to kidney patients.
-
Selecting areas of focus for future UKKA guidelines.
-
Design of future UKKA guidelines.
-
Implementing future UKKA guidelines.
Following the agreement of these domains, the group discussed each area in detail and created a series of 42 draft consensus statements. These were then reviewed anonymously and independently by the panel. This was collated by the independent facilitator. Based on feedback, eight statements were deleted, eight were edited and one new statement was added. The amended statements were then ratified independently and anonymously by the group. This process involved qualitative feedback and comprised round 2 of the process.
The finalised 35 statements provided the basis of a consensus survey, which constituted round 3 of the process. Two separate surveys were created and distributed across the UK. One survey, including all 35 statements, was sent to healthcare professionals in primary and secondary care with any involvement in treating people with kidney disease (not limited to the renal healthcare community). The survey was then streamlined to contain only the most patient relevant statements (n=20), before being sent to patients and patient representatives. This survey was designed to collect quantitative opinion data, as is standard for the Delphi process.29
In both surveys, each statement was presented alongside a 4-point Likert scale (‘strongly agree’, ‘tend to agree’, ‘tend to disagree‘ and ‘strongly disagree’) to allow respondents to indicate their level of agreement. While the survey was anonymous, some demographic data was captured for further analyses (role of the respondent, location within the UK and years of experience). The minimum consensus level was set at ≥75%, a widely accepted threshold,30 with a further category of ‘very high agreement’ at ≥90%. Instead of aiming for a set response rate, the panel agreed to minimum stopping criteria for the survey. A minimum threshold of 400 responses (distributed between secondary care doctors, general practitioners (GPs), nurses, dietitians and other allied healthcare professionals) was set. The survey was distributed by the steering group to colleagues, professional and patient societies, and through social media. Respondents were anonymous to the steering group and did not receive incentives for participation.
Completed surveys were anonymously collated and analysed by the independent facilitator to produce an agreement score for each statement, this was calculated by adding the percentage of respondents who agreed or strongly agreed with each statement. This information was then evaluated and discussed by the expert panel in a second group meeting (June 2023, round 4). Analysis was undertaken by the facilitator to assess whether there were differences between respondents by role, experience or location, which was also validated by the expert panel. As the stopping criteria were fulfilled, the group used the results to select key statements from each topic. These provided the basis for draft study recommendations. Following the meeting these were independently and anonymously reviewed and ratified by the group.
Patient and public involvement
International guideline standards include patient and public involvement as a core principle for developing high-quality evidence-based CPGs.31 As such, this study was designed to include patient representation at each stage, including the steering panel who co-designed a modified questionnaire for patient respondents and their representatives. Wide distribution of the survey (and the results) was ensured using patient and charity networks.
Results
The questionnaire was undertaken by 419 respondents, comprised 364 HCPs and 55 patients and patient representatives. Participants came from across the UK with representation from England, Northern Ireland, Scotland and Wales. Respondents by role are shown in figure 1. HCPs were also asked to provide how long they had been in role. The majority (n=123) had over 20 years of clinical experience, followed by 11–20 years of experience (n=109). Only 55 respondents had less than 5 years of experience.
Consensus among HCP respondents was high (figure 2), with 28/35 (80%) statements achieving over ≥90% consensus, and 4/35 (11%) reaching between <90% and ≥75% consensus. Only three statements (9%) did not reach the 75% consensus threshold. Among patients and patient representatives, agreement was also high (figure 2), with all statements reaching the consensus threshold. Of the statements presented to this group, 13/20 (65%) achieved ≥90% consensus, 7/20 reached between<90% and ≥75% consensus.
The results were further analysed by subgroup. There were some variations in the consensus levels for statements between HCPs based on their role, years in role and region (online supplemental figures A.2–A.4). Consensus levels were more consistent when analysed by years of professional experience. However, the only statements to consistently vary from the mean by >10% across role and region were statements 5, 6 and 26. These were also the only statements not to achieve consensus. Among the patient group, differences were noted for two statements (9 and 13), however variation arose due to lower agreement from carers (n=3) and so may not be representative.
Each of the statements and their individual consensus levels are presented in table 1. The consensus score distribution across the 4-point Likert scale is shown in figure 3A,B.
Discussion
Value of UKKA guidelines
Across the responses from HCPs there was very high agreement on the importance and utility of guidelines (statements 1–4, 7–11, ≥86%). Responses to statement 4 (99%) also highlight that, while national guidelines are essential, there needs to be capacity for local variations in practice. This is supported by research into CPG implementation, which has found that flexibility and autonomy are key to encouraging HCPs to change their behaviour.18
In the past, the UKKA has produced ‘commentaries’ on guideline documents from other specialist societies (eg, Kidney Disease: Improving Global Outcomes) with specific advice on how these relate to UK practice or require specific considerations around their implementation. Responses to statement 5 (61%) and 6 (59%) (suggesting the UKKA should not provide commentaries and that they are less useful than guidelines) did not reach the consensus threshold. This suggests UKKA commentaries on national and international guidelines, along with recommendations for UK implementation, may be an important addition. Figure 3A,B shows a central tendency bias for these statements, with the majority of responses being ‘tend to agree’ and ‘tend to disagree’. A lack of strong opinion on these statements could mean some respondents were unsure of how to respond, particularly as there was no definition provided for what constituted a UKKA ‘commentary’. However, the literature repeatedly finds improving CPG visibility through promotion, education and short communications can help to increase their implementation.3 7 19 26 Therefore, commentaries created by the UKKA could help encourage adoption of new CPGs by simplifying and clarifying their recommendations. Further, where commentaries cover international guidelines, they can give a discussion and interpretation relevant to the UK context.
Patient responses also showed strong consensus on the importance of guidelines, particularly documents which are jargon-free, and person centred. Survey results, alongside input from the lay representative, clearly show that people with kidney disease feel empowered when they have access to resources which they can read and process in their own time outside of appointments. The availability of such person-centred guidelines will help patients to make more informed decisions and potentially lead to improved health communication between patients and their healthcare providers.24 25 The lay representative also highlighted that people with long-term conditions want reputable information, sourced from the same sites accessed by HCPs, which is reflected in statement 8 (HCPs 98%, patients 95%). A strength of the UKKA guidance is that all documents can be found in a single site and are accessible to people with CKD and HCPs. This is something that will need to continue with future guidelines to ensure these documents remain accessible.
UKKA guideline selection and design
Following on from aspects of accessibility highlighted in topics A and B, responses to statements in topics C and D emphasised a need for engagement and user-friendliness. Statements 12 (93%) and 13 (91% HCPs, 87% patients) show there is a need to include a variety of stakeholders when selecting potential topics for guidelines, a view strongly supported within the literature.23–25 This is reinforced by the agreement to statements 15–18 (≥92%), showing respondents believe a multi-professional approach should be taken to identifying and prioritising guideline topics. While it has been acknowledged that cross specialty CPGs can be difficult to develop,32 33 a lack of consideration for comorbidities or age (as a proxy for comorbidity) limits the applicability of CPGs.34
When considering the design of future guidelines, statements 14 (98% HCPs, 91% patients) and 20 (88% HCPs, 84% patients) demonstrate the overarching need for guidance to be simple, equitable and indiscriminate. On the basis of this, it is suggested that not only will the UKKA make all guidelines available, but also have a section of their website where all HCPs and people with CKD can suggest topics for future guidelines, as seen in recommendations by Blackwood et al.25 Following this, it is clear there will be a need to prioritise the development of guidelines. The process of this will need to be both rigorous and transparent. Therefore, it is suggested that a ‘RAG’ (red, amber, green traffic light) system is used to standardise the process by which guideline development is prioritised.
The literature states that CPGs are crucial as they provide management pathways and treatments based on evidence.1 2 Currently there is a reliance on clinical trials to provide this evidence base.35 However, trials may not be available, or even necessary, to back every recommendation. It has been argued that other forms of evidence should be seen as valid when compiling data for guidelines.26 35 The current research found strong support (statement 25; 92% HCPs, 80% patients) for the use of consensus-based evidence within guidelines. Banno et al have also argued for the value of consensus-based evidence, underlining the need for more Delphi studies to provide clear, documented consensus on the content of guidelines. There needs to be an element of caution here however, consensus based guidelines can generate inappropriately strong recommendations compared with evidence based guidelines and so it is important to ensure appropriate alignment of quality of evidence with strength of recommendations.36 Wider use of such practice would ensure the quality of guidelines, and allow for more inclusive guideline design, by assimilating patient input with clinical data and HCP recommended treatment pathways.37
Consensus with statements 22 (93%) and 23 (98%) show that HCPs are keen to take a multi-disciplinary approach to guideline development. The need for alignment across professional guidelines is further reinforced by consensus with statement 30 (98%). As discussed, developing cross specialty CPGs can be complex, hindered by lack of time, resources and standard CPG development methodologies.32 33 To ensure that future UKKA guidelines reflect the results of the current research, it is evident that the UKKA’s standards for guideline development will need to be updated to reflect this multi-stakeholder approach. When developing future guidelines, the UKKA will need to reach out to other societies and professional bodies for input, strengthening cross-discipline ties and communication. Collaboration across disciplines must be seen as pivotal, and the focus should be on how working together can create more broadly applicable, practical guidelines, by pooling knowledge and resources.32 We believe that this approach could be a roadmap for optimised clinical management across medical specialties in the UK.
As set out in the Climate Change Act (2008), the UK National Health Service (NHS) has made a commitment to halve greenhouse gas emissions by 2025 and reach net zero by 2050. Within the NHS, the provision of kidney care is a carbon intensive specialty when considered in terms of the numbers of patients treated with renal replacement therapy.38 The strong consensus with statement 24 (92%) shows the commitment to this agenda, to pay particular attention within guidelines to inform carbon-reduction strategies that live up to the UKKA sustainability agenda; to meet or exceed NHS carbon net zero goals and, the ambition to reduce waste to landfill or incineration by 80%.
Implementing future UKKA guidelines
The UKKA is committed to reinforcing an agile approach to implementing and updating their guidelines. Although it is positive to see from the HCP response to statement 26 (‘guidelines are difficult to implement’; 49%) that many respondents believe guidelines are not difficult to implement, it still does mean that near enough half of the responders feel that guideline implementation can be challenging. There was no difference seen in the agreement levels across experience or geographic region. While literature around guideline implementation highlights potential areas where translating recommendations into practice can fail, it is heartening to see that within nephrology negative beliefs in guideline implementation may not be the central issue. However, it will still be necessary to prepare for other potential implementation pitfalls in the future. In order to address the needs of all HCPs and patients the use of a multi-faceted implementation approach (eg, easy to use and practical guidelines, combined with promotion, education, monitoring) is recommended.13 17 18 20
Consensus with statements 28 (HCPs 93%, patients 91%) and 29 (93%) show there is a need for guidelines to be practical and of use for both HCPs and patients, particularly within consultations. A more efficient structure to guidelines, including a jargon-free summary, could help make guidance more accessible to all audiences. When taken alongside the need for simplicity, it could be suggested that the ideal guideline is delivered in two ways:
-
A central guideline designed to educate and support HCPs and people with CKD by providing focused descriptions of healthcare issues and the evidence base for treatments, alongside concise, actionable recommendations.
-
A supplementary document with technical details, which enriches the information and evidence provided in the main guideline.
Further to this, promotion of new guidelines could be encouraged by creating a calendar of guideline release dates, as supported by consensus with statement 34 (98%). This approach will keep stakeholders abreast of developments and ensure transparency and accountability in the development process.
Recommendations
Based on the levels of consensus seen within this study, the steering group were keen that the UKKA’s process for creating guidelines should be updated in response to the results of this work. As such the steering group posed the following recommendations:
-
A more equitable approach to proposing guideline topics should be adopted, allowing input from HCPs, patients and their representatives.
-
UK commentaries on international guidelines that outline regional applicability and more focused implementation are as valued as full UK guidelines.
-
All guidance should focus on the end user, with simple and appropriate language to ensure accessibility for HCPs and people with CKD, and encourage engagement.
-
Standardised, multi-faceted implementation techniques or ‘practice points’ to maximise the uptake of their recommendations into clinical practice should be developed and included.
-
Connections across disciplines should be fostered, not only to ensure a multi-disciplinary approach to their guideline development but ensure perspectives from nephrology are considered in CPGs created by other professional bodies.
-
Guideline groups should outline strategies to address the sustainability agenda, wherever possible.
Study strengths and limitations
The large number of experienced specialists that responded to the consensus questionnaire lends weight to the validity of the recommendations proposed by the steering group. The presence of patients and their representatives in the research, through the steering group and questionnaire respondents, increases the inclusivity and applicability of these findings. It highlights the opinions of these individuals and emphasises the need to acknowledge and act on them throughout guideline development. Responses were sought from both HCPs and patients across the UK in an attempt to reduce geographic bias. While some areas had fewer respondents (eg, Northern Ireland), overall, there was good representation across the UK. The survey was distributed by the steering group, however, data was collected and analysed anonymously by a third party, helping to limit bias.
The 4-point Likert scale was used so respondents had no ‘neither agree or disagree’ option and had to form an opinion on each statement. However, as discussed, some statements did show a central tendency bias, which could have been due to the language used within the statements. As this study only undertook one round of survey with no adjustments to the statements, it is possible that some of the statements were too agreeable and did not sufficiently challenge the status quo. Further research on this in this area should refine the statements generated herein to determine any greater variance that may exist.
Conclusions
This research explored the views of HCPs, patients and patient representatives on the best practice for selecting, designing and implementing CPGs from the UKKA. Based on the levels of consensus seen across respondents, the steering group were able to develop a strong set of recommendations. Successful implementation of guidelines within nephrology has been shown to improve patient outcomes22 and is theorised to have long-term cost-effectiveness benefits.15 16 Actioning the suggested recommendations has the potential to improve the transparency and accountability of the guideline development process within the UKKA, as well as making UKKA CPG documentation more accessible and understandable for all stakeholders. This in the long-term, can only benefit clinical practice and patient outcomes within UK kidney care.
Data availability statement
Data are available upon reasonable request.
Ethics statements
Patient consent for publication
Ethics approval
Ethical approval was not required due to the design of the study, using a completely anonymous survey approach. A statement of consent was included in the survey; consent was implied by completion and submission of responses. There was no collection of personal data nor implementation within the National Health Service structure.
Acknowledgments
All authors have undertaken this work on behalf of the UKKA guideline committee and report no conflicts of interest. The UKKA would like to thank Tim Warren, Dal Singh and Dr Katie Larner for facilitating this project and drafting the current manuscript.
This post was originally published on https://bmjopen.bmj.com