Clinical News

Role of machine learning in the management of epilepsy: a systematic review protocol

January 25, 2024
Articles From The BMJ

STRENGTHS AND LIMITATIONS OF THIS STUDY

  • This protocol proposes a systematic review on the role of machine learning in epilepsy management.

  • The review will follow international recommendations with regard to reporting items, data extraction and quality assessment.

  • Two independent reviewers will select studies, and an experienced adjudicator will resolve any disagreements.

  • The review focuses mainly on the clinical application of machine learning. Selection criteria are aimed at recruiting studies directly related to clinical decision-making in epilepsy management. Papers on technical aspects of machine learning will not be included.

Introduction

The mainstay of epilepsy management is antiseizure medications (ASMs). The prescribing practice of ASMs via a trial-and-error approach has remained unchanged for decades. Although international guidelines recommend the ASM be individualised to each patient,1 2 this could be difficult clinically as there is no accurate biomarker which can reliably predict an individual’s responsiveness to a specific medication.3 Resultingly, the percentage of patients achieving 1-year seizure freedom on their first ASM has remained relatively unchanged over last 30 years, despite the surge of drug options.4 5 For a subset of patients with drug-resistant epilepsy (DRE), epilepsy surgery may offer a chance at seizure freedom. Epilepsy surgery is the most effective management for focal seizure control for surgically amenable patients, with up to two-thirds of patients with drug-resistant temporal lobe epilepsy attaining seizure freedom after surgery.6 However, only a small proportion of people with DRE are referred for a surgical workup and concerningly,7 there may be a long delay before surgical operation is considered.8

Machine learning algorithms have been developed to support clinicians in optimising the pharmacological and surgical management of epilepsy. The novel technique is well suited to supporting clinician decision-making as it can learn directly from data without human instruction and find hidden pattern in variables that humans and statistical methods cannot readily identify.3 This is evidenced by the broad applications of machine learning for epilepsy. Most machine learning is applied to detect and classify seizures, reflected in multiple narrative reviews and systematic reviews.9–13 Similar amounts of reviews exist for machine learning and its utility for epilepsy neuroimaging diagnosis and prognostication.14–17

In contrast, there are minimal reviews detailing the wide-ranging application of machine learning for epilepsy management. A systematic review addressing this gap is pertinent as the studies exploring this topic are heterogeneous and there is no universal framework used when building and assessing the validity of machine learning models.18 Thus, it would be beneficial to compare studies and examine the clinical utility of machine learning and epilepsy management decision-making. There will be a particular focus on the clinical aspect of machine learning and epilepsy because, despite the many machine learning algorithms developed, they rarely become a part of routine clinical care.19 20 However, machine learning shows potential with increased use in epilepsy decision-making as there are instances where it outperforms clinicians.21

Methods and analysis

The objective of the proposed systematic review is to assess the current role of machine learning in the epilepsy management. This protocol has been registered with the International Prospective Register of Systematic Reviews (PROSPERO). The structure of the protocol has been drafted according to the checklist of Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols 2015 statement.22

Four well-established literature databases will be included in the literature search: MEDLINE, Embase, Scopus and Web of Science. They will be searched from inception to May 2023. There will be no limitations regarding publication date or language. Reference lists of each included paper will be manually searched for additional studies.

Search strategy will be formulated according to the population, intervention, control and outcomes framework (table 1). A concept map will be drafted to visually represent our search strategy. The search strategy will incorporate words or phrases selected from a controlled vocabulary, including MeSH of MEDLINE and ENTREE of Embase (please see online supplemental file 1). Also, keyword terms related to both concepts of machine learning and management of epilepsy will be included in the literature search. An academic librarian will be consulted before we finalised our search strategy. Covidence software will be used to manage the review process. Search results from the databases will be inputted into the software to exclude any duplication. Title-abstract screening will be performed independently by two reviewers (RS-kC and SN). Trial screening of 10 randomly selected papers will be attempted to ensure the concordance of the 2 reviewers before commencement of screening. After that, the two reviewers will proceed to full-text screening of the included papers. We will try to obtain the full paper by contacting the authors of papers which do not have full-text publication online. Any disagreement during title-abstract or full-text screens will be discussed by the two reviewers together. All unsettled conflicts will be settled by a senior adjudicator (ZC or EF).

Supplemental material

View this table:
Table 1

Elements of PICO framework and their contents

Inclusion and exclusion criteria

Studies will be selected according to the following criteria:

Inclusion criteria:

  1. Original research including randomised controlled trials, cohort studies and case–control studies. Both prospective and retrospective study designs will be eligible for inclusion.

  2. Human-only studies.

  3. Studies conducted in populations with a clinician-confirmed diagnosis of epilepsy.

  4. Studies focused on clinical decision-making in the management of epilepsy, including:

    1. Prediction of response to ASMs.

    2. Prediction of DRE.

    3. Prediction of epilepsy surgery/neuromodulation outcomes.

    4. Selection of epilepsy surgery/neuromodulation candidates.

  5. Involve patients of any age and demographics.

Exclusion criteria:

  1. Studies on populations with isolated seizures, status epilepticus and psychogenic non-epileptic seizures.

  2. Studies with less than 10 participants.

  3. No clear direct relationship with clinical decision-making in the management of epilepsy.

  4. Studies on diagnosis, classification, comorbidities and prognostication (except surgical outcomes or drug responsiveness) of epilepsy.

  5. Studies on lateralisation or localisation of epileptic focus.

  6. Studies focused on the engineering and technical aspects of electroencephalogram (EEG) (including intracranial EEG and electrocorticogram) which have no direct relation to clinical decision-making in the management of epilepsy. This includes studies on developing machine learning algorithms for seizure and epileptiform discharges detection and epileptic focus localisation. However, studies that evaluated the use of these algorithms to support clinician’s decision-making for patient management will be included.

  7. Studies focused on the engineering and technical aspects of neuroimaging which have no direct relation to clinical decision-making in the management of epilepsy. This includes studies on developing machine learning algorithms for the analysis of structural or functional modalities. However, studies that evaluate the use of these algorithms to support clinician’s decision-making for patient management are eligible for inclusion.

  8. Studies on wearable devices or ECG.

  9. Studies that only employ traditional statistical models instead of machine learning techniques. This includes an explicit description of development, validation and performance metrics of machine learning model.

Data extraction

Reviewers will extract data of the included articles according to the CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies (CHARMS).23 Other specific information about machine learning such as algorithm and validation method, performance metrics such as area under curve, F1-score and accuracy will also be included in the data extraction. We will also extract information on the explainability of the machine learning models described in the included studies.

Risk of bias assessment

Risk of bias assessment will follow the Prediction model Risk Of Bias ASsessment Tool (PROBAST),24 which is a published scheme for the quality assessment of diagnostic and prognostic prediction model studies. It contains 20 signalling questions under 4 domains, namely participants, predictors, outcome and analysis. Any discrepancies regarding the risk of bias will be settled by discussion between the reviewers until a consensus is reached. We will also summarise any methodological problems specific to machine learning such as lack of external validation.

Data synthesis and analysis

Narrative approach will be adopted to summarise the data. Tables or graphs will be constructed to illustrate the characteristics of included articles.

Ethics and dissemination

The current study is a protocol for a systematic review, ethical approval is not required. The study findings will be disseminated via conference presentation and submission to peer-reviewed journal for publication.

Patient and public involvement

No patient and public involvement is applicable to the design, delivery or dissemination of the findings of the proposed systematic review.

Discussion

Previous efforts have been dedicated to summarising the role of machine learning in management of epilepsy. Critical and narrative reviews have been published, but a systematic review is lacking.25 26 A systematic review on using machine learning in predicting outcomes of epilepsy surgery has been reported in abstract form.27 To our best knowledge, our systematic review stands among the first to delve into machine learning’s roles in both pharmacological and non-pharmacological epilepsy management.

Machine learning has been applied to different fields of epilepsy encompassing diagnosis, management and prognostication. Given the expansive array of machine learning applications, our emphasis is directed towards the clinical management of epilepsy. However, even within this constrained scope, we anticipate encountering numerous articles pertaining to technical or engineering aspects of EEG or neuroimaging. Therefore, we have established a relatively stringent inclusion and exclusion criteria. We have performed a preliminary search and tried to triage the results according to our eligibility criteria. We consider our criteria effective in sorting out papers with clinical implications.

With reference to a critical review in this area by our team,25 we focus on four areas including (1) selection of ASMs; (2) prediction of DRE; (3) prediction of epilepsy surgery/neuromodulation outcomes and (4) selection of epilepsy surgery/neuromodulation candidates. These four topics are comprehensive and cover most of the clinical uses of machine learning in epilepsy management. They also encompass the themes of the papers in our preliminary search and will make our review more organised. CHARMS guideline is a tool commonly employed for data extraction in systemic review involving predictive system including machine learning. Essential outcomes specific to the machine learning will be included in the data extraction also.

Machine learning models have been criticised for working as a ‘black box’. Stakeholders often do not understand how the prediction is made. It could become a hurdle in the clinical application of this technique. Efforts have been made to enhance the comprehensibility of the models. Noticeably, explainable artificial intelligence is a new trend.28 We will summarise if the studies have addressed the transparency of their models.

Currently, there are no specific qualitative assessment guidelines for machine learning studies. PROBAST has been widely employed to assess risk of bias and applicability of prediction models such as machine learning.29 There is an ongoing initiative to develop specific reporting guidelines in this field, an example is Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis specific to machine learning (TRIPOD-ML), which is an extension of popular TRIPOD guideline.30

We hope our readers will gain insights into how machine learning could contribute to clinical management of epilepsy.

Ethics statements

Patient consent for publication

This post was originally published on https://bmjopen.bmj.com