Article Text
PDF
Abstract
Objectives Motor neuron disease (MND) is an incurable progressive neurodegenerative disease with limited treatment options. There is a pressing need for innovation in identifying therapies to take to clinical trial. Here, we detail a systematic and structured evidence-based approach to inform consensus decision making to select the first two drugs for evaluation in Motor Neuron Disease-Systematic Multi-arm Adaptive Randomised Trial (MND-SMART: NCT04302870), an adaptive platform trial. We aim to identify and prioritise candidate drugs which have the best available evidence for efficacy, acceptable safety profiles and are feasible for evaluation within the trial protocol.
Methods We conducted a two-stage systematic review to identify potential neuroprotective interventions. First, we reviewed clinical studies in MND, Alzheimer’s disease, Huntington’s disease, Parkinson’s disease and multiple sclerosis, identifying drugs described in at least one MND publication or publications in two or more other diseases. We scored and ranked drugs using a metric evaluating safety, efficacy, study size and study quality. In stage two, we reviewed efficacy of drugs in MND animal models, multicellular eukaryotic models and human induced pluripotent stem cell (iPSC) studies. An expert panel reviewed candidate drugs over two shortlisting rounds and a final selection round, considering the systematic review findings, late breaking evidence, mechanistic plausibility, safety, tolerability and feasibility of evaluation in MND-SMART.
Results From the clinical review, we identified 595 interventions. 66 drugs met our drug/disease logic. Of these, 22 drugs with supportive clinical and preclinical evidence were shortlisted at round 1. Seven drugs proceeded to round 2. The panel reached a consensus to evaluate memantine and trazodone as the first two arms of MND-SMART.
Discussion For future drug selection, we will incorporate automation tools, text-mining and machine learning techniques to the systematic reviews and consider data generated from other domains, including high-throughput phenotypic screening of human iPSCs.
- Clinical trials
- Motor neurone disease
- Adult neurology
- NEUROLOGY
- THERAPEUTICS
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.
Statistics from Altmetric.com
STRENGTHS AND LIMITATIONS OF THIS STUDY
We describe a systematic, structured and evidence-based, consensus approach for drug repurposing in motor neuron disease (MND), specifically for Motor Neuron Disease – Systematic Multi-arm Adaptive Randomised Trial, a phase III multi-arm multi-stage adaptive clinical trial in MND.
Systematic reviews of clinical studies in neurodegenerative diseases and MND preclinical studies provide a robust evidence base to inform expert panel decisions on drug selection for clinical trial.
Providing a contemporary evidence base using traditional systematic reviews is challenging given their time-consuming and labour-intensive nature.
Incorporation of machine learning and automation tools for systematic reviews, and data from experimental drug screening can be helpful for future drug selection.
Introduction
Motor neuron disease (MND), also known as amyotrophic lateral sclerosis (ALS), is a progressive neurodegenerative disease with a median survival of 2–3 years.1 Despite many promising preclinical studies and 125 phase II and phase III trials reported between 2008 and 2019, riluzole remains the only globally approved disease-modifying treatment, prolonging survival by an average of 2–3 months.2 Edavarone, masitinib, AMX0035 (sodium phenylbutyrate and taursodeoxycholic acid) and tofersen have emerged as potentially promising candidates in clinical trials, but treatment effects are modest and none of these drugs have received approval in Europe.3–7 In a long-term multi-centre prospective cohort study, edaravone showed no significant disease-modifying effect.8 Previously, decisions to evaluate drugs in MND have been informed by preclinical studies, typically using mouse models, such as the SOD1G93A mouse, despite known limitations in the extent to which such models recapitulate human pathology,9 and concerns of the reproducibility of findings from such models.10 Clinical trials in MND are further complicated by the challenges of designing and delivering trials in a rapidly progressive, heterogeneous, disabling and fatal disease with a lack of reliable and sensitive outcome measures or biomarkers.2
Over the same period there have, however, been rapid technical advances in MND genomics, human induced pluripotent stem cells (iPSCs) and gene-editing, which have enabled better understanding of underlying pathophysiology (including potential shared pathways across neurodegenerative diseases), and the development of more sophisticated disease models. In parallel, drug repurposing (testing a drug already used or tested for other indications) has been successfully adopted in many diseases and can significantly reduce development time and cost, with the added benefit of the availability of prior safety data to guide selection.11 In relapsing-remitting multiple sclerosis (MS), for instance, dimethyl fumarate, cladribine,12 alemtuzumab13 14 and rituximab15 provide examples of successful repurposing as disease-modifying treatments.
Systematic review has been recommended to have a key role in planning new research studies.16 We previously used a strategy based on systematic review to identify repurposed interventions for secondary progressive MS. This involved a two-stage systematic review and meta-analysis assessing clinical and preclinical data to identify putative therapeutic interventions17 and led to the Multiple Sclerosis-Secondary Progressive Multi-Arm Randomisation Trial (MS-SMART), a phase IIb multi-arm randomised controlled trial.18 19 The three drugs selected for MS-SMART were based in part on their availability for investigator-led clinical trials and did not show efficacy, but two of the top seven drugs thus identified, ibudilast (ranked first), and lipoic acid, have since shown promise in phase II studies in secondary progressive MS.20 21
Noting similarities between MS and MND as neurodegenerative diseases with limited treatment options, in 2014 we embarked on a similar strategy to identify candidate oral neuroprotective agents in MND. In parallel, we developed the multi-arm multi-stage Motor Neuron Disease-Systematic Multi-Arm Adaptive Randomised Trial (MND-SMART, clinicaltrials.gov registration number: NCT04302870) to provide a more efficient pipeline to evaluate drugs in MND than conventional standalone two-arm trials.22–24 Here, we describe the development and implementation of a systematic, structured and unbiased evidence-based approach to inform expert consensus in the selection of potential oral neuroprotective agents for clinical evaluation in MND-SMART. Specifically, the purpose here is not to provide a contemporary summary of existing evidence, but to describe the process through which clinical trial drugs were selected.
Methods
The work was guided by a systematic review protocol. Over the duration of the project and given the novelty of this approach, this protocol was updated in the light of accumulating experience, and the complete record of the protocol, including the changes made, is available at Open Science Framework.25
Overview
The overall drug selection strategy is characterised in figure 1. We used systematic review to identify publications describing clinical trials or reports of the clinical use of drugs in MND and in four other neurodegenerative diseases which we considered might share pivotal pathways: Alzheimer’s disease (AD), Parkinson’s disease (PD), Huntington’s disease (HD) and MS. For MS, we excluded studies of relapsing-remitting disease since we were interested in drugs tested in the progressive phase where neurodegeneration is a major feature. We also excluded studies of other diseases of motor neurons including Kennedy’s disease and spinal muscle atrophy. We annotated publications for the drugs tested and diseases studied, taking forward drugs described in at least one MND publication or in publications in at least two other diseases. We scored each drug using a predefined framework evaluating efficacy, safety, study size and quality. In parallel, we performed a systematic review of the preclinical MND and frontotemporal dementia (FTD; because of pathological overlap with MND) literature for these drugs. We summarised evidence from both reviews for each drug and presented these to an expert panel consisting of clinical and academic neurologists with expertise in MND, clinical trials, pharmacology and preclinical models of MND.
Diagram illustrating two-stage systematic review approach to inform identification and selection of putative treatments to take forward to clinical trial. MND, motor neuron disease.
Systematic review of clinical evidence
The MS-SMART drug selection process used the same strategy, except we selected drugs tested at least once in MS or in at least two other conditions. The protocol for and results from this search, conducted in September 2011, has been published.17 That search involved three online databases (PubMed, ISI Web of Knowledge and EMBASE) using the terms “multiple sclerosis” OR “Alzheimer’s disease” OR “Huntington’s disease” OR “Parkinson’s disease” OR “motor neuron disease” OR “amyotrophic lateral sclerosis”. On 13 December 2013, we updated the search using the same terms but with limitations for PubMed to clinical trials, and date of record creation after 01/07/2011; for ISI Web of Knowledge to Document type ‘Clinical trial’ and publication years: 2011, 2012 and 2013; for EMBASE: previous search string AND (“case series” or “case report” or “cohort study”), with limits: human studies, full text studies from 2011; and we also contacted the Cochrane Neuromuscular review group to obtain a list of interventions tested in MND/ALS. The protocol of this update was stored locally; in the light of increasing recognition of the importance of making systematic review protocols available, the protocol was published without amendment in September 2019.26
Two reviewers (MM and KE) independently screened title and abstracts of publications identified in the new search against the inclusion and exclusion criteria (box 1) with discrepancies resolved by discussion. We included case reports, uncontrolled case series, non-randomised parallel group studies, crossover studies and randomised controlled trials with any report of safety or efficacy. We extracted basic information from each publication including author, year of publication, intervention tested and disease.
Eligibility criteria for clinical systematic review
Inclusion criteria
Publications reporting qualitative or quantitative data provided on either safety or efficacy of an orally delivered intervention in people with motor neuron disease (MND)/amyotrophic lateral sclerosis, Alzheimer’s disease, Parkinson’s disease, Huntington’s disease or multiple sclerosis (MS).
Studies reporting change in clinical status (including death, tracheostomy free survival, relapse frequency, disability progression, behavioural symptoms), or changes in biomarkers (including MRI, blood, cerebrospinal fluid and muscle strength).
Exclusion criteria
Isolated reporting of non-pharmacological interventions such as acupuncture, aromatherapy, physiotherapy or exercise.
Articles reporting the use of interventions already licensed for clinical use in MND such as riluzole.
Articles on levodopa treatment for Parkinson’s disease.
Studies reporting different modes of intervention delivery other than oral administration.
Publications reporting secondary analysis of previously published clinical trial data.
Protocols for clinical trials.
Preventative studies.
Reviews.
Studies on healthy volunteers.
Studies in patients with relapsing-remitting MS.
Studies reporting combination treatments including where an oral and a non-oral intervention are administered.
Publications where disease type is not specified to be in keeping with the included diseases (studies of vascular dementia, mild cognitive impairment and dementias other than Alzheimer’s disease are excluded.
Studies on patients with parkinsonism are excluded as this do not imply Parkinson’s disease exclusively).
Publications describing studies where multiple drugs were tested in a cohort without any data on individual drugs.
For all candidate interventions which had not been excluded based on feasibility or plausibility, we extracted further information on safety, efficacy, quality of study and study size from publications to a Microsoft Access database and scored these against a predefined metric (box 2 and table 1). For each drug, we calculated an overall drug score by taking the product of the mean score in each domain for safety, efficacy, quality, study size and multiplying this by log10(1+number of publications). We then ranked drugs according to these scores.
Scoring metric for clinical review
Safety score (S)
‘Not described’: 1 point.
‘SUSARs (suspected unexpected serious adverse reactions) or mortality observed’: 1 point.
‘SAEs (serious adverse events) only’: 2 points.
‘AEs (adverse events) only’: 3 points.
‘No adverse effects reported’: 4 points.
Efficacy score (E)
Efficacy score is assigned based on primary outcome measure, and where this is not identified, on the mean efficacy score for all outcomes reported in each publication.
‘Not presented’: 1 point.
‘Definite (ie, statistically significant) worsening’: 1 point.
‘Neutral’: 2 points.
‘Non-significant improvement’: 3 points.
‘Significant improvement’: 4 points.
Quality score (Q)
Study quality was assessed using a combination of criteria taken from a risk of bias tool developed through a Delphi process, GRADE and CAMARADES methods as shown in table 1. Once each publication has been scored they are sorted in quartiles of study quality based on the total number of checklist items scored, with the lowest quartile scoring 1one point and the highest quartile scoring 4 points.
Study size score (SS)
‘1–10 participants’: 1 point.
‘11–100 participants’: 2 points.
‘101–1000 participants’: 3 points.
‘>1000 participants’: 4 points.
Scoring method for evaluation of study quality in clinical systematic review
Summary of preclinical studies evaluating the effect of interventions longlisted from the clinical review on survival outcomes
Systematic review of preclinical evidence
In parallel, we performed a systematic review of the preclinical literature (date of search 6 April 2016), focussing on publications describing the candidate interventions which had not been excluded on the basis of feasibility or plausibility, and using our previously published systematic review protocol.27 We evaluated data from all in vivo models of MND and FTD including (1) mammalian models (mouse and rat), (2) organisms with a central nervous system (Drosophila, Caenorhabditis elegans and Zebrafish) and (3) multicellular eukaryotic models such as yeast. We also include data from studies using human iPSCs derived from people with MND.
Patient and public involvement
The MND-SMART group has consulted people with MND, their families and carers via a patient and public involvement advisory group throughout the development of the trial. They expressed enthusiasm for a study design that enables definitive testing of drugs with promising efficacy, broad inclusion criteria and design features which minimise participant burden including remote study assessments, non-invasive outcome measures, liquid medication that can be administered in more advanced stages of disease, and drugs with favourable safety and tolerability profiles. This was taken into consideration by the expert panel during the drug selection process.
Shortlisting of drugs
Drugs with supportive evidence from both clinical and preclinical literature were shortlisted for review by an expert panel over two shortlisting rounds and a final selection round. Over the two shortlisting rounds, the panel rated drugs as ‘green’ (most favourable), ‘amber’ (less favourable) and ‘red’ (least favourable) based on biological plausibility; safety profile; and data from the clinical and preclinical reviews, and logistical considerations relating to factors including drug manufacturing, storage, dosing schedule and route of administration. Drugs rated ‘red’ for any criteria were excluded, along with drugs which had been tested in more than three previous trials in MND. Remaining drugs after the second shortlisting round entered a final selection round. We hand searched literature to identify and summarise all MND clinical trials for shortlisted drugs, including trials which may have been missed in the original search, trials which were annotated using drug synonyms in the original review (eg, acetylcysteine/acetylcystine/N-acetyl cystine/N-acetylcysteine for N-acetyl cysteine), and trials which have been excluded in the clinical review but contain relevant data for expert panel discussions, such as drugs given in combination with other treatments or drugs given in non-oral formulations. We presented the expert panel with clinical, preclinical and clinical trial summaries for the final shortlisted drugs. Members of the expert panel independently ranked shortlisted drugs. The expert panel then met to finalise selection of drugs for clinical trial. As this approach might not cover novel drugs or pathways that had yet to be tested clinically in neurodegenerative diseases, the panel were given flexibility to consider emerging evidence for hitherto unconsidered drugs.
Results
Clinical systematic review and initial screening of candidate interventions
The Preferred Reporting Items for Systematic Reviews and Meta-Analyses diagram for the clinical review is shown in figure 2. Further data are available in online supplemental file 1. Literature search in August 2011 of PubMed, ISI Web of knowledge and EMBASE, and Cochrane list of clinical trials in MS for MS-SMART identified 29 500 publications. Twelve thousand eight hundred and ninety-three duplicates were removed and 15 232 publications did not meet the inclusion criteria. One thousand three hundred and seventy-five publications were included in this initial search.
Supplemental material
Preferred Reporting Items for Systematic Reviews and Meta-Analyses diagram for clinical systematic review. MND, motor neuron disease; MS-SMART, Multiple Sclerosis-Secondary Progressive Multi-Arm Randomisation Trial; Ti/Ab, title/abstract.
In the updated search in December 2013 a further 3124 publications were identified from PubMed, ISI Web of Knowledge, EMBASE and Cochrane databases. Five hundred and forty-one duplicates were removed, and 2322 publications did not meet the inclusion criteria. Two hundred and sixty-one publications were included.
Based on information contained in the title and abstract of these 1636 included publications we identified 595 interventions, of which 139 met our criteria of being described in at least one MND publication or in publications in two other diseases, in a total of 884 publications. On full text screening, 266 of these 884 publications did not meet our inclusion criteria. A further 50 interventions described in 90 publications were excluded because more detailed review of the primary literature at full text screening showed that the intervention has not been tested either in MND or in at least two of the other diseases. The remaining 66 interventions (528 publications) were scored against our predefined criteria and ranked (table 2). During preparation of this manuscript, we discovered that a publication describing the effect of N-acetyl cysteine in MND had been included in error, as no data were available for N-acetyl cysteine monotherapy.28
Longlisted interventions ranked by drug score from clinical review
Preclinical systematic review
We identified 14 195 publications. After removing duplicates, two independent researchers screened title and abstract of 7586 unique publications, with differences reconciled by a third reviewer. 396 studies were included. Three hundred and thirty studies reported survival outcomes. Three hundred and thirteen studies reported behavioural outcomes. Of the 66 longlisted interventions from the clinical review, there were preclinical survival data for 20 drugs (table 3) and behavioural outcome data for 12 drugs.29 Further data are available in online supplemental file 2.
Supplemental material
Shortlisted candidate drugs for clinical trial
Twenty-one drugs with supportive evidence in both clinical and preclinical systematic reviews were shortlisted for further evaluation. Simvastatin was added to the shortlist based on data from the clinical review and emerging data on its potential role in pathways of interest. Nuclear factor erythroid 2-related factor 2 (NRF2) is a transcription factor which controls expression and regulation of antioxidant proteins.30 Modulating NRF2 may therefore protect against oxidative stress, a common feature across neurodegenerative diseases including MND.30 A separate systematic review of interventions modulating NRF2 pathway in animal in vivo models of neurodegeneration and neuronal injury highlighted statins as a candidate drug targeting NRF2.29 31 A clinical trial in AD demonstrated reduction of cerebrospinal fluid cholesterol level by simvastatin, thus demonstrating blood brain barrier penetrance, while providing supportive evidence that simvastatin may play a role in altering lipid biosynthesis, which may in turn inhibit protein misfolding and stress response mechanisms in MND.32
An evidence summary was compiled for each of the 22 shortlisted drugs including the following information: (1) if they had been tested in three or more in vivo MND studies, (2) the number of clinical trials in people with MND, (3) the putative target pathway, (4) feasibility for delivery via enteral tube (noting that swallowing is commonly affected in MND), (5) detailed safety information including common side effects, rare but serious side effects and requirements for monitoring, (6) published clinical studies in MND and (7) clinical trials registered on clinicaltrials.gov. The expert panel met on 9 January 2017 and discussed the evidence for each drug. Eleven drugs were excluded in the first round. Following a second round of discussions, four other drugs were excluded based on aggregate judgement of data presented. Reasons for exclusion are detailed in table 4.
Drugs excluded following expert panel review and reasons for exclusion
The seven candidate drugs remaining were memantine, acetyl-l-carnitine, simvastatin, ciclosporin, melatonin, fluoxetine and N-acetyl cysteine. The clinical review data for each final shortlisted drug are summarised in table 5. MND clinical trials for shortlisted drugs including additional trials identified on handsearching are summarised in table 6.
Clinical systematic review data for the final shortlisted drugs: number of publications (including interventional and observational studies) and participants according to type of disease
Summary of previous motor neuron disease clinical trials for final shortlisted drugs
On 30 January 2017, members of the expert panel independently ranked shortlisted drugs. On 2 February 2017, the panel reached a consensus to take the two top ranked drugs acetyl-l-carnitine and memantine forward to clinical trial. However, there were subsequent concerns regarding the availability of acetyl-l-carnitine without prescription and the resulting potential that self-medication with a known trial drug by trial participants, in addition to their randomised treatment allocation, might affect trial integrity.
Subsequently, the panel considered the other final shortlisted drugs and also considered emerging and compelling in vivo and in vitro evidence of the prevention of neurodegeneration by trazodone, through the targeting of eIF2a-P-mediated translational repression.33 Following detailed consideration, the panel recommended memantine and trazodone as the first two investigational medicinal products for MND-SMART.
Discussion
Since drugs have undergone rigorous safety and pharmacokinetic testing, drug repurposing—the use of an established drug in a novel therapeutic indication—reduces costs and barriers to clinical development. Our experience of the successful application of a systematic approach to selecting neuroprotective drugs for repurposing in MS clinical trials17 encouraged us to use a similar approach in MND. The first part of the review assessed clinical data in MND and in other neurodegenerative diseases with potential shared pathophysiological pathways. This allowed for the identification of drugs with good central nervous system penetrance and the potential for efficacy and safety in people with neurodegenerative diseases. However, drug selection based on clinical data alone is biased towards those tested in conditions where large well-designed randomised controlled trials have been performed and where the mechanism of action may be particular to that condition. Notably, two of our top five ranked drugs were cholinesterase inhibitors licensed for AD, a mechanism less relevant to MND. It was therefore important that we augment this approach with expert opinion and with preclinical data in MND and FTD models to provide mechanistic relevance. Taken together we have compiled evidence from clinical and preclinical data and used this to inform the selection of potential oral neuroprotective agents for clinical evaluation in people with MND. Through sequential systematic review, we identified a short list of 22 candidate interventions selected from an initial set of 595 drugs.
While some identified drugs demonstrate a good safety profile and have a relevant putative target pathway in MND, others have less favourable side effects profiles or a requirement for close therapeutic monitoring (eg, clozapine) which necessitates a higher threshold of evidence before testing in clinical trial. This highlights another advantage of our approach, in that it allows the identification of interventions that warrant further rigorous preclinical testing (‘cislation’34) in vivo or in vitro models of ALS, with a view to providing more robust information for efficacy to support their inclusion in future clinical trials.
Following rounds of discussion, the expert panel identified memantine as a drug to be tested in MND-SMART. Memantine is a non-competitive N-methyl-D-aspartate receptor antagonist used in the treatment of moderate to severe AD. It was shown to significantly delay disease progression and improve survival in mouse models carrying a high copy number of SOD1G93A.35 Memantine has been previously tested in three MND clinical trials. A phase II double-blind placebo-controlled study of 63 participants with ALS powered to evaluate safety and tolerability did not identify any increase in adverse events.36 There was a trend towards improvement in participants treated with memantine 20 mg/day, but no significant difference in Amyotrophic Lateral Sclerosis Functional Rating Scale. In a 5-month randomised double-blind study of 24 participants with ALS, there was a significant slowing of spinal motor neuron loss as demonstrated on motor unit estimation testing in the high dose group (10 mg two times a day) compared with low dose (5 mg two times a day).37 Adverse events were not reported. In a single-arm pilot study of 19 participants with ALS, participants treated with riluzole and memantine had reduction in rate of Amyotrophic Lateral Sclerosis Functional Rating Scale decline and reduced cerebrospinal fluid (CSF) tau levels without any increase in adverse events.38
We also asked the expert panel to consider other drugs for which relevant data had only become available after the searches described here had been performed. Trazodone was nominated for consideration through this route. Trazodone is an atypical serotonin antagonist and reuptake inhibitor antidepressant. An unbiased drug screen found that trazodone inhibited Protein Kinase RNA-like endoplasmic reticulum kinase (PERK), which is pivotal to stress granule formation, a common feature of neurodegenerative diseases.33 Inhibition of PERK was found to be beneficial in a fly model of ALS as well as in an in vitro neuronal assay of TDP-43 injury.39 Furthermore, trazodone has been shown to modulate the ER-stress response resulting in an improvement in survival in animal models of prion disease and FTD.33 Trazodone also modulated mitochondrial energy metabolism and fatty acid synthesis in animal models of HD, and may prevent mitochondrial dysfunction in MND.40 In a randomised double-blind placebo-controlled crossover phase II trial in 31 participants with FTD, trazodone was found to improve cognition as assessed by the neuropsychiatric inventory.41 In trials of trazodone in PD and AD, although there was no improvement in cognition, symptoms of sleep disturbance and depression were alleviated and adverse events were not increased.42 43
Limitations of this approach
The main challenge in this approach to drug selection is the ambition to base drug choice on the most contemporary evidence. Systematic reviews are time consuming, as evidenced by the interval between our updated search (2013) and expert committee consideration (2017). Furthermore, drugs with promising data in some domains would be excluded if they have been tested in only one disease other than MND; or if they have not been tested clinically despite overwhelming preclinical evidence. We excluded combination therapies, but it may be—as in the treatment of various cancers44 and infections45 46—that engagement with multiple targets is required to achieve a substantial disease-modifying effect.
The inclusion of trazodone may be seen as a weakness of this approach, but in our view this demonstrates a strength in the flexibility of our approach. We do not believe that systematic review should be used as part of a rigid selection process with little need for input from experts; but rather that expert input is informed by a detailed and robust systematic review process. The expert committee selected trazodone in the full knowledge that it had not been selected through the systematic review process, but were convinced that the emerging evidence of potential efficacy, coupled with long standing clinical experience in its use, made it an attractive candidate for testing in MND-SMART.
Finally, some have suggested that the literature-based systematic review approach to drug selection is intrinsically flawed because it does not take into account disease specific pathophysiology (which may be largely unknown).47 While the three drugs tested in MS-SMART were not effective,18 we note that two other drugs on the final MS-SMART shortlist - ibudilast20 and lipoic acid21—have since shown promise in independent phase II trials. Lipoic acid has been identified again as a favourable candidate drug in a further, independent review in 2020.48 We sought to address this issue here by considering, in addition to clinical information, data from in vivo and in vitro research. Although much successful drug repurposing has been opportunistic and serendipitous, we recognise that future efforts should include consideration of our mechanistic understanding of neurodegenerative diseases and should systemically incorporate additional target and pathway-based information.11
Future approaches to drug selection in MND-SMART
Ongoing rounds of drug selection for MND-SMART exploit innovations in automating literature searches, screening and annotation, with these algorithms trained using the human efforts in the work reported here. These techniques show substantial improvements in efficiency in other fields.49 Using the Systematic Review Facility (SyRF) (https://syrf.org.uk)50 we have enabled a ‘living’ systematic review with automatic search, citation screening, identification of disease and drug, and selection of drugs meeting our criteria for the range of diseases in which studies have been performed. Because of similarities between MND and FTD we have included this as an additional disease of interest. Further details are extracted from full text publications of shortlisted drugs by a combination of machine and human work enabled through the SyRF platform, with human monitoring of machine decisions. The incorporation of machine learning and text mining techniques substantially reduces the human effort required and makes this approach feasible in the context of timely drug selection for adaptive clinical trials.
Complementing our literature-based approach, our current platform incorporates data from additional domains, including in house in vitro high throughput screening using human induced pluripotent stem cell culture; pathway and network analysis; and mining of drug and trial databases. We have also sought a broader range of inputs to our expert committee such that it now includes those with experience and expertise in managing people with MND and their symptoms, and of clinical trials, translational and clinical neurology, systematic reviews, experimental drug screening, pharmacology, chemistry, and drug discovery.
Conclusions
We describe our experience in conducting a systematic, structured, unbiased and evidence-based approach to the selection of candidate drugs for evaluation in a clinical trial in MND by combining review of clinical and preclinical literature, and expert panel input. The first two drugs selected are memantine and trazodone. For future selection, we will incorporate machine learning and text mining to our systematic reviews and data from our drug discovery platform.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
Ethics statements
Patient consent for publication
Ethics approval
Not applicable.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Twitter @DrCharisWong, @jennagregory488, @Maarij_Anwar, @VGCollins__, @peterfoley10, @StellaGlasmach1, @GavinLanglands, @Yelleighton, @DrArpan100, @AnkurP_Singh, @FergalWaldron, @bhuvaneish, @suvankarpal, @Maclomaclee
Contributors SP, SC and MM managed the project. CW, JMG, JLiao, KE, HMV and MM were project administrators. JMG, KE, HMV, SC and MM conceptualised the project. CW, JMG, JLiao, KE, HMV, AAK, MA, CB, FSB, JC, AC, JYC, CC, VC, JD, EE, PF, YCF, LF-H, ABG, SAG, ÁH, KJ, NJ, AK, JK, GL, DL, JLiu, JLyon, ARM, AM, VN, NHP, SQ, YR, ASalzinger, BS, ASingh, TS, AT, OT, FMW, SP and MM performed systematic searching, screening, annotation and data extraction. CW, JMG, JLiao, KE, HMV and MM developed the project methodology, curated and analysed data. JLiao handled software and programming. CW developed data visualisation. AC and BTS performed in vitro drug screening. JC, RS, PC, SP, SC and MM were members of the expert panel. CW and JMG wrote the original draft. CW, JMG, JLiao, JC, ARM, JC, RS, SP, SC and MM reviewed and edited the manuscript. All authors have read and approved the manuscript. MM is the guarantor of the overall content: The guarantor accepts full responsibility for the finished work and/or the conduct of the study, had access to the data, and controlled the decision to publish.
Funding For the purpose of open access, the authors have applied a Creative Commons Attribution (CC BY) licence to any Author Accepted Manuscript version arising from this submission. MND-SMART is funded by grants from MND Scotland, My Name’5 Doddie Foundation (DOD/14/15) and specific donations to the Euan MacDonald Centre. The Chandran lab is supported by the UK Dementia Research Institute, which receives its funding from UK DRI Ltd, funded by the UK Medical Research Council, Alzheimer’s Society and Alzheimer’s Research UK. EE is a clinical academic fellow jointly funded by MND Scotland (MNDS) and the Chief Scientist Office (CSO) (217ARF R45951). ARM was a Lady Edith Wolfson Clinical Fellow, jointly funded by the Medical Research Council (MRC) and the Motor Neurone Disease Association (MR/R001162/1). ASalzinger is funded by Marie Sklodowska-Curie actions Innovative Training Network (ITN). BTS is funded by Rowling fellowship.
Competing interests In the last 3 years, JC has received support from the Efficacy and Evaluation (EME) Programme, a Medical Research Council (MRC) and National Institute for Health Research (NIHR) partnership and the Health Technology Assessment (HTA) Programme (NIHR), the UK MS Society, the US National MS Society and the Rosetrees Trust. He is supported in part by the NIHR University College London Hospitals (UCLH) Biomedical Research Centre, London, UK. He has been a local principal investigator for a trial in MS funded by the Canadian MS society. A local principal investigator for commercial trials funded by: Actelion, Novartis and Roche; and has taken part in advisory boards/consultancy for Azadyne, Janssen, Merck, NervGen, Novartis and Roche.
Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.