Health technology assessment of drugs for rare diseases: insights, trends, and reasons for negative recommendations from the CADTH common drug review.

Background

The pipeline of drugs for rare diseases (DRD) has been increasing as biochemical research has shifted focus from blockbusters to ‘niche’ drugs [ 1 ]. While all rare diseases, by definition, affect relatively small populations, the exact number of patients affected and the extent of the severity of the condition used to define a rare disease is a matter of continuous debate [ 2 ]. The regulator in Canada, Health Canada, is yet to officially adopt a definition of a rare disease, although in a 2014 press release, Health Canada defined a rare disease as a “life-threatening, seriously debilitating, or serious chronic condition that only affects a very small number of patients (typically less than 5 in 10,000 persons)” [ 3 ].

The Canadian Agency for Drugs and Technologies in Health (CADTH) is a publicly funded Canadian health technology assessment (HTA) organization that evaluates drugs for reimbursement purposes through its Common Drug Review (CDR) and pan-Canadian Oncology Drug Review [pCODR] processes [ 4 ]. Through its advisory body, the Canadian Drug Expert Committee (CDEC), CADTH offers non-binding reimbursement recommendations to all public drug plans in Canada except for those in Quebec, which has a separate review process. Overall, CDEC provides reimbursement recommendations under three themes: List, List with clinical criteria or conditions, and do not list. It has been reported that participating drug plans adhere to these recommendations in more than 90% of formulary listings [ 4 ]. In 2012, CADTH received a formal mandate from its federal, provincial, and territorial (F/P/T) funders to review DRDs [ 5 ]. Prior to 2012, there was no formal distinction given for DRDs and CADTH evaluated such drugs under the same process as non-DRDs. After a formal stakeholder consultation, CADTH decided to keep the evaluation of DRDs under an enhanced CDR process, with more emphasis on engagement of specialists, patient input, and offering opportunities for manufacturers to engage in dialogue with CADTH earlier in the pre-submission phase [ 6 ]. As such, CADTH has no formal definition that would make a distinction between DRDs and non-DRDs.

This report provides a summary of key characteristics for all DRD submissions that have been filed for review through the CDR process, an analysis of the volume and frequency of DRD submissions, and a detailed examination of the reimbursement recommendations and reasons for reimbursement recommendation that have been issued for DRDs. This will allow us to draw a bigger picture of the fast evolving landscape of DRDs, explore the characters of DRDs CDR submissions, and to gain insight into the evidence base that supports HTA process for DRDs.

Methods

On February 3, 2016, CDR reimbursement recommendation reports published on the CADTH website ( www.cadth.ca ) were screened for inclusion in this review. A drug was included if it was reviewed for use in the management of a disease with a prevalence or birth prevalence of less than 50 in 100,000 people. This definition of rare diseases is in line with most international jurisdictions [ 2 ]. Two independent reviewers (G.J. and W.A.) screened the retrieved reports. First-level screening excluded CDR reports with indications for diseases that are not rare. Second-level screening required the reviewer to provide the prevalence of the disease before a decision to exclude or include was made. Discrepancy between the two reviewers was resolved through arbitration of a third independent reviewer (T.R.). One reviewer (G.J.) extracted the following data from the published CDR reports: CADTH project ID, project status, date of submission, type of submission, disease under review, prevalence of disease under review, Health Canada indication, manufacturer name, drug brand name, drug non-proprietary name, number of studies considered within the CDR review, type of studies considered in each submission, comparisons used in the studies, size of the largest study, highest evidence level (with no double counting allowed), per patient annual treatment cost, cost per quality-adjusted life year (QALY), reimbursement recommendation, and reason(s) for a negative reimbursement recommendation. If prevalence data were not reported in the CDR report, we sought a Canadian published estimate in the literature, if such estimate could not be found, then the prevalence point estimates was informed from the Orphanet report series [ 7 ]. Full data-set is available from the corresponding author upon reasonable request.

We categorized reimbursement recommendations as either “List”, “Do Not List”, or “List with Conditions/Criteria”. A reimbursement recommendation of “do not list at the submitted price” was classified as “Do Not List”. We thematically explored reasons for a negative reimbursement recommendation (i.e., a “Do Not List”) based on the most prominent reason stated within the recommendation report, and each reason was categorized as one of the following: Insufficient evidence: in cases where the committee found the evidence to be of poor quality with a high degree of statistical uncertainty and methodological limitations Lack of clinical effectiveness: in cases where the committee could not determine the actual clinical value to be observed in practice due to a lack of (a) relevant clinical outcomes, (b) knowledge of what constituted a minimal clinically important difference (MCID), or (c) the use of outcomes that are not validated. Usually, in this category, high-quality studies would have been considered, and the drug would have potentially shown statistical significance in possible surrogate outcomes Lack of cost-effectiveness/high cost: in cases where the committee determined the treatment price to be contextually unacceptable Multiple reasons: in cases where more than one of the aforementioned reasons was applicable

Due to the implementation of a revised reimbursement recommendation framework at the CADTH CDR in November 2012 [ 8 ], a subgroup analysis of CDEC reimbursement recommendations that were issued after October 2012 were further analyzed separately. The accuracy of the extracted data was verified by a second reviewer (T.R.).

We calculated descriptive statistics of various parameters, including the average, standard deviation (SD), 95% confidence interval (95%CI), median, and range of continuous variables. Categorical variables are presented as percentages.

Results

Of 434 records retrieved on February 3, 2016, we identified 63 submissions for DRDs. Of these 63 submissions, four were ongoing at the time of the search, and the reimbursement recommendations and clinical report were not available. Therefore, there was no information available for these DRDs regarding the studies included in the submission, the price, and reimbursement recommendations. Assessment of the number of DRD submissions made to the CADTH CDR revealed two distinct, contrasting periods: the first period was between 2004 and 2012, within which the number of submissions was generally between 4 and 5 per year, and ranged from a minimum of 1 submission in 2005 to a maximum of 5 submissions in each of the years 2004, 2009, 2010, and 2012; the second period was between 2013 and 2015, which was distinct from the preceding period in that the number of submissions increased, up to 10, 9, and 8 submissions for the years 2013, 2014, and 2015, respectively. Figure 1 illustrates the temporal trend in the volume of DRD submissions. Fig. 1 Number of CDR submissions for drugs for rare diseases per year for the period 2004 to 2015. Numbers above columns indicate the number of submissions

Table 1 lists the date of each submission, along with the drug name, manufacturer name, the rare disease for which the drug is indicated, the prevalence of the disease, and the CDEC reimbursement recommendation. Examination of these data revealed that Pfizer Canada made more DRD submissions than any other pharmaceutical manufacturer (a total of six submissions), followed by Genzyme Canada (five submissions), and Alexion, Hoffman-La Roche, and Novartis (four submissions each). Table 1 CDR for rare diseases Date of submission Drug brand name Drug non-proprietary name Manufacturer Pharmacological category Disease Prevelance of disease (/100,000) CDEC reimbursement recommendation 19/02/2004 Replagal agalsidase alfa Transkaryotic Therapies Inc. Biologic/Enzyme replacement therapy Fabry Disease 0.22 a Do not list 24/02/2004 Fabrazyme agalsidase beta Genzyme Canada Inc. Biologic/Enzyme replacement therapy Fabry Disease 0.22 a Do not list 14/07/2004 Remodulin Treprostinil sodium Northern Theraputics Inc. Chemical/Vasodilating Agents Pulmonary arterial hypertension 3.3 a Do not list 24/11/2004 Zavesca miglustat Actelion Pharmaceuticals Canada Inc. Chemical/Substrate reduction therapy, Enzyme Inhibitor; Glucosylceramide Synthase Inhibitor Gaucher disease 1 a Do not list 10/12/2004 Fabrazyme agalsidase beta Genzyme Canada Inc. Biologic/Enzyme replacement therapy Fabry Disease 0.22 a Do not list 03/02/2005 Aldurazyme laronidase Genzyme Canada Inc. Biologic/Enzyme replacement therapy Mucopolysaccharidosis I 8 a Do not list 25/01/2006 Somavert pegvisomant Pfizer Canada Inc. Biologic/Growth hormone receptor antagonist Acromegaly 5.5 a Do not list 24/02/2006 Remodulin Treprostinil sodium Northern Theraputics Inc. Chemical/Vasodilating Agents Pulmonary arterial hypertension 3.3 a List with criteria/condition 20/07/2006 Sutent sunitinib Pfizer Canada Inc. Chemical/Antineoplastic Agent, Tyrosine Kinase Inhibitor; Antineoplastic Agent, Vascular Endothelial Growth Factor (VEGF) Inhibitor Gastrointestinal stromal tumour 13 a List with clinical criteria and/or conditions 10/10/2006 Myozyme alglucosidase Genzyme Canada Inc. Biologic/Enzyme replacement therapy Glycogen storage disease type II 0.8 a List with clinical criteria and/or conditions 20/02/2007 Somatuline lanreotide acetate Ipsen Limited Chemical/Somatostatin Analog Acromegaly 5.5 a List in a similar manner to other drugs in class 22/06/2007 Thelin Sitaxsentan sodium Encysive Canada Inc. Chemical/Endothelin receptor antagonist Pulmonary arterial hypertension 3.3 a Do not list 13/07/2007 Elaprase idursulfase Shire Human Genetic Therapies (Canada) Inc. Biologic/Enzyme replacement therapy Mucopolysarccharidosis II 6.7 a Do not list 29/08/2007 Xyrem sodium oxybate Valeant Canada Ltd. Chemical/Central Nervous System Depressant Narcolepsy 25 a Withdrawn 05/05/2008 Thelin Sitaxsentan sodium Encysive Canada Inc. Chemical/Endothelin receptor antagonist Pulmonary arterial hypertension 3.3 a Do not list 09/07/2008 Xyrem sodium oxybate Valeant Canada Ltd. Chemical/Central Nervous System Depressant Narcolepsy 25 a Do not list 09/07/2008 Volibris Ambrisentan GlaxoSmithKline Chemical/Endothelin receptor antagonist Pulmonary arterial hypertension 3.3 a List with clinical criteria and/or conditions 29/08/2008 Orencia Abatacept Bristol-Myers Squibb Canada Biologic/Selective T Cell Costimulation Modulator Juvenile idiopathic arthritis (JIA) 44.7 b List with criteria/condition 12/06/2009 Omnitrope somatropin (rDNA origin) Sandoz Canada Inc. Biologic/Growth hormone Growth hormone deficiency in children and adults 37 c List in a similar manner to other drugs in class 12/06/2009 Xeomin clostridium botulinum neurotoxin type A, free of complexing proteins Merz Pharmaceuticals GmbH Biologic/Neuromuscular Blocker Agent, Toxin; Ophthalmic Agent, Toxin Blepharospasm 16.43 d List in a similar manner to other drugs in class 12/06/2009 Xeomin clostridium botulinum neurotoxin type A, free of complexing proteins Merz Pharmaceuticals GmbH Biologic/Neuromuscular Blocker Agent, Toxin; Ophthalmic Agent, Toxin Cervical dystonia 16.43 d List in a similar manner to other drugs in class 18/09/2009 Soliris eculizumab Alexion Pharmaceuticals Inc. Biologic/Monoclonal Antibody; Monoclonal Antibody, Complement Inhibitor Paroxysmal nocturnal hemoglobinuria 0.2 a Do not list 29/09/2009 Nplate Romiplostim Amgen Canada Inc. Biologic/Colony Stimulating Factor; Hematopoietic Agent; Thrombopoietic Agent Immune thrombocytopenic purpura 25 a Do not list 05/02/2010 Adcirca Tadalafil Eli Lilly Canada Inc. Chemical/Enzyme inhibitor Pulmonary arterial hypertension 3.3 a List with criteria/condition 07/07/2010 Ilaris canakinumab Novartis Pharmaceuticals Canada Inc. Biologic/Interleukin-1 Beta Inhibitor; Interleukin-1 Inhibitor; Monoclonal Antibody Cryopyrin-Associated Periodic Syndrome (CAPS) 0.3 e Do not list 08/07/2010 Kuvan sapropterin dihydrochloride BioMarin Pharmaceutical (Canada) Inc. Chemical/Enzyme Cofactor, activates residual PAH enzyme Phenylketonuria 10 a Do not list 28/10/2010 Vpriv velaglucerase alfa Shire Human Genetic Therapies (Canada) Inc. Biologic/Enzyme replacement therapy Gaucher disease 1 a List with clinical criteria and/or conditions 02/12/2010 Cayston aztreonam Gilead Sciences Canada Inc. Chemical/Antibiotic Cystic fibrosis 7.4 a List with clinical criteria and/or conditions 26/04/2011 Revolade Eltrombopag olamine GlaxoSmithKline Chemical/Colony Stimulating Factor; Hematopoietic Agent; Thrombopoietic Agent Immune thrombocytopenic purpura 25 a Do not list 01/06/2011 Kuvan sapropterin dihydrochloride BioMarin Pharmaceutical (Canada) Inc. Chemical/Enzyme Cofactor, activates residual PAH enzyme Phenylketonuria 10 a NR 20/09/2011 Banzel Rufinamide Eisai Limited Chemical/Anticonvulsant, Triazole Derivative Lennox-Gastaut Syndrome 15 a List with clinical criteria and/or conditions 24/01/2012 Mozobil plerixafor injection Genzyme Canada Inc. Chemical/Hematopoietic Agent; Hematopoietic Stem Cell Mobilizer Non-Hodgkin’s lymphoma and multiple myeloma 11.9 a Do not list 30/01/2012 Actemra tocilizumab Hoffmann-La Roche Ltd. Biologic/Antirheumatic, Disease Modifying; Interleukin-6 Receptor Antagonist Juvenile idiopathic arthritis 44.7 b List 24/02/2012 Rituxan Rituximab Hoffmann-La Roche Ltd. Biologic/Antineoplastic Agent, Anti-CD20; Antineoplastic Agent, Monoclonal Antibody; Antirheumatic, Miscellaneous; Immunosuppressant Agent; Monoclonal Antibody Granulomatosis with Polyangiitis 9 a List with clinical criteria and/or conditions 27/09/2012 Kalydeco ivacaftor tablets Vertex Pharmaceuticals (Canada) Inc. Chemical/Cystic Fibrosis Transmembrane Conductance Regulator Potentiator Cystic fibrosis 7.4 a List with criteria/condition 05/10/2012 Esbriet pirfenidone InterMune Canada Inc. Chemical/Anti-inflammatory Agent; Antifibrotic Agent Idiopathic pulmonary fibrosis (IPF) 42.7 f Do not list 07/01/2013 Soliris eculizumab Alexion Pharmaceuticals Inc. Biologic/Monoclonal Antibody; Monoclonal Antibody, Complement Inhibitor Atypical Hemolytic Uremic Syndrome 0.85 a Do not list 04/02/2013 Humira adalimumab AbbVie Corporation Biologic/Antirheumatic, Disease Modifying; Gastrointestinal Agent, Miscellaneous; Monoclonal Antibody; Tumor Necrosis Factor (TNF) Blocking Agent Juvenile idiopathic arthritis (JIA) 44.7 b List with clinical criteria and/or conditions 08/03/2013 Afinitor Everolimus Novartis Pharmaceuticals Canada Inc. Chemical/Antineoplastic Agent, mTOR Kinase Inhibitor; Immunosuppressant Agent; mTOR Kinase Inhibitor Tuberous sclerosis 8.8 a Do not list 27/05/2013 Genotropin GHD-A somatropin Pfizer Canada Inc. Biologic/Growth Hormone Growth hormone deficiency 37 c List with clinical criteria and/or conditions 27/05/2013 Genotropin GHD-P somatropin Pfizer Canada Inc. Biologic/Growth Hormone Growth hormone deficiency 37 c List with clinical criteria and/or conditions 27/05/2013 Genotropin TS somatropin Pfizer Canada Inc. Biologic/Growth Hormone Turner syndrome 50 g List with criteria/condition 06/06/2013 Jetrea ocriplasmin Alcon Canada Inc. Biologic/Ophthalmic Agent; Vitreolytic Vitreomacular adhesion 40 h List with criteria/condition 29/07/2013 Actemra tocilizumab Hoffmann-La Roche Ltd. Biologic/Antirheumatic, Disease Modifying; Interleukin-6 Receptor Antagonist Juvenile idiopathic arthritis (JIA) 44.7 b List with criteria/condition 30/09/2013 Adempas Ricoiguat Bayer Inc. Chemical/Soluble Guanylate Cyclase (sGC) Stimulator Pulmonary arterial hypertension 3.3 a List with criteria/condition 16/12/2013 Opsumit Macitentan Actelion Pharmaceuticals Canada Inc. Chemical/Endothelin Receptor Antagonist; Vasodilator Pulmonary arterial hypertension 3.3 a List with criteria/condition 27/02/2014 Signifor pasireotide Novartis Pharmaceuticals Canada Inc. Chemical/Somatostatin Analog Cushing's Disease 4 a Do not list 04/03/2014 Firazyr icatibant Shire Human Genetic Therapies (Canada) Inc. Chemical/Selective Bradykinin B2 Receptor Antagonist Hereditary angioedema 1 a List with clinical criteria and/or conditions 19/03/2014 Afinitor Everolimus Novartis Pharmaceuticals Canada Inc. Chemical./Antineoplastic Agent, mTOR Kinase Inhibitor; Immunosuppressant Agent; mTOR Kinase Inhibitor Tuberous Sclerosis 8.8 a Do not list 01/05/2014 Kalydeco ivacaftor Vertex Pharmaceuticals (Canada) Inc, Chemical/Cystic Fibrosis Transmembrane Conductance Regulator Potentiator Cystic fibrosis 7.4 a List with criteria/condition 08/07/2014 Juxtapid lomitapide Aegerion Pharmaceuticals (Canada) Ltd. Chemical/Antilipemic Agent, Microsomal Triglyceride Transfer Protein (MTP) Inhibitor Homozygous Familial Hypercholesterolemia 0.6 i Do not list 05/08/2014 Vimizim elosulfase alfa BioMarin Pharmaceutical (Canada) Inc. Biologic/Enzyme replacement therapy Mucopolysaccharidosis IV 0.3 j Do not list 29/08/2014 Esbriet pirfenidone Hoffmann-La Roche Ltd. Chemical/Anti-inflammatory Agent; Antifibrotic Agent Idiopathic pulmonary fibrosis (IPF) 42.7 f List with criteria/condition 15/09/2014 Elelyso Taliglucerase alfa Pfizer Canada Inc. Biologic/Enzyme replacement therapy Gaucher disease 1 a Do not list 30/10/2014 Diacomit Stiripentol Biocodex Chemical/Anticonvulsant Dravet Syndrome 2.5 a List with criteria/condition 09/02/2015 Soliris eculizumab Alexion Pharmaceuticals Inc. Biologic/Monoclonal Antibody; Monoclonal Antibody, Complement Inhibitor Atypical Hemolytic Uremic Syndrome 0.85 a Do not list 23/04/2015 Ofev Nintedanib Boehringer Ingelheim (Canada) Ltd. Chemical/Tyrosine Kinase Inhibitor Idiopathic pulmonary fibrosis (IPF) 42.7 f List with criteria/condition 08/05/2015 Kalydeco Ivacaftor Vertex Pharmaceuticals (Canada) Inc. Chemical/Cystic Fibrosis Transmembrane Conductance Regulator Potentiator Cystic fibrosis 7.4 a List with criteria/condition 25/06/2015 Adempas Riociguat Bayer Inc. Chemical/Soluble Guanylate Cyclase (sGC) Stimulator Pulmonary arterial hypertension 3.3 a List with criteria/condition 20/07/2015 Strensiq Asfotase alfa Alexion Pharmaceuticals Inc. Biologic/Enzyme replacement therapy Hypophophatasia 1 k Ongoing 20/08/2015 Naglazyme Galsulfase BioMarin Pharmaceutical (Canada) Inc. Biologic/Enzyme replacement therapy Mucopolysaccharidosis VI 0.3 j Ongoing 24/11/2015 Ilaris canakinumab Novartis Pharmaceuticals Canada Inc. Biologic/Interleukin-1 Beta Inhibitor; Interleukin-1 Inhibitor; Monoclonal Antibody Juvenile idiopathic arthritis 44.7 b Ongoing 27/11/2015 Orkambi lumacaftor/ivacaftor Vertex Pharmaceuticals (Canada) Inc. Chemical/CFTR combinations Cystic fibrosis 7.4 a Ongoing Sources of prevalence estimates a Orphanet Report Series - Prevalence of rare diseases: Bibliographic data - July 2015 - Number 2. http://www.orpha.net/orphacom/cahiers/docs/GB/Prevalence_of_rare_diseases_by_decreasing_prevalence_or_cases.pdf . Last accessed January, 2016 b Thierry S, Fautrel B, Lemelle I, Guillemin F. Prevalence and incidence of juvenile idiopathic arthritis: a systematic review. Joint Bone Spine. 2014 Mar;81(2):112–7. doi: 10.1016/j.jbspin.2013.09.003. Epub 2013 Nov 6 c Stochholm K, Gravholt CH, Laursen T, Jorgensen JO, Laurberg P, Andersen M. Incidence of GH deficiency - a nationwide study. Eur J Endocrinol. 2006 Jul. 155(1):61-71 d Steeves TD, Day L, Dykeman J, Jette N, Pringsheim T. The prevalence of primary dystonia: a systematic review and meta-analysis. Mov Disord. 2012 Dec;27(14):1789–96. doi: 10.1002/mds.25244. Epub 2012 Oct 31 e Kümmerle-Deschner JB. [Cryopyrin-associated periodic syndrome] [Article in German]. Z Rheumatol. 2012 Apr;71(3):199–208. doi: 10.1007/s00393-011-0856-9 f Ganesh Raghu, Derek Weycker, John Edelsberg, Williamson Z. Bradford, Gerry Oster. Incidence and Prevalence of Idiopathic Pulmonary Fibrosis. Am J Respir Crit Care Med Vol 174. pp 810–816, 2006 g Claus Højbjerg Gravholt, Kirstine Stochholm. The epidemiology of Turner syndrome. International Congress Series. Volume 1298, October 2006, Pages 139–145 h Ocriplasmin (Jetrea) (125 mcg intravitreal injection) CADTH Common Drug Review Clinical Review Report. January 2014. Available https://www.cadth.ca/sites/default/files/cdr/clinical/SR0337_Jetrea_CL_Report_e.pdf i lomitapide (Juxtapid) (oral capsules) CADTH Common Drug Review Clinical Review Report. July 2015. Available https://www.cadth.ca/sites/default/files/cdr/clinical/SR0386_Juxtapid_CL_Report_e.pdf j Lowry, R.B., Applegarth, D.A., Toone, J.R. et al. An update on the frequency of mucopolysaccharide syndromes in British Columbia. Hum Genet (1990) 85: 389. doi:10.1007/BF00206770 k Fraser D. Hypophosphatasia. Am J Med, 1957; 730–746

Of the 63 DRD submissions, approximately half (30 or 47.6%) were for drugs that were classified by Health Canada as biologics, with the remainder being small molecules. The average prevalence of diseases for which DRD submissions were reviewed at CDR was 14.0 patients per 100,000 people (SD: 16.0; 95%CI: 9.9 to 18.0; range: 0.2 to 50.0 per 100,000 people; median: 7.4 per 100,000 people). Figure 2 presents the number of submissions by prevalence. Figure 2 illustrates that more than half of all DRD submissions (61.9%) were for treatments for rare diseases with a prevalence of less than 10 patients per 100,000 people, with the remainder of the DRD submissions (38.1%) being for treatments for diseases with a prevalence between 10 and 50 patients per 100,000 people. This suggests that there is a tendency for DRD submissions to target relatively less prevalent rare diseases. Fig. 2 Number of CDR submissions for drugs for rare diseases by indicated disease prevalence. Numbers above columns indicate the number of submissions

Of the 54 (85.7%) submissions in which the number of clinical studies considered by CDEC was reported, the average number of clinical studies per submission was 2.5 (SD: 2.0; 95%CI: 2.0 to 3.0), with a median of 2 and a range of 1 to 14 (Fig. 3 ). Of the 57 (90.5%) submissions for which information about the types of studies was available, 47 (74.6.7%) had at least one double-blind randomized clinical trial (RCT) as the highest level of evidence, 3 submissions (4.7%) had at least one open-label RCT as the highest level of evidence, and 7 (11.1%) had at least one non-controlled trial as highest level of evidence (Fig. 4 ). Fig. 3 Number of CDR submissions for drugs for rare diseases by the number of clinical studies considered in each submission. Numbers above columns indicate the number of submissions Fig. 4 Type of best evidence included in the CDR submissions of drugs for rare diseases. Numbers above columns indicate the number of submissions

The study size (i.e., number of study subjects) for clinical studies that were considered in the CDR review of DRD submissions was reported for 49 (77.8%) of the included submissions. The largest clinical study per submission ranged from 20 to 742 subjects, with a median of 122 subjects. The average size of the largest study within each submission was 171.9 (SD: 171.9; 95%CI: 140.1 to 238.8). Figure 5 presents the number of submissions by the size of the largest included trial. Fig. 5 Number of CDR submissions by the size of the largest clinical study considered in each submission. Numbers above columns indicate the number of submissions

Information regarding the annual treatment cost per patient was available for only 31 (49.2%) of the included DRD submissions. The reasons for not reporting the annual treatment cost included confidential pricing (15 submissions or 23.8%), an annual treatment cost not applicable to the indication under review (12 submissions or 19.0%), or ongoing or withdrawn submissions (5 submissions or 7.9%). The average annual treatment cost per patient for the 31 DRD submission for which cost information was available was $215,632 (SD: 240,858.8; 95%CI: 127,283.9 to 303,979.3), with a median of $104,890 with a minimum annual price of $9,706 and a maximum annual price of $940,084. Figure 6 illustrates almost half of the DRD submissions (45.2%) were for treatments with a cost greater than $200,000 per patient per year. Fig. 6 Average annual treatment cost per patient of drugs for rare diseases

Analysis of the type of reimbursement recommendations issued since 2004 for DRD submissions revealed that a negative reimbursement recommendation was issued for 26 (44.8%) submissions, while one submission was withdrawn (1.7%); the remaining 31 submissions (53.5%) received positive reimbursement recommendations, of which 8.6% were to “list” and 44.8% were to “list with criteria/conditions” (Fig. 7 ). Not included in the previous analysis are four submissions that were ongoing at the time of data collection, as such no recommendation was available, and one submission was a request for advice that did not yield a published recommendation. Overall, reasons for a negative reimbursement recommendation included lack of clinical effectiveness (10 submissions or 38.5%), insufficient evidence (8 submissions or 30.8%), multiple reasons (6 submissions or 23.1%), and lack of cost-effectiveness/high cost (2 submissions or 7.7%) (Fig. 8 ). A subgroup analysis of reimbursement recommendations and reasons for a negative reimbursement recommendations issued after the new CDEC framework took effect in November, 2012, revealed that 15 submissions (65.2%) received a positive recommendation (“list with criteria/conditions”) while 8 submissions (34.8)% received a negative recommendation (“do not list”). Reimbursement recommendations. The most frequent reason for a negative reimbursement recommendation was insufficient evidence to determine clinical effectiveness (5 [62.5%] submissions), followed by lack of clinical effectiveness (2 [25.0%] submissions), and multiple reasons (1 [12.5%] submission). No submission received a negative reimbursement recommendation due to cost alone. Fig. 7 Listing reimbursement recommendations since 2004 Fig. 8 Reasons for negative reimbursement recommendation since 2004

Discussion

Since its inception in 2004, the CADTH CDR has received a total of 63 DRD submissions (based on a definition of a rare disease being any disease with a prevalence of <50 patients per 100,000). These 63 submissions have addressed 35 unique rare diseases, which represents a very small proportion of the approximately 7,000 rare diseases described to date [ 9 ]. The number of DRD submissions received annually increased recently, from 1 to 5 submissions between 2004 and 2006 to 8 to 10 submissions between 2013 and 2015. Whether this reflects a general increase in the development of DRDs in unclear, although this would not be an unreasonable conclusion based on reports by others of increased focus of manufacturers on treatment for rare diseases [ 1 , 10 ]. If the increase in the number of DRD submissions observed in our study continues, this suggests that HTA agencies such as the CADTH CDR will likely be required to review an increasingly large number of DRD submissions in future, which could pose some challenges given the unique clinical and economic complexities of these types of submission.

One of the greatest challenges in determining whether treatments for rare diseases are effective is the generation of sufficiently robust clinical data, because it is difficult to adequately power clinical studies due to a dearth of patients with the rare disease being studied. The difficulties encountered with recruiting adequate numbers of patients has led to the general perception that many aspects of conventional study designs are unfeasible in the study of DRDs. We expected to find mostly small size studies and single arm uncontrolled designs. However, 82.5% of the submissions with information on study design included at least one double-blinded RCT, and 71.4% of the submissions had enrolled more than 150 patients in their studies; this was despite most DRD submissions being for DRDs with a prevalence of <10 patients per 100,000 people. Our findings provide evidence that the aforementioned perception may be incorrect in most cases, and instead, suggest that it is indeed possible to design and conduct high-quality clinical studies despite issues with patient recruitment.

The average annual treatment cost per patient for the DRD submissions made to the CADTH CDR was $215,631, and almost half of the reported treatment costs were over $200,000 annually. This average, however, was calculated from only approximately half of the submissions, as cost information was either not reported or was redacted from published reports. Cost information was not available in most cases due to confidential pricing. Although rare diseases affect small numbers of people on an individual basis, approximately 7,000 unique rare diseases have been described to date [ 7 ], and as a whole, it is estimated that rare diseases affect 1 in 12 Canadians [ 11 ]. Moreover, the pace of development of treatments for rare diseases has increased in recent years [ 1 , 10 ], which might be reflected in the increased growth in the number of DRD submissions made to CDR over the last few years. The potential future implications on public financial health resources that could result from increased development and funding of high-cost DRDs will require the timely development of innovative regulatory, HTA, and reimbursement frameworks to mitigate issues such as high opportunity costs and to ensure access to effective DRDs.

Over half of all the DRD CDR submissions received a positive reimbursement recommendation. The ‘do not list’ reimbursement recommendation was mostly due to reasons related to either lack of clinical efficacy or lack of enough evidence to inform on clinical efficacy. Given that most studies have supplied high-quality design, the reason for a ‘do not list’ due to ‘lack of clinical effectiveness’ was largely concerned with a lack of clinically relevant outcomes. This can be a challenge in rare-disease research as the use of surrogate outcomes could prove more convenient, statistically and financially, than clinical outcomes. With the recent emphasis towards more engagement of patients, evaluation committees want to assess beyond the surrogate outcomes and need to know if tangible changes that will better patient’s quality of life are considered in the research [ 11 ]. Clinical outcomes, patient-reported outcomes with a minimally important clinical difference, and surrogate outcomes with established clinical associations are needed to address the insufficient evidence in some of the DRD CDR submissions.

A CDEC reimbursement recommendation is non-binding on the CDR-participating drug plans. Each of the drug plans subsequently makes its own decisions based on the CDEC recommendation in addition to other factors including the plan’s mandate, jurisdictional priorities, pan-Canadian Pharmaceutical Alliance (pCPA) negotiations, and financial resources. Although we used a prevalence rate of < 50 per 100,000 people as a definition of a rare disease for the purpose of this analysis, CADTH has no formal definition for DRDs. In March 2016, CADTH published an update to the CDEC framework [ 12 ]. The framework provides guidance on the deliberation for drugs that may fulfill a significant unmet clinical need, and the rarity of the condition is only one of several factors that are considered to define a significant unmet clinical need.

While we have provided a comprehensive picture of the characteristics of DRD submissions to the CADTH CDR, our study is not without limitations. First, data extraction was conducted by one reviewer and verified by another, rather than in duplicate; while verification would ensure a high level of accuracy, it is not as accurate as a duplicate extraction. Second, our estimated prevalence values were in some cases derived from different sources and most were based on prevalence rates for populations in countries other than Canada; therefore, these values might not be an accurate representation of Canadian prevalence rates. In addition, we did not take into account the variability in prevalence among different locations; therefore, we might have included diseases that are not rare in all countries, while we might not have included diseases that are rare in some countries. This issue was further complicated by the fact that a challenge for the reviewers was whether to consider a drug that targets a small subpopulation of a common disease as a DRD. It was decided to keep the focus on drugs with a condition that is unique and rare versus a very small subpopulation of a relatively more common disease. Finally, the number of submissions that we identified was not sufficiently large to perform robust statistical analysis of associations among different characteristics.

Conclusions

The annual number of DRD submissions made to the CADTH CDR has approximately doubled increased since 2013 compared to previous years, reflecting growth in the development of treatments for rare diseases. Over the last decade, more than half of DRD submissions resulted in a positive CDEC reimbursement recommendation, while most submissions that received a negative recommendation were characterized by low-quality clinical evidence and/or a lack of supportive clinical evidence. Although the average cost of DRD treatments in submissions made to the CDR is high, high cost was not a reason for a negative reimbursement recommendation in any recommendation after October 2012.

Abbreviations

Canadian Agency for Drugs and Technologies in Health

Canadian Drug Expert Committee

Common Drug Review

Drugs for rare diseases

Health technology assessment

Minimal clinically important difference

Pan-Canadian Oncology Drug Review

Quality-adjusted life year

Acknowledgements

Not applicable.

Funding

No funding/research grant was received to support this study.

Availability of data and materials

The datasets during and/or analysed during the current study available from the corresponding author on reasonable request.

Authors’ contributions

GJ contributed significantly to study conception, planning, data gathering, analysis, interpretation, drafting the manuscript and performing revisions; WA contributed significantly to data gathering, analysis, and revising the manuscript critically for important intellectual content; BM contributed significantly to study planning, data interpretation, drafting the manuscript, and revising the manuscript critically for important intellectual content; CS contributed significantly to study planning, data interpretation, drafting the manuscript, and revising the manuscript critically for important intellectual content; TR contributed significantly to study conception, planning, data gathering, analysis, interpretation, drafting the manuscript, and revising the manuscript critically for important intellectual content. All authors have given their final approval for the publication of this article and take full responsibility of its content.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

This was a review from a public database and did not include humans or animals participant, as such, no ethics board approval or consent were required.

References

1. CADTH. Drugs for rare diseases: evolving trends in regulatory and health technology assessment perspectives. Ottawa; CADTH; 2013 Oct [updated 2016 Feb]. (Environmental scan; issue 42)

2. Richter T Nestler-Parr S Babela R Khan ZM Tesoro T Molsen E Rare disease terminology and definitions—a systematic global review: report of the ISPOR rare disease special interest group Value Health 2015 18 6 906 14 10.1016/j.jval.2015.05.008 26409619

3. Government of Canada. Archived - Minister Ambrose Announces Patient Involvement Pilot for Orphan Drugs - Canada News Centre. Available from: http://news.gc.ca/web/article-en.do?nid=873619 . Accessed Apr 2016

4. CADTH. The CADTH Common Drug Review – Myths Versus Facts. Available from: https://www.cadth.ca/media/cdr/cdr-pdf/cdr_myths_facts_e.pdf . Accessed Nov 2016.

5. CADTH. CADTH Consultation – Drugs for Rare Diseases, CDR Update – Issue 94. Available from: https://www.cadth.ca/cdr-update-issue-94 . Accessed Apr 2016

6. CADTH. Update on the CADTH approach to the review of drugs for rare diseases and integration of these reviews into the CADTH Common Drug Review process, CDR Update – Issue 103. Available from: https://www.cadth.ca/cdr-update-issue-103 . Accessed Apr 2016.

7. Orphanet Report Series - Prevalence of rare diseases: Bibliographic data - July 2015 - Number 2. http://www.orpha.net/orphacom/cahiers/docs/GB/Prevalence_of_rare_diseases_by_decreasing_prevalence_or_cases.pdf . Last Accessed Jan 2016.

8. CADTH. Common Drug Review Reimbursement recommendations Options and Deliberative Framework — effective November 21, 2012, CDR Update – Issue 83. Available from: https://www.cadth.ca/cdr-update-issue-83 . Accessed Apr 2016.

9. The Global Gene Project. RARE Diseases: Facts and Statistics. Available from: https://globalgenes.org/rare-diseases-facts-statistics/ . Accessed Apr 2016 CADTH. CADTH Consultation – Drugs for Rare Diseases, CDR Update – Issue 94. Available from: https://www.cadth.ca/cdr-update-issue-94 . Accessed Apr 2016

10. Hadjivasiliou A. Orphan drug report 2014. Available from: http://info.evaluategroup.com/rs/evaluatepharmaltd/images/2014OD.pdf . Accessed Apr 2016.

11. Canadian Organization for Rare Disorders (CORD). We believe that now is the time to act to provide hope and treatment to Canadians and their families who are impacted by a rare disease. Available from: https://www.raredisorders.ca/our-work/ . Accessed Apr 2016.

12. CADTH. Recommendation Framework for CADTH Common Drug Review and pan-Canadian Oncology Drug Review Programs. Ottawa; CADTH; 2016 Mar. Available from: https://www.cadth.ca/media/cdr/templates/pre-sub-phase/CDR_pCODR_recommendations_framework.pdf . Accessed Apr 2016.