Medical research
Medical research (or biomedical research), also known as experimental medicine, encompasses a wide array of research, extending from "basic research" (also called bench science or bench research),[1] – involving fundamental scientific principles that may apply to a preclinical understanding – to clinical research, which involves studies of people who may be subjects in clinical trials. Within this spectrum is applied research, or translational research, conducted to expand knowledge in the field of medicine.
Both clinical and preclinical research phases exist in the pharmaceutical industry's drug development pipelines, where the clinical phase is denoted by the term clinical trial. However, only part of the clinical or preclinical research is oriented towards a specific pharmaceutical purpose. The need for fundamental and mechanism-based understanding, diagnostics, medical devices, and non-pharmaceutical therapies means that pharmaceutical research is only a small part of medical research.
The increased longevity of humans over the past century can be significantly attributed to advances resulting from medical research. Among the major benefits of medical research have been vaccines for measles and polio, insulin treatment for diabetes, classes of antibiotics for treating a host of maladies, medication for high blood pressure, improved treatments for AIDS, statins and other treatments for atherosclerosis, new surgical techniques such as microsurgery, and increasingly successful treatments for cancer. New, beneficial tests and treatments are expected as a result of the Human Genome Project. Many challenges remain, however, including the appearance of antibiotic resistance and the obesity epidemic.
Most of the research in the field is pursued by biomedical scientists, but significant contributions are made by other type of biologists. Medical research on humans has to strictly follow the medical ethics sanctioned in the Declaration of Helsinki and hospital review board where the research is conducted. In all cases, research ethics are expected.
Phases of medical research
Basic medical research
Example areas in basic medical research include: cellular and molecular biology, medical genetics, immunology, neuroscience, and psychology. Researchers, mainly in universities or government-funded research institutes, aim to establish an understanding of the cellular, molecular and physiological mechanisms of human health and disease.
Pre-clinical research
Pre-clinical research covers understanding of mechanisms that may lead to clinical research with people. Typically, the work requires no ethical approval, is supervised by scientists rather than physicians, and is carried out in a university or company, rather than a hospital.
Clinical research
Clinical research is carried out with people as the experimental subjects. It is generally supervised by physicians and conducted by nurses in a medical setting, such as a hospital or research clinic, and requires ethical approval.
Funding
Region | Total | Public | Industry |
---|---|---|---|
United States | 119.3 | 48.9 | 70.4 |
Canada | 5.3 | 3.3 | 2.0 |
Europe | 81.8 | 28.1 | 53.6 |
Asia-Oceania | 62.0 | 19.3 | 42.7 |
Total | 268.4 |
Research funding in many countries derives from research bodies and private organizations which distribute money for equipment, salaries, and research expenses. United States, Europe, Asia, Canada, and Australia combined spent $265.0 billion in 2011, which reflected growth of 3.5% annually from $208.8 billion in 2004.[3] The United States contributed 49% of governmental funding from these regions in 2011 compared to 57% in 2004.[3]
In the United Kingdom, funding bodies such as the National Institute for Health and Care Research (NIHR) and the Medical Research Council derive their assets from UK tax payers, and distribute revenues to institutions by competitive research grants. The Wellcome Trust is the UK's largest non-governmental source of funds for biomedical research and provides over £600 million per year in grants to scientists and funds for research centres.[4]
In the United States, data from ongoing surveys by the National Science Foundation (NSF) show that federal agencies provided only 44% of the $86 billion spent on basic research in 2015.[5] The National Institutes of Health and pharmaceutical companies collectively contribute $26.4 billion and $27 billion, which constitute 28% and 29% of the total, respectively. Other significant contributors include biotechnology companies ($17.9 billion, 19% of total), medical device companies ($9.2 billion, 10% of total), other federal sources, and state and local governments. Foundations and charities, led by the Bill and Melinda Gates Foundation, contributed about 3% of the funding. These funders are attempting to maximize their return on investment in public health.[6] One method proposed to maximize the return on investment in medicine is to fund the development of open source hardware for medical research and treatment.[7]
The enactment of orphan drug legislation in some countries has increased funding available to develop drugs meant to treat rare conditions, resulting in breakthroughs that previously were uneconomical to pursue.
Government-funded biomedical research
Since the establishment of the National Institutes of Health (NIH) in the mid-1940s, the main source of U.S. federal support of biomedical research, investment priorities and levels of funding have fluctuated. From 1995 to 2010, NIH support of biomedical research increased from 11 billion to 27 billion [8] Despite the jump in federal spending, advancements measured by citations to publications and the number of drugs passed by the FDA remained stagnant over the same time span.[9] Financial projections indicate federal spending will remain constant in the near future.[9]
US federal funding trends
The National Institutes of Health (NIH) is the agency that is responsible for management of the lion's share of federal funding of biomedical research.[8] It funds over 280 areas directly related to health.[10] Over the past century there were two notable periods of NIH support. From 1995 to 1996 funding increased from $8.877 billion to $9.366 billion,[11] years which represented the start of what is considered the "doubling period" of rapid NIH support.[8] The second notable period started in 1997 and ended in 2010, a period where the NIH moved to organize research spending for engagement with the scientific community.[11]
Privately (industry) funded biomedical research
Since 1980 the share of biomedical research funding from industry sources has grown from 32% to 62%,[12] which has resulted in the development of numerous life-saving medical advances. The relationship between industry and government-funded research in the US has seen great movement over the years. The 1980 Bayh–Dole Act was passed by Congress to foster a more constructive relationship between the collaboration of government and industry funded biomedical research. The Bayh Doyle Act gave private corporations the option of applying for government funded grants for biomedical research which in turn allowed the private corporations to license the technology.[13] Both government and industry research funding increased rapidly from between the years of 1994–2003; industry saw a compound average annual growth rate of 8.1% a year and slowed only slightly to a compound average annual growth rate of 5.8% from 2003 to 2008.[14]
Conflicts of interests
"Conflict of interest" in the field of medical research has been defined as "a set of conditions in which professional judgment concerning a primary interest (such as a person's welfare or the validity of research) tends to be unduly influenced by a secondary interest (such as financial gain)."[15]
Regulation on industry funded biomedical research has seen great changes since Samuel Hopkins Adams declaration. In 1906 congress passed the Pure Food and Drugs Act of 1906.[16] In 1912 Congress passed the Shirley Amendment to prohibit the wide dissemination of false information on pharmaceuticals.[16] The Food and Drug Administration was formally created in 1930 under the McNarey Mapes Amendment to oversee the regulation of Food and Drugs in the United States.[16] In 1962 the Kefauver-Harris Amendments to the Food, Drug and Cosmetics Act made it so that before a drug was marketed in the United States the FDA must first approve that the drug was safe.[16] The Kefauver-Harris amendments also mandated that more stringent clinical trials must be performed before a drug is brought to the market.[17] The Kefauver-Harris amendments were met with opposition from industry due to the requirement of lengthier clinical trial periods that would lessen the period of time in which the investor is able to see return on their money. In the pharmaceutical industry patents are typically granted for a 20-year period of time, and most patent applications are submitted during the early stages of the product development.[17] According to Ariel Katz on average after a patent application is submitted it takes an additional 8 years before the FDA approves a drug for marketing.[17] As such this would leave a company with only 12 years to market the drug to see a return on their investments. After a sharp decline of new drugs entering the US market following the 1962 Kefauver-Harris amendments economist Sam Petlzman concluded that cost of loss of innovation was greater than the savings recognized by consumers no longer purchasing ineffective drugs.[17] In 1984 the Hatch-Waxman Act or the Drug Price Competition and Patent Term Restoration Act of 1984 was passed by congress.[16] The Hatch-Waxman Act was passed with the idea that giving brand manufacturers the ability to extend their patent by an additional 5 years would create greater incentives for innovation and private sector funding for investment.[18]
The relationship that exists with industry funded biomedical research is that of which industry is the financier for academic institutions which in turn employ scientific investigators to conduct research. A fear that exists wherein a project is funded by industry is that firms might negate informing the public of negative effects to better promote their product.[17] A list of studies shows that public fear of the conflicts of interest that exist when biomedical research is funded by industry can be considered valid after a 2003 publication of "Scope and Impact of Financial Conflicts of Interest in Biomedical Research" in The Journal of American Association of Medicine. This publication included 37 different studies that met specific criteria to determine whether or not an academic institution or scientific investigator funded by industry had engaged in behavior that could be deduced to be a conflict of interest in the field of biomedical research. Survey results from one study concluded that 43% of scientific investigators employed by a participating academic institution had received research related gifts and discretionary funds from industry sponsors.[12] Another participating institution surveyed showed that 7.6% of investigators were financially tied to research sponsors, including paid speaking engagements (34%), consulting arrangements (33%), advisory board positions (32%) and equity (14%).[12] A 1994 study concluded that 58% out of 210 life science companies indicated that investigators were required to withhold information pertaining to their research as to extend the life of the interested companies' patents.[12] Rules and regulations regarding conflict of interest disclosures are being studied by experts in the biomedical research field to eliminate conflicts of interest that could possibly affect the outcomes of biomedical research.
Transparency laws
Two laws which are both still in effect, one passed in 2006 and the other in 2010, were instrumental in defining funding reporting standards for biomedical research, and defining for the first time reporting regulations that were previously not required. The 2006 Federal Funding Accountability and Transparency Act mandates that all entities receiving over $25,000 in federal funds must report annual spending reports, including disclosure of executive salaries.[19] The 2010 amendment to the act mandates that progress reports be submitted along with financial reporting.[19] Data from the federal mandate is managed and made publicly available on usaspending.gov.[19] Aside from the main source, usaspending.gov, other reporting mechanisms exist: Data specifically on biomedical research funding from federal sources is made publicly available by the National Health Expenditure Accounts (NHEA), data on health services research, approximately 0.1% of federal funding on biomedical research, is available through the Coalition of Health Services Research, the Agency for Healthcare Research and Quality, the Centers for Disease Control and Prevention, the Centers for Medicare & Medicaid Services, and the Veterans Health Administration.[20]
Currently, there are not any funding reporting requirements for industry sponsored research, but there has been voluntary movement toward this goal.[21] In 2014, major pharmaceutical stakeholders such as Roche and Johnson and Johnson have made financial information publicly available and Pharmaceutical Research and Manufacturers of America (PhRMA), the most prominent professional association for biomedical research companies, has recently begun to provide limited public funding reports.[21]
History
Ancient to 20th century in other regions
The earliest narrative describing a medical trial is found in the Book of Daniel, which says that Babylonian king Nebuchadnezzar ordered youths of royal blood to eat only red meat and wine for three years, while another group of youths ate only beans and water.[22] The experiment was intended to determine if a diet of vegetables and water was healthier than a diet of wine and red meat. At the experiment endpoint, the trial accomplished its prerogative: the youths who ate only beans and water were noticeably healthier.[22] Scientific curiosity to understand health outcomes from varying treatments has been present for centuries, but it was not until the mid-19th century when an organizational platform was created to support and regulate this curiosity. In 1945, Vannevar Bush said that biomedical scientific research was "the pacemaker of technological progress", an idea which contributed to the initiative to found the National Institutes of Health (NIH) in 1948, a historical benchmark that marked the beginning of a near century substantial investment in biomedical research.[23]
20th and 21st century in the United States
The NIH provides more financial support for medical research than any other agency in the world to date and claims responsibility for numerous innovations that have improved global health.[23] The historical funding of biomedical research has undergone many changes over the past century. Innovations such as the polio vaccine, antibiotics and antipsychotic agents, developed in the early years of the NIH lead to social and political support of the agency. Political initiatives in the early 1990s lead to a doubling of NIH funding, spurring an era of great scientific progress.[24] There have been dramatic changes in the era since the turn of the 21st century to date; roughly around the start of the century, the cost of trials dramatically increased while the rate of scientific discoveries did not keep pace.[24]
Biomedical research spending increased substantially faster than GDP growth over the past decade in the US, between the years of 2003 and 2007 spending increased 14% per year, while GDP growth increased 1% over the same period (both measures adjusted for inflation).[20] Industry, not-for-profit entities, state and federal funding spending combined accounted for an increase in funding from $75.5 billion in 2003 to $101.1 billion in 2007.[20] Due to the immediacy of federal financing priorities and stagnant corporate spending during the recession, biomedical research spending decreased 2% in real terms in 2008.[20] Despite an overall increase of investment in biomedical research, there has been stagnation, and in some areas a marked decline in the number of drug and device approvals over the same time period.[20]
As of 2010, industry sponsored research accounts for 58% of expenditures, NIH for 27% of expenditures, state governments for 5% of expenditures, non NIH-federal sources for 5% of expenditures and not-for-profit entities accounted for 4% of support.[20] Federally funded biomedical research expenditures increased nominally, 0.7% (adjusted for inflation), from 2003 to 2007.[20] Previous reports showed a stark contrast in federal investment, from 1994 to 2003, federal funding increased 100% (adjusted for inflation).[20]
The NIH manages the majority, over 85%, of federal biomedical research expenditures.[20] NIH support for biomedical research decreased from $31.8 billion in 2003, to $29.0 billion in 2007, a 25% decline (in real terms adjusted for inflation), while non-NIH federal funding allowed for the maintenance of government financial support levels through the era (the 0.7% four-year increase). Spending from industry-initiated research increased 25% (adjusted for inflation) over the same time period of time, from 2003 to 2007, an increase from $40 billion in 2003, to $58.6 billion in 2007.[20] Industry sourced expenditures from 1994 to 2003 showed industry sponsored research funding increased 8.1%, a stark contrast to 25% increase in recent years.[20]
Of industry sponsored research, pharmaceutical firm spending was the greatest contributor from all industry sponsored biomedical research spending, but only increased 15% (adjusted for inflation) from 2003 to 2007, while device and biotechnology firms accounted for the majority of the spending.[20] The stock performance, a measure that can be an indication of future firm growth or technological direction, has substantially increased for both predominantly medical device and biotechnology producers.[20] Contributing factors to this growth are thought to be less rigorous FDA approval requirements for devices as opposed to drugs, lower cost of trials, lower pricing and profitability of products and predictable influence of new technology due to a limited number of competitors.[20] Another visible shift during the era was a shift in focus to late stage research trials; formerly dispersed, since 1994 an increasingly large portion of industry-sponsored research was late phase trials rather than early-experimental phases now accounting for the majority of industry sponsored research.[20] This shift is attributable to a lower risk investment and a shorter development to market schedule.[20] The low risk preference is also reflected in the trend of large pharmaceutical firms acquiring smaller companies that hold patents to newly developed drug or device discoveries which have not yet passed federal regulation (large companies are mitigating their risk by purchasing technology created by smaller companies in early-phase high-risk studies).[20] Medical research support from universities increased from $22 billion in 2003 to $27.7 billion in 2007, a 7.8% increase (adjusted for inflation).[20] In 2007 the most heavily funded institutions received 20% of HIN medical research funding, and the top 50 institutions received 58% of NIH medical research funding, the percent of funding allocated to the largest institutions is a trend which has increased only slightly over data from 1994.[20] Relative to federal and private funding, health policy and service research accounted for a nominal amount of sponsored research; health policy and service research was funded $1.8 billion in 2003, which increased to $2.2 billion in 2008.[20]
Stagnant rates of investment from the US government over the past decade may be in part attributable to challenges that plague the field. To date, only two-thirds of published drug trial findings have results that can be re-produced,[25] which raises concerns from a US regulatory standpoint where great investment has been made in research ethics and standards, yet trial results remain inconsistent. Federal agencies have called upon greater regulation to address these problems; a spokesman from the National Institute of Neurological Disorders and Stroke, an agency of the NIH, stated that there is "widespread poor reporting of experimental design in articles and grant applications, that animal research should follow a core set of research parameters, and that a concerted effort by all stakeholders is needed to disseminate best reporting practices and put them into practice".[25]
Regulations and guidelines
Medical research is highly regulated. National regulatory authorities are appointed in most countries to oversee and monitor medical research, such as for the development and distribution of new drugs. In the United States, the Food and Drug Administration oversees new drug development; in Europe, the European Medicines Agency (see also EudraLex); and in Japan, the Ministry of Health, Labour and Welfare. The World Medical Association develops the ethical standards for medical professionals involved in medical research. The most fundamental of them is the Declaration of Helsinki. The International Conference on Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH) works on the creation of rules and guidelines for the development of new medication, such as the guidelines for Good Clinical Practice (GCP). All ideas of regulation are based on a country's ethical standards code. This is why treatment of a particular disease in one country may not be allowed, but is in another.
Flaws and vulnerabilities
A major flaw and vulnerability in biomedical research appears to be the hypercompetition for the resources and positions that are required to conduct science. The competition seems to suppress the creativity, cooperation, risk-taking, and original thinking required to make fundamental discoveries. Other consequences of today's highly pressured environment for research appear to be a substantial number of research publications whose results cannot be replicated, and perverse incentives in research funding that encourage grantee institutions to grow without making sufficient investments in their own faculty and facilities.[26][27][28][29][30] Other risky trends include a decline in the share of key research grants going to younger scientists, as well as a steady rise in the age at which investigators receive their first funding.[31]
Commercialization
After clinical research, medical therapies are typically commercialized by private companies such as pharmaceutical companies or medical device company. In the United States, one estimate found that in 2011, one-third of Medicare physician and outpatient hospital spending was on new technologies unavailable in the prior decade.[32]
Medical therapies are constantly being researched, so the difference between a therapy which is investigational versus standard of care is not always clear, particularly given cost-effectiveness considerations.[33] Payers have utilization management clinical guidelines which do not pay for "experimental or investigational" therapies, or may require that the therapy is medically necessary or superior to cheaper treatments. For example, proton therapy was approved by the FDA, but private health insurers in the United States considered it unproven or unnecessary given its high cost, although it was ultimately covered for certain cancers.[34]
Fields of research
Fields of biomedical research include:
- Aging
- Anatomy
- Behavioral health
- Biochemistry
- Biomaterials
- Biology
- Cardiovascular
- Biostatistics
- Cancer
- Chemistry
- Diabetes
- Endocrinology
- Epigenetics
- Epidemiology
- Genetics
- Immunology
- Microbiology
- Nanomaterials
- Neuroendocrinology
- Neuroscience
- Ophthalmology
- Pharmacology
- Physiology
- Preventive medicine
- Psychopharmacology
- Public health
- Tissue engineering
- Virology
- Otolaryngology
- Toxicology
- Angiology
- Palliative medicine
See also
- Animal testing
- Biomedical informatics
- Biomedical research in the United States
- Biomedical technology
- Biomedicine
- Cancer research
- Gain-of-function research
- Medical research scientist
- Medical Scientist Training Program
- Pharmaceutical company
- Preclinical imaging
- Title 21 of the Code of Federal Regulations (US)
References
- "Basic Science". aamc.org. Association of American Medical Colleges. 2016. Retrieved 12 Aug 2016.
- Chakma J, Sun GH, Steinberg JD, Sammut SM, Jagsi R (January 2014). "Asia's ascent--global trends in biomedical R&D expenditures". The New England Journal of Medicine. 370 (1): 3–6. doi:10.1056/NEJMp1311068. PMID 24382062.
- Moses, Hamilton; Matheson, David H. M.; Cairns-Smith, Sarah; George, Benjamin P.; Palisch, Chase; Dorsey, E. Ray (2015-01-13). "The Anatomy of Medical Research: US and International Comparisons". JAMA. 313 (2): 174–89. doi:10.1001/jama.2014.15939. ISSN 0098-7484. PMID 25585329.
- "Henry Wellcome: from backwoods boy to medicine man". The Guardian. 9 January 2011. Retrieved 12 June 2011.
- Mervis J (9 March 2017). "Data check: U.S. government share of basic research funding falls below 50%". Science | AAAS.
- Buchsbaum S. "How Do We Measure The Impact of Grand Challenges". Impatient Optimists. Retrieved 2018-03-10.
- Pearce JM (2017). "Maximizing returns for public funding of medical research with open-source hardware". Health Policy and Technology. 6 (4): 381–382. doi:10.1016/j.hlpt.2017.09.001. S2CID 168891532.
- "National Institutes of Health (NIH)". nih.gov.
- Frist WH (April 2002). "Federal funding for biomedical research: commitment and benefits". JAMA. 287 (13): 1722–4. doi:10.1001/jama.287.13.1722. PMID 11926898.
- "NIH Categorical Spending -NIH Research Portfolio Online Reporting Tools (RePORT)". report.nih.gov. Retrieved 2018-03-10.
- Steinbrook R (April 2009). "The NIH stimulus--the recovery act and biomedical research". The New England Journal of Medicine. 360 (15): 1479–81. doi:10.1056/NEJMp0901819. PMID 19357402.
- Bekelman JE, Li Y, Gross CP (22 January 2003). "Scope and impact of financial conflicts of interest in biomedical research: a systematic review". JAMA. 289 (4): 454–65. doi:10.1001/jama.289.4.454. PMID 12533125.
- Loffler A, Stern S. "The Future of the Biomedical Industry in an Era of Globalization" (PDF).
- Dorsey ER, de Roulet J, Thompson JP, Reminick JI, Thai A, White-Stellato Z, Beck CA, George BP, Moses H (January 2010). "Funding of US biomedical research, 2003–2008". JAMA. 303 (2): 137–43. doi:10.1001/jama.2009.1987. PMC 3118092. PMID 20068207.
- Thompson DF (August 1993). "Understanding financial conflicts of interest". The New England Journal of Medicine. 329 (8): 573–6. CiteSeerX 10.1.1.466.1945. doi:10.1056/nejm199308193290812. PMID 8336759.
- "Significant Dates in U.S. Food and Drug Law History". U.S. Food and Drug Administration. Archived from the original on 4 February 2017.
- Katz A. "Pharmaceutical Lemons: Innovation and Regulation in the Drug Industry" (PDF). Archived from the original (PDF) on 2014-12-28.
- Rumore M (August 15, 2009). "The Hatch-Waxman Act--25 Years Later: Keeping the Pharmaceutical Scales Balanced". Generic Supplements. August 2009.
- "Requirements for Federal Funding Accountability and Transparency Act Implementation". hrsa.gov. 2017-04-13.
- Dorsey ER, de Roulet J, Thompson JP, Reminick JI, Thai A, White-Stellato Z, Beck CA, George BP, Moses H (January 2010). "Funding of US biomedical research, 2003–2008". JAMA. 303 (2): 137–43. doi:10.1001/jama.2009.1987. PMC 3118092. PMID 20068207.
- "Industry and Non-Profits Join Forces to Accelerate Discovery of Therapies for Alzheimer's, Diabetes, RA, and Lupus". policymed.com.
- Collier R (January 2009). "Legumes, lemons and streptomycin: a short history of the clinical trial". CMAJ. 180 (1): 23–4. doi:10.1503/cmaj.081879. PMC 2612069. PMID 19124783.
- "Basic Research: the pacemaker of progress". scienceguide.nl/. 2012-12-06.
- Johnson J (December 23, 2013). "Brief History of NIH Funding: Fact Sheet" (PDF).
- "Improving Reproducibility and Transparency in Biomedical Research". drugabuse.gov. 2013-09-12.
- Alberts B, Kirschner MW, Tilghman S, Varmus H (April 2014). "Rescuing US biomedical research from its systemic flaws". Proceedings of the National Academy of Sciences of the United States of America. 111 (16): 5773–7. Bibcode:2014PNAS..111.5773A. doi:10.1073/pnas.1404402111. PMC 4000813. PMID 24733905.
- Kolata G (April 23, 2009). "Advances Elusive in the Drive to Cure Cancer". The New York Times. Retrieved 2009-12-29.
- Kolata G (June 27, 2009). "Grant System Leads Cancer Researchers to Play It Safe". The New York Times. Retrieved 2009-12-29.
- Leaf C (2004-03-22). "Why We're Losing The War On Cancer". Fortune Magazine (CNN Money).
- Powell K (October 2016). "Young, talented and fed-up: scientists tell their stories". Nature. 538 (7626): 446–449. Bibcode:2016Natur.538..446P. doi:10.1038/538446a. PMID 27786221. S2CID 4465686.
- Daniels RJ (January 2015). "A generation at risk: young investigators and the future of the biomedical workforce". Proceedings of the National Academy of Sciences of the United States of America. 112 (2): 313–8. doi:10.1073/pnas.1418761112. PMC 4299207. PMID 25561560.
- Frakt A, Bagley N, Chandra A (2005-10-07). "Correcting signals for innovation in health care". Brookings. Retrieved 2019-05-20.
- Moses RE, Feld AD (January 2008). "Legal risks of clinical practice guidelines". The American Journal of Gastroenterology. 103 (1): 7–11. doi:10.1111/j.1572-0241.2007.01399.x. PMID 18184116. S2CID 11802118.
- Bekelman JE, Denicoff A, Buchsbaum J (August 2018). "Randomized Trials of Proton Therapy: Why They Are at Risk, Proposed Solutions, and Implications for Evaluating Advanced Technologies to Diagnose and Treat Cancer". Journal of Clinical Oncology. 36 (24): 2461–2464. doi:10.1200/JCO.2018.77.7078. PMC 6366815. PMID 29985746.