Randomized Controlled Trials and real life studies. Approaches and methodologies: a clinical point of view

Abstract

Randomized Controlled Trials (RCTs) are the "gold standard" for evaluating treatment outcomes providing information on treatments "efficacy". They are designed to test a therapeutic hypothesis under optimal setting in the absence of confounding factors. For this reason they have high internal validity. The strict and controlled conditions in which they are conducted, leads to low generalizability because they are performed in conditions very different from real life usual care. Conversely, real life studies inform on the "effectiveness" of a treatment, that is, the measure of the extent to which an intervention does what is intended to do in routine circumstances. At variance to RCTs, real life trials have high generalizability, but low internal validity. Recently the number of real life studies has been rapidly growing in different areas of respiratory medicine, particularly in asthma and COPD. The role of such studies is becoming a hot topic in respiratory medicine, attracting research interest and debate. In the first part of this review we discuss some of the advantages and disadvantages of different types of RCTs and analyze the strengths and weaknesses of real life trials, considering the recent examples of some studies conducted in COPD. We then discuss methodological approaches and options to overcome some of the limitations of real life studies. Comparing the conclusions of effectiveness and efficacy trials can provide important pieces of information. Indeed, these approaches can result complementary, and they can guide the interpretation of each other results.