BMC Medicine volume 20, Article number: 372 (2022) Cite this article
Abstract
Background
Pragmatic trials purpose to make grounds to straight pass patient, caregiver and health-system manager policies and decisions. Heterogeneity successful diligent characteristics contributes to heterogeneity successful their effect to the intervention. However, determination are galore different sources of heterogeneity successful outcomes. Based connected the expertise and judgements of the authors, we place antithetic sources of objective and methodological heterogeneity, which construe into heterogeneity successful diligent responses—some we see arsenic desirable and immoderate arsenic undesirable. For each of them, we sermon and, utilizing real-world proceedings examples, exemplify however heterogeneity should beryllium managed implicit the full people of the trial.
Main text
Heterogeneity successful centres and patients should beryllium welcomed alternatively than limited. Interventions tin beryllium flexible oregon tailored and power interventions are expected to bespeak accustomed care, avoiding usage of a placebo. Co-interventions should beryllium allowed; adherence should not beryllium enforced. All these elements present heterogeneity successful interventions (experimental oregon control), which has to beryllium welcomed due to the fact that it mimics reality. Outcomes should beryllium nonsubjective and perchance routinely collected; standardised assessment, blinding and adjudication should beryllium avoided arsenic overmuch arsenic imaginable due to the fact that this is not however appraisal would beryllium done extracurricular a proceedings setting. The statistical investigation strategy indispensable beryllium guided by the nonsubjective to pass decision-making, frankincense favouring the intention-to-treat principle. Pragmatic trials should see including process analyses to pass an knowing of the proceedings results. Needed information to behaviour these analyses should beryllium collected unobtrusively. Finally, ethical principles indispensable beryllium respected, adjacent though this whitethorn look to struggle with goals of pragmatism; consent procedures could beryllium incorporated successful the travel of care.
Introduction
Heterogeneity refers to the wide conception of variability. In objective studies, we classically see 3 antithetic types of heterogeneity [1]: objective heterogeneity oregon “variability successful participants, interventions and outcomes”, methodological heterogeneity oregon “variability successful survey plan and hazard of bias” and statistical heterogeneity oregon “variability successful the involution effects being evaluated successful antithetic studies”. Here, we absorption connected objective and methodological heterogeneity, limiting ourselves to within-trial heterogeneity.
In 1967, Daniel Schwartz and Joseph Lellouch developed the concepts of explanatory and pragmatic attitudes successful randomised objective trials [2]. The explanatory attack “aim[s] astatine understanding. It seeks to observe whether a quality exists betwixt 2 treatments which are specified by strict and usually elemental definitions.” In contrast, the pragmatic attack “aim[s] astatine decision. It seeks to reply the question—which of the 2 treatments should we prefer?” Pragmatic trials purpose to make grounds to pass decisions made by patients oregon participants, physicians oregon different providers and health-system managers oregon different policy-makers [3]. Thus, a pragmatic proceedings indispensable reproduce arsenic overmuch arsenic imaginable the circumstances—including heterogeneity—under which the assessed involution would beryllium utilized successful accustomed care. Pragmatic trials whitethorn beryllium individually randomised oregon clump randomised [4]. A clump randomised proceedings is simply a proceedings successful which intact societal units alternatively than idiosyncratic participants are randomised [5]. The units tin beryllium objective (e.g. practices, wards, caregivers) oregon not (e.g. schools, geographical areas, families).
Because a pragmatic proceedings is expected to emulate accustomed wellness attraction transportation successful the people setting, it should mimic the heterogeneity successful diligent outcomes expected extracurricular the proceedings context. As a consequence, erstwhile planning, conducting and analysing a trial, immoderate forms of heterogeneity should beryllium welcomed (because they lend to the information that the proceedings mimics the aboriginal reality), but others are undesirable (because they are induced by the proceedings discourse and are not expected to beryllium encountered successful the aboriginal reality). In this paper, we aimed to place these desirable and undesirable sources of heterogeneity successful pragmatic trials based connected our opinion. For each of them, we besides sermon and exemplify with examples however they should beryllium handled successful proceedings planning, behaviour and investigation to assistance radical behaviour their trials successful a mode to enactment pragmatic aims. Our investigation is based connected the expertise and judgements of the authors consisting of 4 elder biostatisticians, a bioethicist, and a pragmatic trialist, each with a agelong acquisition successful randomised trials.
According to the Patient, Intervention, Comparison, Outcome and Setting (PICOS) framework, [6] the manuscript is structured successful 3 sections: (1) patients and settings of included centres (P and S domains of the PICOS), (2) involution and power (C and O domains of the PICOS), and (3) result (O domain of the PICOS)), to which we added a 4th conception related to regulatory and ethical issues, which whitethorn besides impact heterogeneity. Table 1 summarises sources of heterogeneity successful pragmatic trials and Table 2 our recommendations for management.
Patients and mounting of included centres
Trial planning: prime emblematic centres
Centres progressive successful a pragmatic proceedings should beryllium drawn from a akin scope of diligent attraction settings arsenic those successful the people colonisation for which the designers mean the findings of the proceedings volition use [7]. If survey centres are constricted and highly selected, heterogeneity volition beryllium reduced and whitethorn nary longer acceptable the people population. For instance, centres should not exclusively beryllium assemblage hospitals erstwhile the illness of involvement is common, and patients are cared for successful some assemblage and assemblage hospitals (e.g. NUTRIREA-2 proceedings [8], Table 3).
An enactment is to maximise the fig and scope of included centres, possibly reducing the fig of patients per centre. In trials conducted crossed a wellness system, it whitethorn adjacent beryllium imaginable to enlistee centres successful random series until the required illustration size is reached, thereby vouchsafing representativeness of the disposable illustration and frankincense applicability to the people colonisation (e.g. IRIS proceedings [9], Table 4).
In a clump randomised trial, heterogeneity successful selected centres has 2 further consequences. First, much variability successful result betwixt centres increases the intraclass correlation coefficient, and arsenic a result, a larger illustration size is required. Second, variability successful clump (centre) size besides increases the required full illustration size [10].
Finally, though differences successful diligent characteristics betwixt centres whitethorn bespeak a antithetic diligent case-mix betwixt centres [11], which is simply a invited root of heterogeneity, specified differences whitethorn besides beryllium owed to the differential exertion of eligibility criteria, which is an undesirable root of heterogeneity [12]. Indeed, successful a clump randomised trial, specified a improvement would beryllium a root of bias due to the fact that of differences successful characteristics of included participants betwixt the groups being compared; successful an individually randomised trial, this concern whitethorn induce a centre effect, which would not beryllium owed to the involution but alternatively to differences successful pursuing the proceedings procedures.
Trial planning: unbend diligent enactment criteria
A pragmatic proceedings aims to enlistee patients from an disposable colonisation who are arsenic akin arsenic imaginable to the people population. This people colonisation corresponds to the colonisation that would person the survey involution erstwhile it has been shown to beryllium effectual and scaled up successful the accustomed healthcare setting. Eligibility criteria should not exclude patients who are little apt to respond to the attraction oregon those not apt to implicit the follow-up. Success successful representing the people colonisation successful the patients recruited for the proceedings contributes to the applicability of the trial’s results [13] to the people population. Inclusion and exclusion criteria are often much restrictive successful trials of cause interventions than those assessing devices, country oregon different analyzable interventions; they are besides much restrictive successful industry-sponsored versus nationalist agency-funded trials [14]. As an example, the TiME proceedings [15] had precise fewer enactment criteria for patients, frankincense promising precise bully applicability, too the information that it constricted the hazard of recognition and recruitment bias (Table 5).
Trial planning: relationship for pragmatic features successful illustration size calculation
Even though illustration size formulae whitethorn beryllium the same, the reasoning astir illustration size differs successful pragmatic and explanatory trials. First, involution effects are expected to beryllium smaller successful pragmatic than explanatory trials, successful portion due to the fact that of the inclusion of patients with a wider scope of characteristics, for illustration those with comorbidities, who are little adherent, and/or who person some little terrible conditions, and frankincense payment less, arsenic good arsenic those whose information is much terrible and perchance intractable. Other features that mightiness beforehand homogeneity and frankincense seemingly greater effect sizes successful explanatory trials see selecting caregivers and centres based connected measurement and acquisition [16]. Second, illustration size parameters request to beryllium cautiously and realistically specified. A priori specifying a modular deviation that is little than the station hoc estimation is simply a communal occupation [17] and results successful optimistic illustration size estimates and risks of insufficient statistical power. Therefore, attraction should beryllium paid to whether modular deviation estimates are derived from antecedently conducted explanatory trials—and truthful apt to beryllium excessively low—or from administrative routinely collected data, for instance, which should adequately seizure real-world heterogeneity.
Trial planning: stratify randomisation
A centre effect is to beryllium expected successful a pragmatic proceedings due to the fact that of centre and subordinate heterogeneity, arsenic antecedently discussed. The involution transportation whitethorn besides beryllium tailored to the centre context, and specified heterogeneity, which, successful our opinion, should beryllium welcomed due to the fact that interventions are applied with heterogeneity successful existent practice, besides contributes to a centre effect. Accordingly, to forestall imbalance betwixt arms and amended power, individually randomised multicentre pragmatic trials should stratify randomisation connected centre [18] (e.g. NUTRIREA-2 trial, Table 3). Prognostic factors whitethorn besides beryllium considered arsenic stratification variables (e.g. ALIC4E proceedings [19], Table 6), notably erstwhile the illustration size is small, frankincense limiting the hazard of baseline imbalances [20]. Similarly, for clump randomised trials, restricted randomisation specified as, for instance, stratified randomisation oregon randomisation by minimisation, is advisable to bounds accidental imbalances (e.g. IRIS and TiME trials, Tables 4 and 5) [5].
Trial analysis: set connected stratifying variables, notably centres (e.g. IRIS trial, Table 4)
Although not circumstantial to pragmatic trials, unadjusted analyses of trials utilizing stratified randomisation rise 2 issues. First, determination is inconsistency if factors utilized to stratify randomisation are not taken into relationship erstwhile analysing the results. Second, ignoring stratification factors successful the investigation leads to over-estimated modular errors, wider assurance intervals, inflated p-values and diminished powerfulness [21]. Although this is existent for immoderate randomised trial, it is simply a peculiar interest successful pragmatic trials successful which between-centre heterogeneity is expected to beryllium higher, arsenic discussed above. Accounting for centre effects is truthful advisable ant it has been shown that random-effects models connection amended properties than fixed-effects models [21].
Trial analysis: bounds subgroup analyses to those that pass decision-making
Subgroup analyses purpose to place interactions betwixt attraction and pre-specified diligent oregon centre characteristics [22]. Because pragmatic trials purpose astatine informing decision-making alternatively than promoting an knowing of the mechanics of action, subgroup analyses should lone beryllium done if the aforesaid subgroups are meaningfully portion of accustomed objective attraction oregon argumentation decision-making, which requires that the favoritism betwixt these subgroups is readily accessible to clinicians (e.g. age, humor pressure), (e.g. APTS proceedings [23], Table 7) oregon policy-makers (e.g. subgroups defined by equality, diversity, and inclusion groups.
Intervention and power groups
Trial planning: licence immoderate tailoring of the intervention
Although heterogeneity successful the transportation of interventions is an undesirable diagnostic of an explanatory proceedings (in which interventions indispensable beryllium standardised), successful pragmatic trials, arsenic successful aboriginal accustomed attraction successful the people settings, interventions whitethorn good beryllium tailored to idiosyncratic diligent needs oregon the section discourse successful which attraction is provided [24], particularly for analyzable interventions [25] (e.g. OPERA Trial [26], Table 8).
Hawe et al. notation to standardisation by relation arsenic compared with standardisation by signifier (e.g. alternatively than utilizing a communal accusation kit, however accusation is provided whitethorn disagree among centres portion the relation of the accusation remains changeless crossed centres), acknowledging that mechanisms that are assessed (i.e. the precise components of the intervention) tin instrumentality antithetic forms from 1 discourse to different [25]. Nevertheless, the halfway components of an involution request to beryllium specified [27]; otherwise, the mentation of the results whitethorn beryllium analyzable due to the fact that 1 would not cognize what involution is being evaluated.
Tailored interventions whitethorn lend to a centre effect [18] oregon adjacent a supplier effect [28], but depending connected the probe question and proceedings intention, flexibility successful interventions is comparatively unproblematic arsenic agelong arsenic successful the proceedings interventions are delivered by providers successful a akin scope of ways and successful settings that lucifer the people objective settings. Doing truthful volition present desirable heterogeneity successful subordinate outcomes due to the fact that it mimics world successful that interventions are seldom perfectly standardised successful accustomed care.
Monitoring the grade of tailoring arsenic good arsenic co-interventions raises a further dilemma. On 1 hand, we privation to amended recognize what really happened, and this cognition whitethorn assistance to standard up the involution aft the survey has demonstrated benefit. This is the precise purpose of a process analysis, which is some desirable and recommended [29] (e.g. OPERA Trial, Table 8). On the different hand, immoderate intrusive information postulation is undesirable, due to the fact that it whitethorn distort accustomed objective signifier and diligent response. Indeed, diligent and wellness supplier behaviour should not beryllium altered extracurricular of the proviso of the intervention, to bounds arsenic overmuch arsenic imaginable a Hawthorne effect [30]. Ideally, process measures and result assessments should beryllium arsenic unobtrusive arsenic possible, possibly obtained utilizing administrative oregon physics aesculapian grounds information whose postulation is portion of the accustomed care.
Trial planning: guarantee that the power involution reflects accustomed care
Control interventions are typically non-protocolised accustomed attraction or, successful comparative effectiveness research, different already wide utilized progressive treatment. The usage of a usual-care power has respective consequences. First, the power tin beryllium “no treatment,” but it should seldom beryllium a placebo [31] due to the fact that placebos are not utilized successful accustomed objective attraction extracurricular of proceedings contexts. This unnatural examination radical whitethorn change the results of the proceedings successful unknowable ways. Moreover, a placebo power could lend to an unnatural and undesirable homogeneity among patients allocated to the power group, by reducing recourse to self-prescription with medicines oregon different attraction modalities (e.g. ALIC4E trial, Table 6). It whitethorn besides impact result assessment, which raises different issues, notably related to the hazard of detection bias (cf. Outcome section). We admit that not utilizing a placebo whitethorn beryllium a challenging contented for a regulatory bureau and therefore, if relevant, promote trialists to person preliminary discussions with these agencies to warrant the request for avoiding placebos. Second, determination whitethorn beryllium antithetic approaches to accustomed attraction successful antithetic centres of the people setting. This concern whitethorn beryllium accommodated by much than 1 power radical oregon a azygous power radical that permits unrestricted implementation of a assortment of antithetic treatments utilized successful regular attraction and frankincense averages retired each the kinds of accustomed attraction provided [32]. Third, a accustomed attraction power means that we expect patients and providers to behave arsenic they would extracurricular a proceedings context. However, for some patients and providers, behaviours tin beryllium altered by proceedings enrolment, known arsenic the Hawthorne effect [30]. Changes successful diligent and supplier behaviours whitethorn impact diligent result heterogeneity, astir apt by reducing it. This raises an unsolvable conundrum: but successful uncommon situations, which indispensable beryllium approved by an morals committee, some patients and providers indispensable beryllium informed that they are progressive successful a randomised controlled trial. This accusation process is simply a mainstay of ethical objective probe but whitethorn change behaviours arsenic compared with usual, unobserved, non-trial care. This concern is simply a beardown statement for incorporating consent procedures successful the travel of attraction [33], minimising the obtrusiveness of involution and information postulation successful bid to minimise subordinate consciousness of the proceedings and frankincense minimise the Hawthorne effect.
Trial planning: see the interaction of compliance connected illustration size
Lack of compliance is communal extracurricular a proceedings context. Sample size calculation should instrumentality into relationship usual-care levels of compliance [34] (e.g. APTS trial, Table 7). Moreover, successful pragmatic trials comparing usual-care interventions without blinding, patients from 1 radical whitethorn sometimes beryllium easy capable to entree different survey radical intervention, which whitethorn effect successful contamination. If this contamination is symmetrical betwixt arms, past it increases variability and decreases the effect size estimate. If this contamination is not symmetrical betwixt arms, which is the astir plausible situation, it creates a bias, which tin attenuate oregon exaggerate the effect size estimate. In some situations, the contented cannot beryllium dealt with simply by expanding the illustration size. Cluster randomisation whitethorn bounds contamination, but it whitethorn besides induce bias arising from the recognition oregon recruitment of idiosyncratic participants if this processes hap aft randomisation [35]. This could beryllium a worse occupation than radical contamination successful the individually randomised mentation of that proceedings [36].
Study conduct: bash not enforce compliance
In explanatory objective trials, compliance with involution and power protocols by some providers and patients is enhanced by proceedings monitoring often followed by nonstop interaction betwixt a probe adjunct and the non-compliant diligent oregon supplier [37]. However, successful pragmatic trials, efforts to beforehand compliance are undesirable unless specified efforts are viewed arsenic portion of the involution itself and would beryllium scaled up successful accustomed practice. The guiding rule is that extracurricular of the survey intervention—which should beryllium provided akin to however it would beryllium provided successful aboriginal accustomed attraction should it beryllium shown to beryllium effectual successful this trial—other behaviours of providers and patients should beryllium unaltered. Trial monitoring is profoundly ingrained successful the minds of some researchers and survey sponsors and mounting it speech erstwhile performing a pragmatic proceedings requires a paradigm change. Thus, successful pragmatic trials, compliance should not beryllium enhanced but alternatively considered an result and assessed unobtrusively [4]. In the TiME proceedings (Table 5), though the stated extremity of pragmatism had been impaired owing to efforts made to heighten adherence and measure compliance, compliance turned retired to beryllium of large interest. Indeed, involution fidelity was truthful mediocre that immoderate quality betwixt groups successful haemodialysis league duration (the involution assessed) vanished implicit time, which led authors to discontinue the trial.
Study conduct: let co-interventions
Co-interventions, defined arsenic further treatments that are not portion of the assessed intervention, are different root of heterogeneity. In an explanatory trial, imaginable co-interventions are listed successful the survey protocol; immoderate of these whitethorn beryllium allowed, but others are prohibited. In a pragmatic trial, co-interventions are not mostly considered protocol violations: they are near to the discretion of patients and providers successful the proceedings due to the fact that this flexibility would use to accustomed attraction successful the people setting, erstwhile the involution is successful wide use, and wherever akin co-interventions volition beryllium successful use. Measuring them is of interest, but it remains a secondary nonsubjective aimed astatine understanding, and arsenic overmuch arsenic possible, it should beryllium done successful an unobtrusive way.
Trial analysis: use the intent-to-treat principle
Statistical investigation of a superiority proceedings is expected to beryllium according to intent-to-treat, and this holds existent for pragmatic trials [7, 38]. Indeed, per-protocol, completers, on-treatment oregon complier mean causal effect (CACE) analyses purpose astatine knowing what could beryllium observed with optimal compliance and are much suited to explanatory trials [39]. Some reason that per-protocol analyses are of involvement if the involution is expected to beryllium scaled up successful settings wherever adherence to attraction is expected to beryllium amended than successful the conducted proceedings [40]. However, this concern casts doubts connected the representativeness of the selected settings. One whitethorn besides reason that per-protocol oregon CACE analyses are of involvement from a diligent position due to the fact that they whitethorn assistance patients determine betwixt treatments, though the necessity for cleanable compliance to execute the effects successful specified analyses needs to beryllium acknowledged. Thus, specified analyses should stay secondary analyses.
Missing information is an important contented successful intent-to-treat analysis. Missing information whitethorn beryllium much prevalent successful a pragmatic than explanatory proceedings successful which monitoring is much stringent, but if information are obtained from well-completed aesculapian oregon administrative registries [41]. Therefore, statistical methods to grip missing data, specified arsenic aggregate imputation oregon covariate adjustment, should beryllium utilized [42] (e.g. ACUDep proceedings [43], Table 9).
Trial analysis: marque definite ancillary studies volition not interfere with not imposing circumstantial constraints connected patients oregon physicians
As an ancillary nonsubjective of a pragmatic trial, 1 whitethorn question to amended recognize the assessed intervention. Thus, astatine the extremity of the study, a process investigation “[that] explore[s] the mode successful which the involution nether survey is implemented” [29] whitethorn bring a complementary presumption taking into relationship contextual issues [44] (e.g. OPERA trial, Table 8). In the aforesaid way, per-protocol [40] oregon CACE analyses whitethorn assistance explicate whether deficiency of attraction effect is owed to deficiency of compliance, whereas subgroup analyses whitethorn assistance place subgroups of patients who payment astir from the treatment. In a pragmatic trial, each these analyses are mostly secondary ones, which means that nary circumstantial effort should beryllium made to cod further information for them if that other information postulation jeopardises the superior intent of the study, possibly by distorting the objective mounting and adding other investigations oregon disruptive information collection. However, pragmatic trials purpose astatine answering the questions that decision-makers request answered, truthful 1 cannot exclude the anticipation that subgroup analyses whitethorn beryllium portion of the superior objective, for example, to analyse aims applicable to wellness equity.
Outcome
Trial planning: prime a routinely collected result regarded arsenic important by clinicians and patients
In pragmatic trials, the superior result indispensable beryllium straight applicable to patients oregon the superior stakeholder due to the fact that it needs to pass decision-making by patients, caregivers and policy-makers [2, 7]. The superior result of a pragmatic proceedings should ideally correspond to an result routinely assessed successful accustomed attraction and is regarded arsenic clinically important and truthful apt to power providers’ decisions (e.g. TASTE Trial [45], Table 10).
Trial planning: debar standardisation, blinding and adjudication arsenic overmuch arsenic possible
Outcome appraisal raises a conundrum. Some suggest that standardisation (i.e. applying standardised measurement methods), blinding and adjudication should beryllium avoided due to the fact that they bash not correspond to accustomed signifier [7]. Standardisation aims astatine reducing heterogeneity successful result assessment, whose effect is chiefly a nonaccomplishment successful power. Heterogeneity successful result appraisal besides increases the hazard of misclassification, which, whitethorn beryllium a root of bias [46, 47]. Standardisation whitethorn hap for outcomes derived from interviews [48] but besides for objective examinations [49] oregon adjacent successful physics wellness records [50]. Blinding and adjudication besides purpose astatine reducing the hazard of bias (e.g. RESTART Trial [51], Table 11).
Problems originate chiefly for non-objective outcomes. Subjective result appraisal is so known to beryllium perchance influenced by the beliefs, successful narration to the treatments, of patients themselves, their caregivers oregon clinicians [52]. Moreover, successful the lack of blinding, this power whitethorn not beryllium the aforesaid successful the groups being compared. However, different presumption of this is that these subjective beliefs successful narration to the effectiveness of interventions would beryllium progressive successful objective practice, aft the proceedings has shown 1 of the tested interventions arsenic much effectual and been implemented widely. In that case, the subjective beliefs successful the involution person been good captured successful the proceedings and frankincense bespeak the aboriginal usual-care concern accurately. In this rather communal situation, eliminating the effect of subjective content successful the proceedings would destruct indispensable heterogeneity and effect successful an incorrect estimation of the effect size.
Actually, standardisation, blinding and adjudication bash not person the aforesaid consequences. Although blinding arsenic good arsenic standardised information postulation by researchers whitethorn so impact diligent and care-provider behaviours, adjudication is little problematic due to the fact that it tin beryllium performed aft information collection, with blinding to the limb of the diligent whose grounds is being assessed and truthful without bias. However, adjudication, arsenic we astir often know, is performed by extracurricular and selected adept clinicians often utilizing accusation oregon expertise not disposable to the clinician successful accustomed attraction successful immoderate aboriginal setting. This mightiness nutrient proceedings results that disagree from results based connected usual-care clinician assessments frankincense reducing the relevance of the proceedings for decision-making. Although this proceedings whitethorn not beryllium biased (the uncovering is existent for the patients and result measures of the trial), it is little applicable to the usual-care situation.
Trial conduct: sensitise data-monitoring committee to the pragmatic quality of the trial
The information monitoring committee is expected to deliberation otherwise erstwhile investigators person intelligibly articulated their intended extremity of pragmatism [50]. The committee should wage much attraction to protecting outer applicability and avoiding co-interventions delivered by the probe squad (not the diligent and care-provider co-interventions) that are not disposable erstwhile speechmaking the involution statement successful the proceedings protocol. Depending connected the unsocial circumstances of each proceedings and involution being assessed, it whitethorn nevertheless support its archetypal relation of monitoring for information concerns.
Many pragmatic trials, particularly of analyzable non-clinical interventions specified arsenic work transportation changes, whitethorn not cod information different than astatine the extremity of the trial, and truthful ongoing information monitoring is not applicable due to the fact that the involution is debased risk. Hence, information signals are considered improbable and volition not beryllium formally monitored with proceedings data. This concern whitethorn suggest that alternatively of a information information oregon monitoring committee, a much broad proceedings absorption committee whitethorn beryllium an due supervisory structure, paying much attraction to issues specified arsenic involution implementation, diligent and centre recruitment, though proviso should beryllium made for processes to woody with information confidentially should the request originate during the trial.
If ongoing information information postulation is planned for a pragmatic trial, unobtrusive information sources specified arsenic administrative and physics aesculapian grounds information whitethorn beryllium preferred due to the fact that they person nary effect connected the travel of care. However, collecting from these sources whitethorn besides person important time-lags earlier reliable datasets are assembled and cleaned. Therefore, information monitoring for acute intervention-related injury, requiring a speedy turnaround for action, whitethorn person to beryllium connected objective suspicion. Because intensive information monitoring whitethorn disrupt the accustomed travel of care, a highly pragmatic plan whitethorn not beryllium suitable for trials evaluating interventions whose side-effect illustration is not yet clear.
Ethical and regulatory issues
Any randomised trial, pragmatic oregon not, indispensable beryllium conducted successful accordance with internationally accepted ethical principles and regulatory guidelines. The precise purpose of specified principles is to support the autonomy and payment interests of the participants successful objective trials, and the request for extortion is not debatable fixed horrendous and inhumane “research” specified arsenic the Nazi aesculapian experiments and the Tuskegee syphilis survey that litter the past of aesculapian probe [53]. Participant autonomy is protected by informed consent procedures. With this process, participants voluntarily hold to person a follow-up circumstantial to the study, to perchance acquisition risk, and to person idiosyncratic and perchance delicate information utilized for the research. Additional protections whitethorn beryllium required for radical who are peculiarly susceptible to imaginable risks (e.g. children, prisoners oregon large women, adjacent though determination whitethorn beryllium nary known objective crushed for doing truthful [54]) and besides radical with diminished autonomy (e.g. children oregon adults lacking decision-making capacity).
Patients who garbage to enactment successful trials whitethorn disagree from those who hold to enrol (e.g. the Beaver et al. proceedings [55], Table 12).
In the end, excluding imaginable participants due to the fact that of deficiency of consent whitethorn pb to a concern successful which the hazard illustration of included participants whitethorn disagree from the hazard illustration of those who were excluded. This concern whitethorn trim heterogeneity among participants, and therefore, the representativeness of the included participants and the applicability of the trial. As a consequence, the situation successful maintaining heterogeneous participants and providers and settings successful pragmatic trials whitethorn necessitate that proceedings designers collaborate with ethicists and probe morals committees to get a due equilibrium betwixt protecting probe participants portion promoting the applicability of the proceedings findings, though ethical issues indispensable prevail implicit technological ones.
Heterogeneity whitethorn besides beryllium induced by differences successful requirements from antithetic probe morals committees, which is an undesirable benignant of heterogeneity [56] (e.g. PADIT Trial [57], Table 13). Indeed, successful specified a situation, a diligent could beryllium considered eligible and included successful immoderate centres but not successful others. Such a concern has immoderate similarities with 1 successful which enactment criteria would not beryllium applied successful the aforesaid mode among centres, which, arsenic antecedently discussed, is simply a root of undesirable heterogeneity. In immoderate countries, centralised probe morals committees tin supply a azygous reappraisal covering each participating centres, frankincense improving consistency and reducing unwanted between-centre heterogeneity.
Trial planning: inclusion of susceptible patients and informed consent
Although susceptible patients, including those with co-morbidities, are commonly excluded successful explanatory trials, a much inclusive attack whitethorn beryllium adopted successful pragmatic trials, provided capable protections are successful place. For patients with co-morbidities, protections whitethorn see flexibility successful medication of the survey involution to conscionable idiosyncratic diligent needs (e.g. dose reduction) and further clinically indicated follow-up visits. When patients person diminished capableness to supply consent, a surrogate decision-maker whitethorn beryllium required. This whitethorn besides beryllium the lawsuit for exigency probe specified arsenic trials conducted successful intensive attraction units.
Written informed consent for proceedings information is modular for explanatory trials. Pragmatic trials are commonly conducted successful superior attraction settings and usually impact regular aesculapian interventions. Although the ethical rule of respect for persons requires that the autonomy of participants beryllium respected, a much objective attack to consent successful pragmatic trials whitethorn execute the aforesaid extremity with little intrusion (and frankincense little propensity to summation homogeneity). Kim et al. [33] picture 1 specified objective attack to consent called “integrated consent”, whereby informed consent to information successful a pragmatic proceedings is sought by the wellness supplier successful the clinic, during the accustomed people of attraction delivery. The wellness supplier discloses cardinal features of survey information verbally and records the patient’s consent oregon refusal successful the physics wellness record. In a clump randomised trial, erstwhile the survey involution is simply a cluster-level involution (thus, indivisible astatine the level of the individual) and poses lone minimal hazard to participants, probe morals committees whitethorn assistance a waiver of consent erstwhile the subject would beryllium compromised by seeking consent [58].
Conclusion
Heterogeneity is simply a prevalent diagnostic of each trials and whitethorn beryllium much marked successful pragmatic trials, which are expected to intimately emulate the people settings. Between-patient variability is astir apt the main root of heterogeneity. However, determination are galore different sources of heterogeneity. Some are undesirable and truthful should beryllium limited, but the pragmatic proceedings should beryllium considered a “dress rehearsal” for the involution to beryllium scaled up astatine the extremity of the proceedings [59]; therefore, ideally, nary restrictions should beryllium added to the proceedings that volition not beryllium carried done to accustomed attraction erstwhile the involution has been evaluated. Thus, proceedings readying and behaviour should minimise the interaction connected behaviours of patients, attraction providers and result assessors. In the end, heterogeneity indispensable beryllium considered and accommodated successful the planning, behaviour and investigation of a trial.
The arguments developed successful the contiguous insubstantial correspond the opinions of the authors and are not based connected archetypal worldly oregon systematic reviews. However, each authors are acquainted with randomised trials: they each person been progressive successful galore randomised trials and person conducted methodological enactment successful this field. Therefore, these recommendations trust connected idiosyncratic experiences to date, and we admit that they volition request to beryllium updated arsenic cognition of pragmatic approaches to randomised trials evolves. Indeed, pragmatic trials person received overmuch attraction implicit the past years, though the seminal insubstantial was published much than 50 years ago. Finally, though trials person agelong been viewed arsenic pragmatic oregon not, adjacent this archetypal insubstantial described the concern arsenic much complex. The wide volition of the proceedings designers tin reasonably beryllium described arsenic either pragmatic (to nutrient accusation for decision-making) oregon explanatory (to clarify an knowing of the mechanisms of enactment of an intervention), but astir trialists present hold that determination beryllium respective domains relating to the plan choices wrong the proceedings and that pragmatism should beryllium viewed arsenic a continuum alternatively than a dichotomous diagnostic wrong each domain [7, 31, 60]. The due plan attack for each domain should purpose astatine matching the wide volition portion optimising the equilibrium betwixt wanted and unwanted heterogeneity.
Availability of information and materials
No information were collected.
References
Higgins J. Cochrane handbook for systematic reviews of interventions. Chichester and Hoboken: Wiley-Blackwell; 2008.
Schwartz D, Lellouch J. Explanatory and pragmatic attitudes successful therapeutical trials. J Chronic Dis. 1967;20:637–48.
Zuidgeest MGP, Goetz I, Groenwold RHH, Irving E, van Thiel GJMW, Grobbee DE, et al. Series: pragmatic trials and existent satellite evidence: insubstantial 1. Introduction. J Clin Epidemiol. 2017;88:7–13.
Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, et al. Pragmatic controlled objective trials successful superior care: the conflict betwixt outer and interior validity. BMC Med Res Methodol. 2003;3:28.
Donner A. Design and investigation of clump randomization trials successful wellness research. London: Arnold; 2000.
Robinson KA, Saldanha IJ, McKoy NA. Development of a model to place probe gaps from systematic reviews. J Clin Epidemiol. 2011;64:1325–30.
Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are acceptable for purpose. BMJ. 2015;350:h2147.
Reignier J, Boisramé-Helms J, Brisard L, Lascarrou J-B, Ait Hssain A, Anguel N, et al. Enteral versus parenteral aboriginal nutrition successful ventilated adults with shock: a randomised, controlled, multicentre, open-label, parallel-group survey (NUTRIREA-2). Lancet Lond Engl. 2018;391:133–43.
Feder G, Davies RA, Baird K, Dunne D, Eldridge S, Griffiths C, et al. Identification and referral to amended information (IRIS) of women experiencing home unit with a superior attraction grooming and enactment programme: a clump randomised controlled trial. Lancet Lond Engl. 2011;378:1788–95.
Eldridge SM, Ashby D, Kerry S. Sample size for clump randomized trials: effect of coefficient of saltation of clump size and investigation method. Int J Epidemiol. 2006;35:1292–300.
Lamont EB, Landrum MB, Keating NL, Archer L, Lan L, Strauss GM, et al. Differences successful objective proceedings diligent attributes and outcomes according to enrollment setting. J Clin Oncol Off J Am Soc Clin Oncol. 2010;28:215–21.
Gentry KR, Arnup SJ, Disma N, Dorris L, de Graaff JC, Hunyady A, et al. Enrollment challenges successful multicenter, planetary studies: the illustration of the GAS trial. Paediatr Anaesth. 2019;29:51–8.
Jüni P, Altman DG, Egger M. Systematic reviews successful wellness care: assessing the prime of controlled objective trials. BMJ. 2001;323:42–6.
Van Spall HGC, Toren A, Kiss A, Fowler RA. Eligibility criteria of randomized controlled trials published successful high-impact wide aesculapian journals: a systematic sampling review. JAMA. 2007;297:1233–40.
Dember LM, Lacson E, Brunelli SM, Hsu JY, Cheung AK, Daugirdas JT, et al. The TiME trial: a afloat embedded, cluster-randomized, pragmatic proceedings of hemodialysis league duration. J Am Soc Nephrol JASN. 2019;30:890–903.
Loudon K, Zwarenstein M, Sullivan F, Donnan P, Treweek S. Making objective trials much relevant: improving and validating the PRECIS instrumentality for matching proceedings plan decisions to proceedings purpose. Trials. 2013;14:115.
Vickers AJ. Underpowering successful randomized trials reporting a illustration size calculation. J Clin Epidemiol. 2003;56:717–20.
Localio AR, Berlin JA, Ten Have TR, Kimmel SE. Adjustments for halfway successful multicenter studies: an overview. Ann Intern Med. 2001;135:112–23.
Butler CC, van der Velden AW, Bongard E, Saville BR, Holmes J, Coenen S, et al. Oseltamivir positive accustomed attraction versus accustomed attraction for influenza-like unwellness successful superior care: an open-label, pragmatic, randomised controlled trial. Lancet Lond Engl. 2019. https://doi.org/10.1016/S0140-6736(19)32982-4.
Kernan WN, Viscoli CM, Makuch RW, Brass LM, Horwitz RI. Stratified randomization for objective trials. J Clin Epidemiol. 1999;52:19–26.
Kahan BC, Morris TP. Improper investigation of trials randomised utilizing stratified blocks oregon minimisation. Stat Med. 2012;31:328–40.
Rothwell PM. Treating individuals 2. Subgroup investigation successful randomised controlled trials: importance, indications, and interpretation. Lancet Lond Engl. 2005;365:176–86.
Tarnow-Mordi W, Morris J, Kirby A, Robledo K, Askie L, Brown R, et al. Delayed versus contiguous cord clamping successful preterm infants. N Engl J Med. 2017;377:2445–55.
Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to code determinants of practice. Cochrane Database Syst Rev. 2015;2015(4):CD005470.
Hawe P, Shiell A, Riley T. Complex interventions: however “out of control” tin a randomised controlled proceedings be? BMJ. 2004;328:1561–3.
Underwood M, Lamb SE, Eldridge S, Sheehan B, Slowther A, Spencer A, et al. Exercise for slump successful attraction location residents: a randomised controlled proceedings with cost-effectiveness investigation (OPERA). Health Technol Assess Winch Engl. 2013;17:1–281.
Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for involution statement and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
Roberts C, Roberts SA. Design and investigation of objective trials with clustering effects owed to treatment. Clin Trials Lond Engl. 2005;2:152–62.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating analyzable interventions: the caller Medical Research Council guidance. BMJ. 2008;337:a1655.
Sedgwick P, Greenwood N. Understanding the Hawthorne effect. BMJ. 2015;351:h4672.
Dal-Ré R, Janiaud P, Ioannidis JPA. Real-world evidence: however pragmatic are randomized controlled trials labeled arsenic pragmatic? BMC Med. 2018;16:49.
Dawson L, Zarin DA, Emanuel EJ, Friedman LM, Chaudhari B, Goodman SN. Considering accustomed aesculapian attraction successful objective proceedings design. PLoS Med. 2009;6:e1000111.
Kim SYH, Miller FG. Informed consent for pragmatic trials--the integrated consent model. N Engl J Med. 2014;370:769–72.
Sato T. Sample size calculations with compliance information. Stat Med. 2000;19:2689–97.
Eldridge S, Kerry S, Torgerson DJ. Bias successful identifying and recruiting participants successful clump randomised trials: what tin beryllium done? BMJ. 2009;339:b4006.
Torgerson DJ. Contamination successful trials: is clump randomisation the answer? BMJ. 2001;322:355–7.
International Conference connected Harmonization of method requirements for registration of pharmaceuticals for quality use. Guideline for Good Clinical Practice - E6(R1). https://database.ich.org/sites/default/files/E6_R2_Addendum.pdf.
Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an hold of the CONSORT statement. BMJ. 2008;337:a2390.
Hewitt CE, Torgerson DJ, Miles JNV. Is determination different mode to instrumentality relationship of noncompliance successful randomized controlled trials? CMAJ Can Med Assoc J J Assoc Medicale Can. 2006;175:347.
Hernán MA, Robins JM. Per-protocol analyses of pragmatic trials. N Engl J Med. 2017;377:1391–8.
Meinecke A-K, Welsing P, Kafatos G, Burke D, Trelle S, Kubin M, et al. Series: pragmatic trials and existent satellite evidence: insubstantial 8. Data postulation and management. J Clin Epidemiol. 2017;91:13–22.
Sterne JAC, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, et al. Multiple imputation for missing information successful epidemiological and objective research: imaginable and pitfalls. BMJ. 2009;338:b2393.
MacPherson H, Richmond S, Bland M, Brealey S, Gabe R, Hopton A, et al. Acupuncture and counselling for slump successful superior care: a randomised controlled trial. PLoS Med. 2013;10:e1001518.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process valuation of analyzable interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.
Fröbert O, Lagerqvist B, Olivecrona GK, Omerovic E, Gudnason T, Maeng M, et al. Thrombus aspiration during ST-segment elevation myocardial infarction. N Engl J Med. 2013;369:1587–97.
Kahan BC, Feagan B, Jairath V. A examination of approaches for adjudicating outcomes successful objective trials. Trials. 2017;18:266.
Welsing PM, Oude Rengerink K, Collier S, Eckert L, van Smeden M, Ciaglia A, et al. Series: pragmatic trials and existent satellite evidence: insubstantial 6. Outcome measures successful the existent world. J Clin Epidemiol. 2017;90:99–107.
O’Muircheartaigh C, Campanelli P. The comparative interaction of interviewer effects and illustration plan effects connected survey precision. J R Stat Soc Ser A Stat Soc. 1998;161:63–77.
Kramer MS, Martin RM, Sterne JAC, Shapiro S, Dahhou M, Platt RW. The treble jeopardy of clustered measurement and clump randomisation. BMJ. 2009;339:b2900.
Ellenberg SS, Culbertson R, Gillen DL, Goodman S, Schrandt S, Zirkle M. Data monitoring committees for pragmatic objective trials. Clin Trials Lond Engl. 2015;12:530–6.
RESTART Collaboration. Effects of antiplatelet therapy aft changeable owed to intracerebral haemorrhage (RESTART): a randomised, open-label trial. Lancet Lond Engl. 2019;393:2613–23.
Savović J, Jones HE, Altman DG, Harris RJ, Jüni P, Pildal J, et al. Influence of reported survey plan characteristics connected involution effect estimates from randomized, controlled trials. Ann Intern Med. 2012;157:429–38.
Vollmann J, Winau R. Informed consent successful quality experimentation earlier the Nuremberg code. BMJ. 1996;313:1445–9.
Macklin R. Enrolling large women successful biomedical research. Lancet Lond Engl. 2010;375:632–3.
Beaver K, Tysver-Robinson D, Campbell M, Twomey M, Williamson S, Hindley A, et al. Comparing infirmary and telephone follow-up aft attraction for bosom cancer: randomised equivalence trial. BMJ. 2009;338:a3147.
De Smit E, Kearns LS, Clarke L, Dick J, Hill CL, Hewitt AW. Heterogeneity of quality probe morals committees and probe governance offices crossed Australia: an observational study. Australas Med J. 2016;9:33–9.
Krahn AD, Longtin Y, Philippon F, Birnie DH, Manlucu J, Angaran P, et al. Prevention of arrhythmia instrumentality corruption trial: the PADIT trial. J Am Coll Cardiol. 2018;72:3098–109.
Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, et al. The Ottawa connection connected the ethical plan and behaviour of clump randomized trials. PLoS Med. 2012;9:e1001346.
Schwartz J, Flamant R, Lellouch J. L’Essai thérapeutique chez l’homme. Paris: Editions Médicales Flammarion; 1970.
Taljaard M, Nicholls SG, Howie AH, Nix HP, Carroll K, Moon PM, et al. An investigation of published trials recovered that existent usage of pragmatic proceedings labels is uninformative. J Clin Epidemiol. 2022;151:113-21.
Acknowledgements
No acknowledgement.
Funding
This enactment (BG, SEM, CW, MZ, BG) was supported by the Canadian Institutes of Health Research done the Project Grant contention (competitive, peer-reviewed), grant fig PJT-153045. MT is supported by the National Institute of Aging (NIA) of the National Institutes of Health nether Award Number U54AG063546, which funds NIA Imbedded Pragmatic Alzheimer’s Disease and AD-Related Dementias Clinical Trials Collaboratory (NIA IMPACT Collaboratory). The contented is solely the work of the authors and does not needfully correspond the authoritative views of the National Institutes of Health. The funder played nary relation successful the study. The funders had nary relation successful the survey design; successful the collection, investigation and mentation of data; successful the penning of the report; and successful the determination to taxable the nonfiction for publication.
Ethics declarations
Ethics support and consent to participate
Not required.
Consent for publication
Not required.
Competing interests
All authors person completed the ICMJ azygous disclosure signifier astatine www.icmje.org/coi_disclosure.pdf (available connected petition from the corresponding author) and state that they person nary applicable interests to declare.
Additional information
Publisher’s Note
Springer Nature remains neutral with respect to jurisdictional claims successful published maps and organization affiliations.
Rights and permissions
Open Access This nonfiction is licensed nether a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, organisation and reproduction successful immoderate mean oregon format, arsenic agelong arsenic you springiness due recognition to the archetypal author(s) and the source, supply a nexus to the Creative Commons licence, and bespeak if changes were made. The images oregon different 3rd enactment worldly successful this nonfiction are included successful the article's Creative Commons licence, unless indicated different successful a recognition enactment to the material. If worldly is not included successful the article's Creative Commons licence and your intended usage is not permitted by statutory regularisation oregon exceeds the permitted use, you volition request to get support straight from the copyright holder. To presumption a transcript of this licence, sojourn http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the information made disposable successful this article, unless different stated successful a recognition enactment to the data.
About this article
Cite this article
Giraudeau, B., Caille, A., Eldridge, S.M. et al. Heterogeneity successful pragmatic randomised trials: sources and management. BMC Med 20, 372 (2022). https://doi.org/10.1186/s12916-022-02569-w
Received: 25 March 2022
Accepted: 14 September 2022
Published: 28 October 2022
DOI: https://doi.org/10.1186/s12916-022-02569-w
Keywords
- Pragmatic randomised trials
- Heterogeneity
- Cluster randomised trials