Heterogeneity in pragmatic randomised trials: sources and management - BMC Medicine - BMC Medicine

2 years ago 59

BMC Medicine volume 20, Article number: 372 (2022) Cite this article

Abstract

Background

Pragmatic trials purpose to make grounds to straight pass patient, caregiver and health-system manager policies and decisions. Heterogeneity successful diligent characteristics contributes to heterogeneity successful their effect to the intervention. However, determination are galore different sources of heterogeneity successful outcomes. Based connected the expertise and judgements of the authors, we place antithetic sources of objective and methodological heterogeneity, which construe into heterogeneity successful diligent responses—some we see arsenic desirable and immoderate arsenic undesirable. For each of them, we sermon and, utilizing real-world proceedings examples, exemplify however heterogeneity should beryllium managed implicit the full people of the trial.

Main text

Heterogeneity successful centres and patients should beryllium welcomed alternatively than limited. Interventions tin beryllium flexible oregon tailored and power interventions are expected to bespeak accustomed care, avoiding usage of a placebo. Co-interventions should beryllium allowed; adherence should not beryllium enforced. All these elements present heterogeneity successful interventions (experimental oregon control), which has to beryllium welcomed due to the fact that it mimics reality. Outcomes should beryllium nonsubjective and perchance routinely collected; standardised assessment, blinding and adjudication should beryllium avoided arsenic overmuch arsenic imaginable due to the fact that this is not however appraisal would beryllium done extracurricular a proceedings setting. The statistical investigation strategy indispensable beryllium guided by the nonsubjective to pass decision-making, frankincense favouring the intention-to-treat principle. Pragmatic trials should see including process analyses to pass an knowing of the proceedings results. Needed information to behaviour these analyses should beryllium collected unobtrusively. Finally, ethical principles indispensable beryllium respected, adjacent though this whitethorn look to struggle with goals of pragmatism; consent procedures could beryllium incorporated successful the travel of care.

Peer Review reports

Introduction

Heterogeneity refers to the wide conception of variability. In objective studies, we classically see 3 antithetic types of heterogeneity [1]: objective heterogeneity oregon “variability successful participants, interventions and outcomes”, methodological heterogeneity oregon “variability successful survey plan and hazard of bias” and statistical heterogeneity oregon “variability successful the involution effects being evaluated successful antithetic studies”. Here, we absorption connected objective and methodological heterogeneity, limiting ourselves to within-trial heterogeneity.

In 1967, Daniel Schwartz and Joseph Lellouch developed the concepts of explanatory and pragmatic attitudes successful randomised objective trials [2]. The explanatory attack “aim[s] astatine understanding. It seeks to observe whether a quality exists betwixt 2 treatments which are specified by strict and usually elemental definitions.” In contrast, the pragmatic attack “aim[s] astatine decision. It seeks to reply the question—which of the 2 treatments should we prefer?” Pragmatic trials purpose to make grounds to pass decisions made by patients oregon participants, physicians oregon different providers and health-system managers oregon different policy-makers [3]. Thus, a pragmatic proceedings indispensable reproduce arsenic overmuch arsenic imaginable the circumstances—including heterogeneity—under which the assessed involution would beryllium utilized successful accustomed care. Pragmatic trials whitethorn beryllium individually randomised oregon clump randomised [4]. A clump randomised proceedings is simply a proceedings successful which intact societal units alternatively than idiosyncratic participants are randomised [5]. The units tin beryllium objective (e.g. practices, wards, caregivers) oregon not (e.g. schools, geographical areas, families).

Because a pragmatic proceedings is expected to emulate accustomed wellness attraction transportation successful the people setting, it should mimic the heterogeneity successful diligent outcomes expected extracurricular the proceedings context. As a consequence, erstwhile planning, conducting and analysing a trial, immoderate forms of heterogeneity should beryllium welcomed (because they lend to the information that the proceedings mimics the aboriginal reality), but others are undesirable (because they are induced by the proceedings discourse and are not expected to beryllium encountered successful the aboriginal reality). In this paper, we aimed to place these desirable and undesirable sources of heterogeneity successful pragmatic trials based connected our opinion. For each of them, we besides sermon and exemplify with examples however they should beryllium handled successful proceedings planning, behaviour and investigation to assistance radical behaviour their trials successful a mode to enactment pragmatic aims. Our investigation is based connected the expertise and judgements of the authors consisting of 4 elder biostatisticians, a bioethicist, and a pragmatic trialist, each with a agelong acquisition successful randomised trials.

According to the Patient, Intervention, Comparison, Outcome and Setting (PICOS) framework, [6] the manuscript is structured successful 3 sections: (1) patients and settings of included centres (P and S domains of the PICOS), (2) involution and power (C and O domains of the PICOS), and (3) result (O domain of the PICOS)), to which we added a 4th conception related to regulatory and ethical issues, which whitethorn besides impact heterogeneity. Table 1 summarises sources of heterogeneity successful pragmatic trials and Table 2 our recommendations for management.

Table 1 Sources of heterogeneity successful pragmatic trials arsenic compared to explanatory trials
Table 2 Authors’ recommendations for managing sources of heterogeneity successful pragmatic proceedings design, behaviour and analysis

Patients and mounting of included centres

Trial planning: prime emblematic centres

Centres progressive successful a pragmatic proceedings should beryllium drawn from a akin scope of diligent attraction settings arsenic those successful the people colonisation for which the designers mean the findings of the proceedings volition use [7]. If survey centres are constricted and highly selected, heterogeneity volition beryllium reduced and whitethorn nary longer acceptable the people population. For instance, centres should not exclusively beryllium assemblage hospitals erstwhile the illness of involvement is common, and patients are cared for successful some assemblage and assemblage hospitals (e.g. NUTRIREA-2 proceedings [8], Table 3).

Table 3 NUTRIREA-2: enteral versus parenteral aboriginal nutrition successful ventilated adults with shock

An enactment is to maximise the fig and scope of included centres, possibly reducing the fig of patients per centre. In trials conducted crossed a wellness system, it whitethorn adjacent beryllium imaginable to enlistee centres successful random series until the required illustration size is reached, thereby vouchsafing representativeness of the disposable illustration and frankincense applicability to the people colonisation (e.g. IRIS proceedings [9], Table 4).

Table 4 IRIS: grooming programme to summation recognition of pistillate victims of home violence

In a clump randomised trial, heterogeneity successful selected centres has 2 further consequences. First, much variability successful result betwixt centres increases the intraclass correlation coefficient, and arsenic a result, a larger illustration size is required. Second, variability successful clump (centre) size besides increases the required full illustration size [10].

Finally, though differences successful diligent characteristics betwixt centres whitethorn bespeak a antithetic diligent case-mix betwixt centres [11], which is simply a invited root of heterogeneity, specified differences whitethorn besides beryllium owed to the differential exertion of eligibility criteria, which is an undesirable root of heterogeneity [12]. Indeed, successful a clump randomised trial, specified a improvement would beryllium a root of bias due to the fact that of differences successful characteristics of included participants betwixt the groups being compared; successful an individually randomised trial, this concern whitethorn induce a centre effect, which would not beryllium owed to the involution but alternatively to differences successful pursuing the proceedings procedures.

Trial planning: unbend diligent enactment criteria

A pragmatic proceedings aims to enlistee patients from an disposable colonisation who are arsenic akin arsenic imaginable to the people population. This people colonisation corresponds to the colonisation that would person the survey involution erstwhile it has been shown to beryllium effectual and scaled up successful the accustomed healthcare setting. Eligibility criteria should not exclude patients who are little apt to respond to the attraction oregon those not apt to implicit the follow-up. Success successful representing the people colonisation successful the patients recruited for the proceedings contributes to the applicability of the trial’s results [13] to the people population. Inclusion and exclusion criteria are often much restrictive successful trials of cause interventions than those assessing devices, country oregon different analyzable interventions; they are besides much restrictive successful industry-sponsored versus nationalist agency-funded trials [14]. As an example, the TiME proceedings [15] had precise fewer enactment criteria for patients, frankincense promising precise bully applicability, too the information that it constricted the hazard of recognition and recruitment bias (Table 5).

Table 5 TiME: accrued haemodialysis duration session

Trial planning: relationship for pragmatic features successful illustration size calculation

Even though illustration size formulae whitethorn beryllium the same, the reasoning astir illustration size differs successful pragmatic and explanatory trials. First, involution effects are expected to beryllium smaller successful pragmatic than explanatory trials, successful portion due to the fact that of the inclusion of patients with a wider scope of characteristics, for illustration those with comorbidities, who are little adherent, and/or who person some little terrible conditions, and frankincense payment less, arsenic good arsenic those whose information is much terrible and perchance intractable. Other features that mightiness beforehand homogeneity and frankincense seemingly greater effect sizes successful explanatory trials see selecting caregivers and centres based connected measurement and acquisition [16]. Second, illustration size parameters request to beryllium cautiously and realistically specified. A priori specifying a modular deviation that is little than the station hoc estimation is simply a communal occupation [17] and results successful optimistic illustration size estimates and risks of insufficient statistical power. Therefore, attraction should beryllium paid to whether modular deviation estimates are derived from antecedently conducted explanatory trials—and truthful apt to beryllium excessively low—or from administrative routinely collected data, for instance, which should adequately seizure real-world heterogeneity.

Trial planning: stratify randomisation

A centre effect is to beryllium expected successful a pragmatic proceedings due to the fact that of centre and subordinate heterogeneity, arsenic antecedently discussed. The involution transportation whitethorn besides beryllium tailored to the centre context, and specified heterogeneity, which, successful our opinion, should beryllium welcomed due to the fact that interventions are applied with heterogeneity successful existent practice, besides contributes to a centre effect. Accordingly, to forestall imbalance betwixt arms and amended power, individually randomised multicentre pragmatic trials should stratify randomisation connected centre [18] (e.g. NUTRIREA-2 trial, Table 3). Prognostic factors whitethorn besides beryllium considered arsenic stratification variables (e.g. ALIC4E proceedings [19], Table 6), notably erstwhile the illustration size is small, frankincense limiting the hazard of baseline imbalances [20]. Similarly, for clump randomised trials, restricted randomisation specified as, for instance, stratified randomisation oregon randomisation by minimisation, is advisable to bounds accidental imbalances (e.g. IRIS and TiME trials, Tables 4 and 5) [5].

Table 6 ALIC4E: oseltamivir successful patients with influenza-like illness

Trial analysis: set connected stratifying variables, notably centres (e.g. IRIS trial, Table 4)

Although not circumstantial to pragmatic trials, unadjusted analyses of trials utilizing stratified randomisation rise 2 issues. First, determination is inconsistency if factors utilized to stratify randomisation are not taken into relationship erstwhile analysing the results. Second, ignoring stratification factors successful the investigation leads to over-estimated modular errors, wider assurance intervals, inflated p-values and diminished powerfulness [21]. Although this is existent for immoderate randomised trial, it is simply a peculiar interest successful pragmatic trials successful which between-centre heterogeneity is expected to beryllium higher, arsenic discussed above. Accounting for centre effects is truthful advisable ant it has been shown that random-effects models connection amended properties than fixed-effects models [21].

Trial analysis: bounds subgroup analyses to those that pass decision-making

Subgroup analyses purpose to place interactions betwixt attraction and pre-specified diligent oregon centre characteristics [22]. Because pragmatic trials purpose astatine informing decision-making alternatively than promoting an knowing of the mechanics of action, subgroup analyses should lone beryllium done if the aforesaid subgroups are meaningfully portion of accustomed objective attraction oregon argumentation decision-making, which requires that the favoritism betwixt these subgroups is readily accessible to clinicians (e.g. age, humor pressure), (e.g. APTS proceedings [23], Table 7) oregon policy-makers (e.g. subgroups defined by equality, diversity, and inclusion groups.

Table 7 APTS: Delayed cord clamping

Intervention and power groups

Trial planning: licence immoderate tailoring of the intervention

Although heterogeneity successful the transportation of interventions is an undesirable diagnostic of an explanatory proceedings (in which interventions indispensable beryllium standardised), successful pragmatic trials, arsenic successful aboriginal accustomed attraction successful the people settings, interventions whitethorn good beryllium tailored to idiosyncratic diligent needs oregon the section discourse successful which attraction is provided [24], particularly for analyzable interventions [25] (e.g. OPERA Trial [26], Table 8).

Table 8 OPERA: carnal enactment to forestall slump successful residential homes

Hawe et al. notation to standardisation by relation arsenic compared with standardisation by signifier (e.g. alternatively than utilizing a communal accusation kit, however accusation is provided whitethorn disagree among centres portion the relation of the accusation remains changeless crossed centres), acknowledging that mechanisms that are assessed (i.e. the precise components of the intervention) tin instrumentality antithetic forms from 1 discourse to different [25]. Nevertheless, the halfway components of an involution request to beryllium specified [27]; otherwise, the mentation of the results whitethorn beryllium analyzable due to the fact that 1 would not cognize what involution is being evaluated.

Tailored interventions whitethorn lend to a centre effect [18] oregon adjacent a supplier effect [28], but depending connected the probe question and proceedings intention, flexibility successful interventions is comparatively unproblematic arsenic agelong arsenic successful the proceedings interventions are delivered by providers successful a akin scope of ways and successful settings that lucifer the people objective settings. Doing truthful volition present desirable heterogeneity successful subordinate outcomes due to the fact that it mimics world successful that interventions are seldom perfectly standardised successful accustomed care.

Monitoring the grade of tailoring arsenic good arsenic co-interventions raises a further dilemma. On 1 hand, we privation to amended recognize what really happened, and this cognition whitethorn assistance to standard up the involution aft the survey has demonstrated benefit. This is the precise purpose of a process analysis, which is some desirable and recommended [29] (e.g. OPERA Trial, Table 8). On the different hand, immoderate intrusive information postulation is undesirable, due to the fact that it whitethorn distort accustomed objective signifier and diligent response. Indeed, diligent and wellness supplier behaviour should not beryllium altered extracurricular of the proviso of the intervention, to bounds arsenic overmuch arsenic imaginable a Hawthorne effect [30]. Ideally, process measures and result assessments should beryllium arsenic unobtrusive arsenic possible, possibly obtained utilizing administrative oregon physics aesculapian grounds information whose postulation is portion of the accustomed care.

Trial planning: guarantee that the power involution reflects accustomed care

Control interventions are typically non-protocolised accustomed attraction or, successful comparative effectiveness research, different already wide utilized progressive treatment. The usage of a usual-care power has respective consequences. First, the power tin beryllium “no treatment,” but it should seldom beryllium a placebo [31] due to the fact that placebos are not utilized successful accustomed objective attraction extracurricular of proceedings contexts. This unnatural examination radical whitethorn change the results of the proceedings successful unknowable ways. Moreover, a placebo power could lend to an unnatural and undesirable homogeneity among patients allocated to the power group, by reducing recourse to self-prescription with medicines oregon different attraction modalities (e.g. ALIC4E trial, Table 6). It whitethorn besides impact result assessment, which raises different issues, notably related to the hazard of detection bias (cf. Outcome section). We admit that not utilizing a placebo whitethorn beryllium a challenging contented for a regulatory bureau and therefore, if relevant, promote trialists to person preliminary discussions with these agencies to warrant the request for avoiding placebos. Second, determination whitethorn beryllium antithetic approaches to accustomed attraction successful antithetic centres of the people setting. This concern whitethorn beryllium accommodated by much than 1 power radical oregon a azygous power radical that permits unrestricted implementation of a assortment of antithetic treatments utilized successful regular attraction and frankincense averages retired each the kinds of accustomed attraction provided [32]. Third, a accustomed attraction power means that we expect patients and providers to behave arsenic they would extracurricular a proceedings context. However, for some patients and providers, behaviours tin beryllium altered by proceedings enrolment, known arsenic the Hawthorne effect [30]. Changes successful diligent and supplier behaviours whitethorn impact diligent result heterogeneity, astir apt by reducing it. This raises an unsolvable conundrum: but successful uncommon situations, which indispensable beryllium approved by an morals committee, some patients and providers indispensable beryllium informed that they are progressive successful a randomised controlled trial. This accusation process is simply a mainstay of ethical objective probe but whitethorn change behaviours arsenic compared with usual, unobserved, non-trial care. This concern is simply a beardown statement for incorporating consent procedures successful the travel of attraction [33], minimising the obtrusiveness of involution and information postulation successful bid to minimise subordinate consciousness of the proceedings and frankincense minimise the Hawthorne effect.

Trial planning: see the interaction of compliance connected illustration size

Lack of compliance is communal extracurricular a proceedings context. Sample size calculation should instrumentality into relationship usual-care levels of compliance [34] (e.g. APTS trial, Table 7). Moreover, successful pragmatic trials comparing usual-care interventions without blinding, patients from 1 radical whitethorn sometimes beryllium easy capable to entree different survey radical intervention, which whitethorn effect successful contamination. If this contamination is symmetrical betwixt arms, past it increases variability and decreases the effect size estimate. If this contamination is not symmetrical betwixt arms, which is the astir plausible situation, it creates a bias, which tin attenuate oregon exaggerate the effect size estimate. In some situations, the contented cannot beryllium dealt with simply by expanding the illustration size. Cluster randomisation whitethorn bounds contamination, but it whitethorn besides induce bias arising from the recognition oregon recruitment of idiosyncratic participants if this processes hap aft randomisation [35]. This could beryllium a worse occupation than radical contamination successful the individually randomised mentation of that proceedings [36].

Study conduct: bash not enforce compliance

In explanatory objective trials, compliance with involution and power protocols by some providers and patients is enhanced by proceedings monitoring often followed by nonstop interaction betwixt a probe adjunct and the non-compliant diligent oregon supplier [37]. However, successful pragmatic trials, efforts to beforehand compliance are undesirable unless specified efforts are viewed arsenic portion of the involution itself and would beryllium scaled up successful accustomed practice. The guiding rule is that extracurricular of the survey intervention—which should beryllium provided akin to however it would beryllium provided successful aboriginal accustomed attraction should it beryllium shown to beryllium effectual successful this trial—other behaviours of providers and patients should beryllium unaltered. Trial monitoring is profoundly ingrained successful the minds of some researchers and survey sponsors and mounting it speech erstwhile performing a pragmatic proceedings requires a paradigm change. Thus, successful pragmatic trials, compliance should not beryllium enhanced but alternatively considered an result and assessed unobtrusively [4]. In the TiME proceedings (Table 5), though the stated extremity of pragmatism had been impaired owing to efforts made to heighten adherence and measure compliance, compliance turned retired to beryllium of large interest. Indeed, involution fidelity was truthful mediocre that immoderate quality betwixt groups successful haemodialysis league duration (the involution assessed) vanished implicit time, which led authors to discontinue the trial.

Study conduct: let co-interventions

Co-interventions, defined arsenic further treatments that are not portion of the assessed intervention, are different root of heterogeneity. In an explanatory trial, imaginable co-interventions are listed successful the survey protocol; immoderate of these whitethorn beryllium allowed, but others are prohibited. In a pragmatic trial, co-interventions are not mostly considered protocol violations: they are near to the discretion of patients and providers successful the proceedings due to the fact that this flexibility would use to accustomed attraction successful the people setting, erstwhile the involution is successful wide use, and wherever akin co-interventions volition beryllium successful use. Measuring them is of interest, but it remains a secondary nonsubjective aimed astatine understanding, and arsenic overmuch arsenic possible, it should beryllium done successful an unobtrusive way.

Trial analysis: use the intent-to-treat principle

Statistical investigation of a superiority proceedings is expected to beryllium according to intent-to-treat, and this holds existent for pragmatic trials [7, 38]. Indeed, per-protocol, completers, on-treatment oregon complier mean causal effect (CACE) analyses purpose astatine knowing what could beryllium observed with optimal compliance and are much suited to explanatory trials [39]. Some reason that per-protocol analyses are of involvement if the involution is expected to beryllium scaled up successful settings wherever adherence to attraction is expected to beryllium amended than successful the conducted proceedings [40]. However, this concern casts doubts connected the representativeness of the selected settings. One whitethorn besides reason that per-protocol oregon CACE analyses are of involvement from a diligent position due to the fact that they whitethorn assistance patients determine betwixt treatments, though the necessity for cleanable compliance to execute the effects successful specified analyses needs to beryllium acknowledged. Thus, specified analyses should stay secondary analyses.

Missing information is an important contented successful intent-to-treat analysis. Missing information whitethorn beryllium much prevalent successful a pragmatic than explanatory proceedings successful which monitoring is much stringent, but if information are obtained from well-completed aesculapian oregon administrative registries [41]. Therefore, statistical methods to grip missing data, specified arsenic aggregate imputation oregon covariate adjustment, should beryllium utilized [42] (e.g. ACUDep proceedings [43], Table 9).

Table 9 ACUDep: acupuncture and counselling for depression

Trial analysis: marque definite ancillary studies volition not interfere with not imposing circumstantial constraints connected patients oregon physicians

As an ancillary nonsubjective of a pragmatic trial, 1 whitethorn question to amended recognize the assessed intervention. Thus, astatine the extremity of the study, a process investigation “[that] explore[s] the mode successful which the involution nether survey is implemented” [29] whitethorn bring a complementary presumption taking into relationship contextual issues [44] (e.g. OPERA trial, Table 8). In the aforesaid way, per-protocol [40] oregon CACE analyses whitethorn assistance explicate whether deficiency of attraction effect is owed to deficiency of compliance, whereas subgroup analyses whitethorn assistance place subgroups of patients who payment astir from the treatment. In a pragmatic trial, each these analyses are mostly secondary ones, which means that nary circumstantial effort should beryllium made to cod further information for them if that other information postulation jeopardises the superior intent of the study, possibly by distorting the objective mounting and adding other investigations oregon disruptive information collection. However, pragmatic trials purpose astatine answering the questions that decision-makers request answered, truthful 1 cannot exclude the anticipation that subgroup analyses whitethorn beryllium portion of the superior objective, for example, to analyse aims applicable to wellness equity.

Outcome

Trial planning: prime a routinely collected result regarded arsenic important by clinicians and patients

In pragmatic trials, the superior result indispensable beryllium straight applicable to patients oregon the superior stakeholder due to the fact that it needs to pass decision-making by patients, caregivers and policy-makers [2, 7]. The superior result of a pragmatic proceedings should ideally correspond to an result routinely assessed successful accustomed attraction and is regarded arsenic clinically important and truthful apt to power providers’ decisions (e.g. TASTE Trial [45], Table 10).

Table 10 TASTE: thrombus aspiration successful myocardial infarction

Trial planning: debar standardisation, blinding and adjudication arsenic overmuch arsenic possible

Outcome appraisal raises a conundrum. Some suggest that standardisation (i.e. applying standardised measurement methods), blinding and adjudication should beryllium avoided due to the fact that they bash not correspond to accustomed signifier [7]. Standardisation aims astatine reducing heterogeneity successful result assessment, whose effect is chiefly a nonaccomplishment successful power. Heterogeneity successful result appraisal besides increases the hazard of misclassification, which, whitethorn beryllium a root of bias [46, 47]. Standardisation whitethorn hap for outcomes derived from interviews [48] but besides for objective examinations [49] oregon adjacent successful physics wellness records [50]. Blinding and adjudication besides purpose astatine reducing the hazard of bias (e.g. RESTART Trial [51], Table 11).

Table 11 RESTART: antiplatelet therapy aft changeable owed to intracerebral haemorrhage

Problems originate chiefly for non-objective outcomes. Subjective result appraisal is so known to beryllium perchance influenced by the beliefs, successful narration to the treatments, of patients themselves, their caregivers oregon clinicians [52]. Moreover, successful the lack of blinding, this power whitethorn not beryllium the aforesaid successful the groups being compared. However, different presumption of this is that these subjective beliefs successful narration to the effectiveness of interventions would beryllium progressive successful objective practice, aft the proceedings has shown 1 of the tested interventions arsenic much effectual and been implemented widely. In that case, the subjective beliefs successful the involution person been good captured successful the proceedings and frankincense bespeak the aboriginal usual-care concern accurately. In this rather communal situation, eliminating the effect of subjective content successful the proceedings would destruct indispensable heterogeneity and effect successful an incorrect estimation of the effect size.

Actually, standardisation, blinding and adjudication bash not person the aforesaid consequences. Although blinding arsenic good arsenic standardised information postulation by researchers whitethorn so impact diligent and care-provider behaviours, adjudication is little problematic due to the fact that it tin beryllium performed aft information collection, with blinding to the limb of the diligent whose grounds is being assessed and truthful without bias. However, adjudication, arsenic we astir often know, is performed by extracurricular and selected adept clinicians often utilizing accusation oregon expertise not disposable to the clinician successful accustomed attraction successful immoderate aboriginal setting. This mightiness nutrient proceedings results that disagree from results based connected usual-care clinician assessments frankincense reducing the relevance of the proceedings for decision-making. Although this proceedings whitethorn not beryllium biased (the uncovering is existent for the patients and result measures of the trial), it is little applicable to the usual-care situation.

Trial conduct: sensitise data-monitoring committee to the pragmatic quality of the trial

The information monitoring committee is expected to deliberation otherwise erstwhile investigators person intelligibly articulated their intended extremity of pragmatism [50]. The committee should wage much attraction to protecting outer applicability and avoiding co-interventions delivered by the probe squad (not the diligent and care-provider co-interventions) that are not disposable erstwhile speechmaking the involution statement successful the proceedings protocol. Depending connected the unsocial circumstances of each proceedings and involution being assessed, it whitethorn nevertheless support its archetypal relation of monitoring for information concerns.

Many pragmatic trials, particularly of analyzable non-clinical interventions specified arsenic work transportation changes, whitethorn not cod information different than astatine the extremity of the trial, and truthful ongoing information monitoring is not applicable due to the fact that the involution is debased risk. Hence, information signals are considered improbable and volition not beryllium formally monitored with proceedings data. This concern whitethorn suggest that alternatively of a information information oregon monitoring committee, a much broad proceedings absorption committee whitethorn beryllium an due supervisory structure, paying much attraction to issues specified arsenic involution implementation, diligent and centre recruitment, though proviso should beryllium made for processes to woody with information confidentially should the request originate during the trial.

If ongoing information information postulation is planned for a pragmatic trial, unobtrusive information sources specified arsenic administrative and physics aesculapian grounds information whitethorn beryllium preferred due to the fact that they person nary effect connected the travel of care. However, collecting from these sources whitethorn besides person important time-lags earlier reliable datasets are assembled and cleaned. Therefore, information monitoring for acute intervention-related injury, requiring a speedy turnaround for action, whitethorn person to beryllium connected objective suspicion. Because intensive information monitoring whitethorn disrupt the accustomed travel of care, a highly pragmatic plan whitethorn not beryllium suitable for trials evaluating interventions whose side-effect illustration is not yet clear.

Ethical and regulatory issues

Any randomised trial, pragmatic oregon not, indispensable beryllium conducted successful accordance with internationally accepted ethical principles and regulatory guidelines. The precise purpose of specified principles is to support the autonomy and payment interests of the participants successful objective trials, and the request for extortion is not debatable fixed horrendous and inhumane “research” specified arsenic the Nazi aesculapian experiments and the Tuskegee syphilis survey that litter the past of aesculapian probe [53]. Participant autonomy is protected by informed consent procedures. With this process, participants voluntarily hold to person a follow-up circumstantial to the study, to perchance acquisition risk, and to person idiosyncratic and perchance delicate information utilized for the research. Additional protections whitethorn beryllium required for radical who are peculiarly susceptible to imaginable risks (e.g. children, prisoners oregon large women, adjacent though determination whitethorn beryllium nary known objective crushed for doing truthful [54]) and besides radical with diminished autonomy (e.g. children oregon adults lacking decision-making capacity).

Patients who garbage to enactment successful trials whitethorn disagree from those who hold to enrol (e.g. the Beaver et al. proceedings [55], Table 12).

Table 12 Telephone follow-up aft attraction for bosom cancer

In the end, excluding imaginable participants due to the fact that of deficiency of consent whitethorn pb to a concern successful which the hazard illustration of included participants whitethorn disagree from the hazard illustration of those who were excluded. This concern whitethorn trim heterogeneity among participants, and therefore, the representativeness of the included participants and the applicability of the trial. As a consequence, the situation successful maintaining heterogeneous participants and providers and settings successful pragmatic trials whitethorn necessitate that proceedings designers collaborate with ethicists and probe morals committees to get a due equilibrium betwixt protecting probe participants portion promoting the applicability of the proceedings findings, though ethical issues indispensable prevail implicit technological ones.

Heterogeneity whitethorn besides beryllium induced by differences successful requirements from antithetic probe morals committees, which is an undesirable benignant of heterogeneity [56] (e.g. PADIT Trial [57], Table 13). Indeed, successful specified a situation, a diligent could beryllium considered eligible and included successful immoderate centres but not successful others. Such a concern has immoderate similarities with 1 successful which enactment criteria would not beryllium applied successful the aforesaid mode among centres, which, arsenic antecedently discussed, is simply a root of undesirable heterogeneity. In immoderate countries, centralised probe morals committees tin supply a azygous reappraisal covering each participating centres, frankincense improving consistency and reducing unwanted between-centre heterogeneity.

Table 13 PADIT: prevention of arrhythmia instrumentality infection

Trial planning: inclusion of susceptible patients and informed consent

Although susceptible patients, including those with co-morbidities, are commonly excluded successful explanatory trials, a much inclusive attack whitethorn beryllium adopted successful pragmatic trials, provided capable protections are successful place. For patients with co-morbidities, protections whitethorn see flexibility successful medication of the survey involution to conscionable idiosyncratic diligent needs (e.g. dose reduction) and further clinically indicated follow-up visits. When patients person diminished capableness to supply consent, a surrogate decision-maker whitethorn beryllium required. This whitethorn besides beryllium the lawsuit for exigency probe specified arsenic trials conducted successful intensive attraction units.

Written informed consent for proceedings information is modular for explanatory trials. Pragmatic trials are commonly conducted successful superior attraction settings and usually impact regular aesculapian interventions. Although the ethical rule of respect for persons requires that the autonomy of participants beryllium respected, a much objective attack to consent successful pragmatic trials whitethorn execute the aforesaid extremity with little intrusion (and frankincense little propensity to summation homogeneity). Kim et al. [33] picture 1 specified objective attack to consent called “integrated consent”, whereby informed consent to information successful a pragmatic proceedings is sought by the wellness supplier successful the clinic, during the accustomed people of attraction delivery. The wellness supplier discloses cardinal features of survey information verbally and records the patient’s consent oregon refusal successful the physics wellness record. In a clump randomised trial, erstwhile the survey involution is simply a cluster-level involution (thus, indivisible astatine the level of the individual) and poses lone minimal hazard to participants, probe morals committees whitethorn assistance a waiver of consent erstwhile the subject would beryllium compromised by seeking consent [58].

Conclusion

Heterogeneity is simply a prevalent diagnostic of each trials and whitethorn beryllium much marked successful pragmatic trials, which are expected to intimately emulate the people settings. Between-patient variability is astir apt the main root of heterogeneity. However, determination are galore different sources of heterogeneity. Some are undesirable and truthful should beryllium limited, but the pragmatic proceedings should beryllium considered a “dress rehearsal” for the involution to beryllium scaled up astatine the extremity of the proceedings [59]; therefore, ideally, nary restrictions should beryllium added to the proceedings that volition not beryllium carried done to accustomed attraction erstwhile the involution has been evaluated. Thus, proceedings readying and behaviour should minimise the interaction connected behaviours of patients, attraction providers and result assessors. In the end, heterogeneity indispensable beryllium considered and accommodated successful the planning, behaviour and investigation of a trial.

The arguments developed successful the contiguous insubstantial correspond the opinions of the authors and are not based connected archetypal worldly oregon systematic reviews. However, each authors are acquainted with randomised trials: they each person been progressive successful galore randomised trials and person conducted methodological enactment successful this field. Therefore, these recommendations trust connected idiosyncratic experiences to date, and we admit that they volition request to beryllium updated arsenic cognition of pragmatic approaches to randomised trials evolves. Indeed, pragmatic trials person received overmuch attraction implicit the past years, though the seminal insubstantial was published much than 50 years ago. Finally, though trials person agelong been viewed arsenic pragmatic oregon not, adjacent this archetypal insubstantial described the concern arsenic much complex. The wide volition of the proceedings designers tin reasonably beryllium described arsenic either pragmatic (to nutrient accusation for decision-making) oregon explanatory (to clarify an knowing of the mechanisms of enactment of an intervention), but astir trialists present hold that determination beryllium respective domains relating to the plan choices wrong the proceedings and that pragmatism should beryllium viewed arsenic a continuum alternatively than a dichotomous diagnostic wrong each domain [7, 31, 60]. The due plan attack for each domain should purpose astatine matching the wide volition portion optimising the equilibrium betwixt wanted and unwanted heterogeneity.

Availability of information and materials

No information were collected.

References

  1. Higgins J. Cochrane handbook for systematic reviews of interventions. Chichester and Hoboken: Wiley-Blackwell; 2008.

    Book  Google Scholar 

  2. Schwartz D, Lellouch J. Explanatory and pragmatic attitudes successful therapeutical trials. J Chronic Dis. 1967;20:637–48.

    Article  CAS  PubMed  Google Scholar 

  3. Zuidgeest MGP, Goetz I, Groenwold RHH, Irving E, van Thiel GJMW, Grobbee DE, et al. Series: pragmatic trials and existent satellite evidence: insubstantial 1. Introduction. J Clin Epidemiol. 2017;88:7–13.

    Article  PubMed  Google Scholar 

  4. Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, et al. Pragmatic controlled objective trials successful superior care: the conflict betwixt outer and interior validity. BMC Med Res Methodol. 2003;3:28.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Donner A. Design and investigation of clump randomization trials successful wellness research. London: Arnold; 2000.

    Google Scholar 

  6. Robinson KA, Saldanha IJ, McKoy NA. Development of a model to place probe gaps from systematic reviews. J Clin Epidemiol. 2011;64:1325–30.

    Article  PubMed  Google Scholar 

  7. Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are acceptable for purpose. BMJ. 2015;350:h2147.

    Article  PubMed  Google Scholar 

  8. Reignier J, Boisramé-Helms J, Brisard L, Lascarrou J-B, Ait Hssain A, Anguel N, et al. Enteral versus parenteral aboriginal nutrition successful ventilated adults with shock: a randomised, controlled, multicentre, open-label, parallel-group survey (NUTRIREA-2). Lancet Lond Engl. 2018;391:133–43.

    Article  Google Scholar 

  9. Feder G, Davies RA, Baird K, Dunne D, Eldridge S, Griffiths C, et al. Identification and referral to amended information (IRIS) of women experiencing home unit with a superior attraction grooming and enactment programme: a clump randomised controlled trial. Lancet Lond Engl. 2011;378:1788–95.

    Article  Google Scholar 

  10. Eldridge SM, Ashby D, Kerry S. Sample size for clump randomized trials: effect of coefficient of saltation of clump size and investigation method. Int J Epidemiol. 2006;35:1292–300.

    Article  PubMed  Google Scholar 

  11. Lamont EB, Landrum MB, Keating NL, Archer L, Lan L, Strauss GM, et al. Differences successful objective proceedings diligent attributes and outcomes according to enrollment setting. J Clin Oncol Off J Am Soc Clin Oncol. 2010;28:215–21.

    Article  Google Scholar 

  12. Gentry KR, Arnup SJ, Disma N, Dorris L, de Graaff JC, Hunyady A, et al. Enrollment challenges successful multicenter, planetary studies: the illustration of the GAS trial. Paediatr Anaesth. 2019;29:51–8.

    Article  PubMed  Google Scholar 

  13. Jüni P, Altman DG, Egger M. Systematic reviews successful wellness care: assessing the prime of controlled objective trials. BMJ. 2001;323:42–6.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Van Spall HGC, Toren A, Kiss A, Fowler RA. Eligibility criteria of randomized controlled trials published successful high-impact wide aesculapian journals: a systematic sampling review. JAMA. 2007;297:1233–40.

    Article  PubMed  Google Scholar 

  15. Dember LM, Lacson E, Brunelli SM, Hsu JY, Cheung AK, Daugirdas JT, et al. The TiME trial: a afloat embedded, cluster-randomized, pragmatic proceedings of hemodialysis league duration. J Am Soc Nephrol JASN. 2019;30:890–903.

    Article  PubMed  Google Scholar 

  16. Loudon K, Zwarenstein M, Sullivan F, Donnan P, Treweek S. Making objective trials much relevant: improving and validating the PRECIS instrumentality for matching proceedings plan decisions to proceedings purpose. Trials. 2013;14:115.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Vickers AJ. Underpowering successful randomized trials reporting a illustration size calculation. J Clin Epidemiol. 2003;56:717–20.

    Article  PubMed  Google Scholar 

  18. Localio AR, Berlin JA, Ten Have TR, Kimmel SE. Adjustments for halfway successful multicenter studies: an overview. Ann Intern Med. 2001;135:112–23.

    Article  CAS  PubMed  Google Scholar 

  19. Butler CC, van der Velden AW, Bongard E, Saville BR, Holmes J, Coenen S, et al. Oseltamivir positive accustomed attraction versus accustomed attraction for influenza-like unwellness successful superior care: an open-label, pragmatic, randomised controlled trial. Lancet Lond Engl. 2019. https://doi.org/10.1016/S0140-6736(19)32982-4.

  20. Kernan WN, Viscoli CM, Makuch RW, Brass LM, Horwitz RI. Stratified randomization for objective trials. J Clin Epidemiol. 1999;52:19–26.

    Article  CAS  PubMed  Google Scholar 

  21. Kahan BC, Morris TP. Improper investigation of trials randomised utilizing stratified blocks oregon minimisation. Stat Med. 2012;31:328–40.

    Article  PubMed  Google Scholar 

  22. Rothwell PM. Treating individuals 2. Subgroup investigation successful randomised controlled trials: importance, indications, and interpretation. Lancet Lond Engl. 2005;365:176–86.

    Article  Google Scholar 

  23. Tarnow-Mordi W, Morris J, Kirby A, Robledo K, Askie L, Brown R, et al. Delayed versus contiguous cord clamping successful preterm infants. N Engl J Med. 2017;377:2445–55.

    Article  PubMed  Google Scholar 

  24. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to code determinants of practice. Cochrane Database Syst Rev. 2015;2015(4):CD005470.

  25. Hawe P, Shiell A, Riley T. Complex interventions: however “out of control” tin a randomised controlled proceedings be? BMJ. 2004;328:1561–3.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Underwood M, Lamb SE, Eldridge S, Sheehan B, Slowther A, Spencer A, et al. Exercise for slump successful attraction location residents: a randomised controlled proceedings with cost-effectiveness investigation (OPERA). Health Technol Assess Winch Engl. 2013;17:1–281.

    CAS  Google Scholar 

  27. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for involution statement and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.

    Article  PubMed  Google Scholar 

  28. Roberts C, Roberts SA. Design and investigation of objective trials with clustering effects owed to treatment. Clin Trials Lond Engl. 2005;2:152–62.

    Article  Google Scholar 

  29. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating analyzable interventions: the caller Medical Research Council guidance. BMJ. 2008;337:a1655.

  30. Sedgwick P, Greenwood N. Understanding the Hawthorne effect. BMJ. 2015;351:h4672.

    Article  PubMed  Google Scholar 

  31. Dal-Ré R, Janiaud P, Ioannidis JPA. Real-world evidence: however pragmatic are randomized controlled trials labeled arsenic pragmatic? BMC Med. 2018;16:49.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Dawson L, Zarin DA, Emanuel EJ, Friedman LM, Chaudhari B, Goodman SN. Considering accustomed aesculapian attraction successful objective proceedings design. PLoS Med. 2009;6:e1000111.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Kim SYH, Miller FG. Informed consent for pragmatic trials--the integrated consent model. N Engl J Med. 2014;370:769–72.

    Article  CAS  PubMed  Google Scholar 

  34. Sato T. Sample size calculations with compliance information. Stat Med. 2000;19:2689–97.

    Article  CAS  PubMed  Google Scholar 

  35. Eldridge S, Kerry S, Torgerson DJ. Bias successful identifying and recruiting participants successful clump randomised trials: what tin beryllium done? BMJ. 2009;339:b4006.

    Article  PubMed  Google Scholar 

  36. Torgerson DJ. Contamination successful trials: is clump randomisation the answer? BMJ. 2001;322:355–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. International Conference connected Harmonization of method requirements for registration of pharmaceuticals for quality use. Guideline for Good Clinical Practice - E6(R1). https://database.ich.org/sites/default/files/E6_R2_Addendum.pdf.

  38. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an hold of the CONSORT statement. BMJ. 2008;337:a2390.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Hewitt CE, Torgerson DJ, Miles JNV. Is determination different mode to instrumentality relationship of noncompliance successful randomized controlled trials? CMAJ Can Med Assoc J J Assoc Medicale Can. 2006;175:347.

    Article  Google Scholar 

  40. Hernán MA, Robins JM. Per-protocol analyses of pragmatic trials. N Engl J Med. 2017;377:1391–8.

    Article  PubMed  Google Scholar 

  41. Meinecke A-K, Welsing P, Kafatos G, Burke D, Trelle S, Kubin M, et al. Series: pragmatic trials and existent satellite evidence: insubstantial 8. Data postulation and management. J Clin Epidemiol. 2017;91:13–22.

    Article  PubMed  Google Scholar 

  42. Sterne JAC, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, et al. Multiple imputation for missing information successful epidemiological and objective research: imaginable and pitfalls. BMJ. 2009;338:b2393.

    Article  PubMed  PubMed Central  Google Scholar 

  43. MacPherson H, Richmond S, Bland M, Brealey S, Gabe R, Hopton A, et al. Acupuncture and counselling for slump successful superior care: a randomised controlled trial. PLoS Med. 2013;10:e1001518.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process valuation of analyzable interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Fröbert O, Lagerqvist B, Olivecrona GK, Omerovic E, Gudnason T, Maeng M, et al. Thrombus aspiration during ST-segment elevation myocardial infarction. N Engl J Med. 2013;369:1587–97.

    Article  PubMed  Google Scholar 

  46. Kahan BC, Feagan B, Jairath V. A examination of approaches for adjudicating outcomes successful objective trials. Trials. 2017;18:266.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Welsing PM, Oude Rengerink K, Collier S, Eckert L, van Smeden M, Ciaglia A, et al. Series: pragmatic trials and existent satellite evidence: insubstantial 6. Outcome measures successful the existent world. J Clin Epidemiol. 2017;90:99–107.

    Article  PubMed  Google Scholar 

  48. O’Muircheartaigh C, Campanelli P. The comparative interaction of interviewer effects and illustration plan effects connected survey precision. J R Stat Soc Ser A Stat Soc. 1998;161:63–77.

    Article  Google Scholar 

  49. Kramer MS, Martin RM, Sterne JAC, Shapiro S, Dahhou M, Platt RW. The treble jeopardy of clustered measurement and clump randomisation. BMJ. 2009;339:b2900.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Ellenberg SS, Culbertson R, Gillen DL, Goodman S, Schrandt S, Zirkle M. Data monitoring committees for pragmatic objective trials. Clin Trials Lond Engl. 2015;12:530–6.

    Article  Google Scholar 

  51. RESTART Collaboration. Effects of antiplatelet therapy aft changeable owed to intracerebral haemorrhage (RESTART): a randomised, open-label trial. Lancet Lond Engl. 2019;393:2613–23.

    Article  Google Scholar 

  52. Savović J, Jones HE, Altman DG, Harris RJ, Jüni P, Pildal J, et al. Influence of reported survey plan characteristics connected involution effect estimates from randomized, controlled trials. Ann Intern Med. 2012;157:429–38.

    Article  PubMed  Google Scholar 

  53. Vollmann J, Winau R. Informed consent successful quality experimentation earlier the Nuremberg code. BMJ. 1996;313:1445–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  54. Macklin R. Enrolling large women successful biomedical research. Lancet Lond Engl. 2010;375:632–3.

    Article  Google Scholar 

  55. Beaver K, Tysver-Robinson D, Campbell M, Twomey M, Williamson S, Hindley A, et al. Comparing infirmary and telephone follow-up aft attraction for bosom cancer: randomised equivalence trial. BMJ. 2009;338:a3147.

    Article  PubMed  PubMed Central  Google Scholar 

  56. De Smit E, Kearns LS, Clarke L, Dick J, Hill CL, Hewitt AW. Heterogeneity of quality probe morals committees and probe governance offices crossed Australia: an observational study. Australas Med J. 2016;9:33–9.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Krahn AD, Longtin Y, Philippon F, Birnie DH, Manlucu J, Angaran P, et al. Prevention of arrhythmia instrumentality corruption trial: the PADIT trial. J Am Coll Cardiol. 2018;72:3098–109.

    Article  PubMed  Google Scholar 

  58. Weijer C, Grimshaw JM, Eccles MP, McRae AD, White A, Brehaut JC, et al. The Ottawa connection connected the ethical plan and behaviour of clump randomized trials. PLoS Med. 2012;9:e1001346.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Schwartz J, Flamant R, Lellouch J. L’Essai thérapeutique chez l’homme. Paris: Editions Médicales Flammarion; 1970.

    Google Scholar 

  60. Taljaard M, Nicholls SG, Howie AH, Nix HP, Carroll K, Moon PM, et al. An investigation of published trials recovered that existent usage of pragmatic proceedings labels is uninformative. J Clin Epidemiol. 2022;151:113-21.

Download references

Acknowledgements

No acknowledgement.

Funding

This enactment (BG, SEM, CW, MZ, BG) was supported by the Canadian Institutes of Health Research done the Project Grant contention (competitive, peer-reviewed), grant fig PJT-153045. MT is supported by the National Institute of Aging (NIA) of the National Institutes of Health nether Award Number U54AG063546, which funds NIA Imbedded Pragmatic Alzheimer’s Disease and AD-Related Dementias Clinical Trials Collaboratory (NIA IMPACT Collaboratory). The contented is solely the work of the authors and does not needfully correspond the authoritative views of the National Institutes of Health. The funder played nary relation successful the study. The funders had nary relation successful the survey design; successful the collection, investigation and mentation of data; successful the penning of the report; and successful the determination to taxable the nonfiction for publication.

Author information

Authors and Affiliations

  1. Université de Tours, Université de Nantes, INSERM, SPHERE U1246, 2 Bd Tonnellé, 37044, Tours cedex 9, France

    Bruno Giraudeau & Agnès Caille

  2. INSERM CIC1415, CHRU de Tours, Tours, France

    Bruno Giraudeau & Agnès Caille

  3. Centre for Primary Care and Public Health, Queen Mary University of London, 58 Turner Street, London, E1 2AB, UK

    Sandra M. Eldridge

  4. Departments of Medicine and Philosophy, Western University, Stevenson Hall 4130, 1151 Richmond Street, London, ON, N6A 5B7, Canada

    Charles Weijer

  5. Centre for Studies successful Family Medicine, Department of Family Medicine Schulich School of Medicine & Dentistry Western University, 1151 Richmond Street, London, ON, N6A 3K7, Canada

    Merrick Zwarenstein

  6. Clinical Epidemiology Program, Ottawa Hospital Research Institute, The Ottawa Hospital, Civic Campus, 1053 Carling Avenue, Ottawa, Ontario, K1Y 4E9, Canada

    Monica Taljaard

  7. School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada

    Monica Taljaard

Contributions

BG and MT wrote the archetypal draft. All authors critically revised the draught for important intelligence contented and gave last support of the mentation to beryllium published. BG is the guarantor for the study.

Corresponding author

Correspondence to Bruno Giraudeau.

Ethics declarations

Ethics support and consent to participate

Not required.

Consent for publication

Not required.

Competing interests

All authors person completed the ICMJ azygous disclosure signifier astatine www.icmje.org/coi_disclosure.pdf (available connected petition from the corresponding author) and state that they person nary applicable interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with respect to jurisdictional claims successful published maps and organization affiliations.

About this article

Verify currency and authenticity via CrossMark

Cite this article

Giraudeau, B., Caille, A., Eldridge, S.M. et al. Heterogeneity successful pragmatic randomised trials: sources and management. BMC Med 20, 372 (2022). https://doi.org/10.1186/s12916-022-02569-w

Download citation

  • Received: 25 March 2022

  • Accepted: 14 September 2022

  • Published: 28 October 2022

  • DOI: https://doi.org/10.1186/s12916-022-02569-w

Keywords

  • Pragmatic randomised trials
  • Heterogeneity
  • Cluster randomised trials
Read Entire Article