16  Randomization and Blinding

Randomization and blinding are often taken for granted, yet the methodological history of medicine contains numerous examples of treatments that seemed effective in uncontrolled studies but proved worthless, or even harmful, when properly tested.

Consider a simple scenario. A physician enthusiastic about a new treatment prescribes it to patients who seem likely to benefit and withholds it from those who seem too sick to respond. When the treated patients do better, is it because the treatment works, or because healthier patients were selected for treatment?

This is not a hypothetical concern. For decades, hormone replacement therapy was thought to prevent heart disease based on observational studies showing that women who took hormones had lower rates of heart attacks. When randomized trials were finally conducted, they showed the opposite: combined hormone therapy increased the risk of coronary heart disease by roughly 29% and stroke by roughly 41%. The observational studies had been confounded: women who chose to take hormones were healthier to begin with.

Randomization eliminates this confounding (Cox 2009). When a coin flip (or its statistical equivalent) determines who receives treatment and who receives control, the groups are comparable at baseline. Any differences that emerge can be attributed to the treatment itself. Cox identifies three broad purposes for randomization: to avoid selection and other biases in a publicly convincing way; to provide a unified approach to estimating error in standard designs; and to provide a basis for exact tests of significance. Of these, bias avoidance is the most compelling in clinical trials: failure to randomize appropriately may fatally compromise an investigation. Randomization also convinces those not directly involved in the trial that the comparison is fair.

16.1 Types of Randomization

Table 16.1 compares the major randomization strategies and their appropriate use cases.

Table 16.1: Randomization method comparison
Method Information needed at randomization Balance guarantee Risk of prediction Best suited for
Simple None None (probabilistic only) Low Large trials (n > 200); unpredictability valued
Block Block size Balance after each complete block Moderate (last slot in block predictable) Most confirmatory trials; standard practice
Stratified block Key prognostic strata for each patient Balance within each stratum after each block Moderate (same as block, within stratum) Trials with 1-3 strong prognostic factors; multi-site
Minimization Current enrollment totals by covariate level Near-perfect balance on all included covariates Low-moderate (deterministic rule creates some predictability) Multi-center trials with many prognostic covariates; moderate sample sizes
Response-adaptive (RAR) Accruing outcome data from enrolled patients None; allocation shifts dynamically toward better arm Low to moderate (single assignments stay probabilistic, but a shifting allocation ratio can leak interim performance) Multi-arm early-phase or platform trials; rarely appropriate for two-arm Phase III
Cluster Group (site, clinic, community) membership Balance at group level, not individual Low Community or system-level interventions; implementation science

The simplest approach is simple randomization: essentially flipping a coin for each participant. This works well for large trials but can produce unequal group sizes in smaller studies. By chance, a trial randomizing 20 patients might end up with 13 in one group and 7 in the other. Bradley Efron addressed this problem in 1971 with the biased coin design, which increases the probability of assigning to the underrepresented group when imbalance develops (Efron 1971).

Block Randomization

Block randomization addresses the imbalance problem by randomizing within blocks of fixed size, as illustrated in Figure 16.1.

flowchart LR
    subgraph Block1["Block 1"]
        P1["Patient 1"] --> A1["Treatment A"]
        P2["Patient 2"] --> B1["Treatment B"]
        P3["Patient 3"] --> A2["Treatment A"]
        P4["Patient 4"] --> B2["Treatment B"]
    end
    
    subgraph Block2["Block 2"]
        P5["Patient 5"] --> B3["Treatment B"]
        P6["Patient 6"] --> A3["Treatment A"]
        P7["Patient 7"] --> B4["Treatment B"]
        P8["Patient 8"] --> A4["Treatment A"]
    end
    
    Block1 --> R1["After Block 1:<br/>A=2, B=2"]
    Block2 --> R2["After Block 2:<br/>A=4, B=4"]
Figure 16.1: Block randomization ensures equal group sizes after each complete block. This example shows a block size of 4.

With blocks of 4, for example, each block might have the pattern ABAB, ABBA, BABA, or another of the six possible arrangements with two A’s and two B’s. After every complete block, the groups are guaranteed to be equal in size.

Stratified randomization goes further by randomizing separately within subgroups defined by important prognostic factors. If disease severity is a major predictor of outcome, patients might be stratified as mild, moderate, or severe, with randomization occurring independently within each stratum. This ensures that treatment groups are balanced on severity, even if overall enrollment is skewed toward one level.

Minimization (or dynamic allocation) takes a different approach (Taves 1974; Pocock and Simon 1975). Rather than randomizing each patient independently, minimization algorithms assign each new patient based on the current imbalance among enrolled patients. If the treatment group currently has more older patients, the next older patient may be somewhat more likely to be assigned to control. This approach can achieve excellent balance on multiple factors simultaneously. Taves’ original simulations showed a four- to fivefold reduction in the probability of severe imbalance compared to standard randomization (Scott et al. 2002). A 2023 tutorial demonstrated that minimization is particularly beneficial when numerous major prognostic factors are known, when many centers of varying sizes recruit patients, or when the trial’s sample size is moderate (Coart et al. 2023).

16.2 Maintaining Randomization Integrity

The value of randomization depends on its integrity. If investigators can predict or influence which treatment a patient will receive, the protection against bias is lost.

Allocation concealment is the mechanism that prevents this. In older trials, numbered envelopes were used, sometimes inadequately, leading to investigators holding envelopes up to light to see the assignment inside. Modern trials use Interactive Response Technology (IRT) systems: computer or telephone systems that reveal the assignment only after the investigator has committed to enrolling a specific patient.

Once randomization occurs, the assignment should be followed. Treatment crossover (where patients switch from their assigned group to another) can blur the distinction between groups and complicate analysis. When crossover is unavoidable (as when patients on placebo deteriorate and ethical obligations require access to active treatment), appropriate analytical methods must be used.

16.3 The Power of Blinding

If randomization protects against bias in allocation, blinding protects against bias in everything that follows.

Consider a trial where investigators know which patients are receiving the experimental drug. They might, consciously or unconsciously, give those patients extra attention, monitor them more closely, interpret symptoms more charitably, or encourage them to continue despite side effects. Patients who know they are receiving active treatment might report more improvement due to expectations.

When outcomes are subjective (pain, mood, quality of life), these biases can be substantial. Even supposedly objective outcomes can be affected: a radiologist who knows a patient is on active treatment might interpret a borderline scan as showing improvement.

Blinding addresses these concerns by ensuring that treatment assignment is unknown to those who might be influenced by it.

16.4 Levels of Blinding

Trials utilize varying levels of blinding depending on the research question and practical constraints. Open-label trials make no attempt at concealment and are often used when comparing radically different interventions, such as surgery versus medication, though they are susceptible to observer bias. Single-blind trials reduce participant expectations by concealing the assignment from patients, while double-blind trials (the industry standard) conceal assignments from both patients and investigators to protect against subjective interpretation of results. In the most rigorous triple-blind designs, the assignment is also withheld from those performing the statistical analysis until the study is formally concluded.

16.5 Technical Aspects of Blinding

Achieving and maintaining the blind requires careful attention to multiple details.

Treatment and placebo must be indistinguishable. This means matching appearance (color, size, shape), taste, smell, and texture. If the active drug comes as a capsule and the comparator is a tablet, both may need to be over-encapsulated to create matching appearances.

Unblinding procedures must be in place for emergencies. If a participant has a medical crisis and the treating physician needs to know the treatment assignment, there must be a mechanism to break the blind for that individual while maintaining it for everyone else.

Side effects can compromise blinding. If the experimental drug causes a distinctive adverse effect (dry mouth, dizziness, skin discoloration), participants and investigators may guess the assignment. Trials sometimes include perception of assignment assessments to evaluate whether blinding was maintained.

When true blinding is not possible, blinded assessment provides an alternative. An assessor who has no contact with patients other than performing specific evaluations may remain blind even when other study staff cannot. Imaging studies can be read by radiologists who have no knowledge of treatment assignment.

16.6 The Challenge of Device and Behavioral Trials

Blinding is particularly challenging in trials of devices, surgical procedures, and behavioral interventions. How do you blind a patient to whether they received surgery? How do you blind a therapist to whether they are delivering cognitive behavioral therapy or a control intervention?

Sham procedures provide one approach. In studies of surgical interventions, patients in the control group may receive anesthesia and incisions but not the actual procedure. This is ethically controversial (some argue that exposing patients to surgical risk without potential for direct benefit is unacceptable), but it may be the only way to separate the effects of the procedure from placebo effects and expectation.

Active comparator designs offer an alternative. Rather than trying to blind the comparison to nothing, both groups receive an intervention, and the question becomes which intervention is better.

16.7 Impact on Trial Design

Decisions regarding randomization and blinding shape the overall trial architecture. Increasing the number of treatment arms complicates stratification and balance, while the planned duration of blinding must account for cross-over periods and long-term follow-up requirements. Sponsors must also decide how to handle treatment discontinuations, ensuring that even if a patient stops the study medication, their follow-up and data collection continue in a way that preserves the integrity of the randomized comparison.

16.8 Advanced Topics

Two randomization approaches extend beyond the fixed-probability designs covered above: response-adaptive randomization, which updates allocation probabilities as outcome data accumulate, and covariate-adaptive randomization, which conditions allocation on patient characteristics measured at enrollment.

Response-Adaptive Randomization

Response-adaptive randomization (RAR) modifies allocation probabilities during the trial in response to accruing outcome data, assigning more patients to whichever arm is performing better at any given time. The ethical motivation is direct: if one treatment is proving superior, fewer patients should be assigned to the inferior arm during the trial itself.

The randomized play-the-winner rule, proposed by Wei and Durham (Wei and Durham 1978), is among the most transparent RAR designs. Every time a patient on a treatment arm has a successful outcome, a ball of that treatment’s color is added to an urn; a failure adds a ball of the other treatment’s color. Each new patient draws from the urn to determine their assignment, so success rates directly steer allocation toward the better arm. In later Bayesian formulations, the same intuition is implemented via Thompson sampling: at each allocation, compute the posterior probability that each arm is best and assign the next patient with that probability (see Section 12.8 for the statistical mechanics).

The ECMO case. The most influential and contested application of play-the-winner was the 1985 ECMO trial by Bartlett and colleagues (Bartlett et al. 1985), evaluating extracorporeal membrane oxygenation for newborns with severe respiratory failure, a condition with near-certain mortality untreated. The play-the-winner design resulted in only one patient randomized to the control arm (who died), while eleven were randomized to ECMO (all eleven survived). The ethical appeal was obvious: very few infants were exposed to the inferior arm. The evidentiary problem was equally clear: a trial with one control patient cannot estimate the control-arm survival rate with any precision, and the result was vigorously contested. A subsequent UK collaborative ECMO trial using conventional equal randomization confirmed the benefit (UK Collaborative ECMO Trial Group 1996).

The ECMO trial remains the reference case for the central tension in RAR: it can protect patients during the trial, but it can produce underpowered estimates and a result that the medical community will not accept. Full treatment of the statistical debate, including temporal-trend bias, the Proschan objection, and the conditions under which RAR is and is not appropriate, is at Section 12.8.

NoteWhen RAR is useful and when it is not

RAR is most defensible in multi-arm settings (three or more arms) where the goal is to efficiently identify the best arm among several plausible candidates, particularly in early-phase or platform trials. In two-arm Phase III confirmatory trials, the power loss and potential for bias under RAR is rarely worth the patient-protection benefit, and conventional equal randomization is generally preferred (Korn and Freidlin 2011; Proschan and Evans 2020). The burn-in period (equal allocation for the first N patients before adaptation begins) and the protect-control safeguard (never reducing the control arm below a minimum proportion) are practical mitigations when RAR is used.

Covariate-Adaptive Randomization

Covariate-adaptive randomization extends minimization by incorporating patient characteristics into allocation decisions in more sophisticated ways (Atkinson 2002; Lin, Zhu, and Su 2015). When randomization is implemented sequentially (one patient at a time), a key tension emerges: knowing previous allocations may allow prediction of the next assignment, potentially enabling selection bias. Atkinson carefully compared procedures that balance this tension between achieving covariate balance and maintaining unpredictability (Cox 2009). FDA’s 2023 guidance on covariate adjustment recommends that sponsors prospectively specify how baseline covariates will be used in both randomization and analysis (U.S. Food and Drug Administration 2023).

For full treatment of randomization theory and practice, see Rosenberger and Lachin (Rosenberger and Lachin 2016), which covers the mathematical foundations, and Hu and Rosenberger (Hu and Rosenberger 2006) for response-adaptive methods specifically.

NoteDiscussion Questions
  1. Minimization is sometimes described as “not truly random” because the allocation of each patient is at least partly deterministic given the current enrollment counts. Some regulatory agencies have expressed concern about this. What is the substantive statistical concern (selection bias, inference validity, or both), how serious is it in practice, and what design modifications (e.g., a probabilistic minimization rule with a biased coin) address the concern?

  2. A Phase III sponsor using response-adaptive randomization in a two-arm cardiovascular outcomes trial argues the design is justified because the trial will run for four years and it would be unethical to continue assigning patients to a placebo if the drug is clearly superior at year two. A statistician objects that temporal confounding could bias the estimate in a multi-year trial. Construct the statistician’s argument precisely, and propose the minimum safeguards that would make RAR defensible in this specific setting.

  3. A trial investigator states: “We have allocation concealment, so blinding is not necessary for our open-label surgical trial.” Explain why allocation concealment and blinding protect against different sources of bias, using a concrete example from a surgical or device trial context to illustrate each.

  4. A sponsor planning a 120-patient Phase II trial proposes to stratify by six prognostic factors (each binary), generating 64 possible strata. Most strata will have 0-2 patients. What specific statistical and operational problems arise from over-stratification at this sample size, and what would you recommend instead?

  5. A placebo-controlled antipsychotic trial achieves double-blind status for capsule appearance and taste, but 68% of patients correctly guess their treatment assignment at the end-of-study perception survey, predominantly due to sedation and weight gain in the active arm. The primary endpoint is a subjective symptom rating scale. What are the implications for interpreting the primary efficacy result, what additional analyses could help bound the bias, and how should this be reported in the publication?