Mock tests

USMLE Foundation & Exam Strategy

Topic: Mock Tests

Audience – Advanced medical students, residency applicants, and pre‑medical students preparing for the USMLE Step 1, Step 2 CK, and Step 3.
Level – MIT‑style rigorous treatment, integrating psychometrics, educational theory, and exam‑specific strategy.

1. Why Mock Tests Matter

Key Principle: A mock test is not merely practice—it is a data‑driven diagnostic tool that informs the next cycle of study.

2. Psychometric Foundations

2.1 Classical Test Theory (CTT)

• Model: ( X = T + E )
  • (X) = observed score
  • (T) = true score (latent ability)
  • (E) = error (random, systematic)

2.1.1 Key Indices for Mock Items

CTT Assumptions: Homogeneous population, linear item response.

2.2 Item Response Theory (IRT)

• Model: ( P(\theta) = \frac{1}{1+e^{-a(\theta - b)}} ) (1‑PL, 2‑PL, 3‑PL variants)
  • ( \theta ): examinee ability
  • ( a ): discrimination (slope)
  • ( b ): difficulty (location)
  • ( c ): guessing (lower asymptote)

2.2.1 IRT Strengths for Mock Tests

• Ability‑specific difficulty – each item’s probability curve informs how it behaves across the ability spectrum.
• Computer‑Adaptive Testing – selects items based on current ( \theta ).
• Standard Error of Measurement (SEM) – ( \text{SEM}(\theta) = \frac{1}{\sqrt{I(\theta)}} ) where (I(\theta)) is Fisher information.

Edge Case: For the USMLE, the exam is criterion‑referenced; hence, IRT helps calibrate items to a national standard rather than relative ranks.

3. Designing a High‑Quality Mock Test

3.1 Content Coverage

1. Systematic Mapping

   • Use the USMLE Content Outline (Step 1/2/3) to create a matrix.
   • Allocate items proportionally to system importance (e.g., 30 % physiology, 25 % pathology, etc.).

2. Weighting

   • Ebel’s method: experts assign importance scores (1–5) to each domain.
   • Compute weighted item counts: ( \text{items}_{i} = \frac{w_i}{\sum w} \times N ).

3.2 Item Sampling & Quality Control