Mizoram TET – Foundation & Exam Strategy
Topic: Mock Tests
Audience: Aspiring TET candidates, coaching staff, test‑designers
Level: MIT‑grade, first‑principles & rigorous reasoning
Goal: Master the theory, design, analysis, and strategy around mock tests to maximise exam performance and test‑development quality.
Table of Contents
| Section | Sub‑topics |
|---|---|
| 1. What is a Mock Test? | Definition, purpose, historical evolution |
| 2. Psychometric Foundations | Classical Test Theory (CTT), Item Response Theory (IRT), reliability & validity |
| 3. Test Construction Principles | Item bank, sampling, blueprint, scaling, difficulty & discrimination |
| 4. Implementation & Logistics | Timing, environment, proctoring, technological platforms |
| 5. Data‑Driven Analysis | Item statistics, test‑level metrics, DIF & IRT diagnostics |
| 6. Strategic Use of Mock Tests | Practice cycles, adaptive practice, feedback loops |
| 7. Edge Cases & Mitigation | Test anxiety, cheating, low‑resource settings, accessibility |
| 8. Advanced Topics | Computer‑adaptive testing (CAT), Bayesian updating, item‑pool maintenance |
| 9. Challenging Problem | Design a mock test with specified psychometric constraints |
| 10. References & Further Reading |
1. What is a Mock Test?
| Feature | Description |
|---|---|
| Definition | A deliberately constructed practice test that mimics the real TET exam in format, timing, and difficulty. |
| Purpose | 1. Preparation: Gives candidates a realistic feel for the exam. 2. Assessment: Provides diagnostic data on candidate readiness. 3. Test‑development: Allows designers to refine items before the final exam. |
| Evolution | From simple “paper‑and‑pencil” practice sheets in the 70s to sophisticated computer‑adaptive simulations in the 2000s. |
Key insight: A mock test is both a practice tool and a research instrument. Treat it as a miniature version of the real exam.
2. Psychometric Foundations
2.1 Classical Test Theory (CTT)
- Formulation
( X = T + E )
Where ( X ) = observed score, ( T ) = true score, ( E ) = error. - Key metrics
- Reliability ( r = \frac{\sigma_T^2}{\sigma_X^2} ) (Cronbach’s alpha for multiple items).
- Item difficulty ( p = \frac{\text{number of correct responses}}{\text{total candidates}} ).
- Item discrimination ( r_{iT} = \frac{\text{cov}(i, T)}{\sigma_i \sigma_T} ).
- Assumptions
- Unidimensionality
- Linear relationship between true and observed scores
Limitation for mock tests: CTT treats items as independent from examinee ability; not ideal for adaptive testing.
2.2 Item Response Theory (IRT)
- Model: 3‑parameter logistic (3PL)
( P(\theta) = c + \frac{1-c}{1+e^{-a(\theta-b)}} )- ( \theta ) = examinee ability
- ( a ) = discrimination parameter
- ( b ) = difficulty parameter
- ( c ) = guessing parameter
- Advantages
- Ability‑specific item information
- Item parameters invariant across samples
- Foundation for Computer‑Adaptive Testing
- Key metrics
- Test information ( I(\theta) = \sum_i I_i(\theta) ) where ( I_i(\theta) = \frac{a_i^2(1-P_i(\theta))(P_i(\theta)-c_i)^2}{(P_i(\theta)-c_i)^2} ).
- Standard error ( SE(\theta) = 1/\sqrt{I(\theta)} ).
- Application to mock tests
- Calibration: Estimate ( a,b,c ) using pilot data.
- Diagnostic reports: Provide candidate‑specific item‑level performance.
2.3 Reliability & Validity of Mock Tests
- Reliability: Must be high enough to differentiate high‑performers from low‑performers. Target ( \alpha > 0.85 ) for high‑stakes mock tests.
- Validity:
- Content validity: Blueprint adherence.
- Construct validity: Correlation with external measures (e.g., prior classroom performance).
- Criterion validity: Correlation with the actual TET score (if available).
Takeaway: Mock tests should be psychometrically comparable to the real TET to be useful diagnostics.
3. Test Construction Principles
3.1 Item Bank Development
| Step | Action | Rationale |
|---|---|---|
| 1 | Domain analysis | Identify knowledge, skills, and attitudes (KSA) per subject. |
| 2 | Blueprint | Allocate item percentages per KSA. |
| 3 | Item writing | Use PQRST method (Predict, Question, Read, Summarize, Test). |
| 4 | Peer review | Check for ambiguity, bias, and cultural relevance. |
| 5 | Pilot testing | Collect data for psychometric analysis. |
| 6 | Calibration | Estimate IRT parameters; discard items with low discrimination or high missingness. |
3.2 Sampling & Scaling
- Random Sampling: Ensure each mock test has a representative mix of items across the blueprint.
- Scaling: Convert raw scores to scaled scores to match TET scoring (e.g., 0–100).
[