📚 Study Notes – Bayes’ Theorem & Random Variables
(For SRMJEEE – Mathematics)
1. Bayes’ Theorem
1.1 What is it?
Bayes’ Theorem tells you how to update a probability once you learn new information.
Think of it like a detective who changes his guess when he finds a new clue.
1.2 The formula (in plain words)
Probability of A given B
= (Probability of B given A) × (Probability of A) / (Probability of B)
A– an event you care aboutB– new evidence you have seen
1.3 Everyday analogy
- A (Event) – “It is raining.”
- B (Evidence) – “The street is wet.”
- We want the chance that it’s raining when we see a wet street.
1.4 Tiny example
| Rain (A) | No Rain (¬A) | |
|---|---|---|
| Street Wet (B) | 0.8 (80%) | 0.2 (20%) |
| Street Dry | 0.2 (20%) | 0.8 (80%) |
- Prior: Probability of rain = 0.3 (30%)
- Likelihood: P(B|A) = 0.8
- Evidence: P(B) = 0.3×0.8 + 0.7×0.2 = 0.38
Bayes’ Theorem
P(A|B) = (0.8 × 0.3) / 0.38 ≈ 0.63
So, if the street is wet, the chance of rain jumps from 30% to 63%.
2. Random Variables
2.1 What is a random variable?
A number that comes out of a random experiment.
Example: “How many heads appear when you toss a coin 3 times?” → 0, 1, 2, or 3.
2.2 Two types
| Type | What it is | Example |
|---|---|---|
| Discrete | Takes a countable set of values | Number of heads in 3 coin tosses |
| Continuous | Can be any number in an interval | Height of a person |
2.3 Probability Mass Function (PMF) – Discrete
Shows how likely each value is.
P(X = k) = probability that X equals k
2.4 Probability Density Function (PDF) – Continuous
Shows “density” of probability.
The area under the curve between two numbers gives the probability of being in that range.
2.5 Expected Value (Mean)
The long‑run average you would get if you repeated the experiment many times.
For discrete:
E[X] = Σ (k × P(X = k))
For continuous: integrate k × f(k) over the range.
2.6 Variance – How spread out the values are
Var(X) = E[(X – E[X])²]
Smaller variance → values stay close to the mean.
3. Quick Reference: Key Formulas
| Concept | Formula | What it Means |
|---|---|---|
| Bayes’ Theorem | `P(A | B) = (P(B |
| Discrete PMF | P(X = k) |
Probability of exact value k |
| Expected Value | E[X] = Σ k·P(X=k) |
Average value |
| Variance | Var(X) = Σ (k – E[X])² · P(X=k) |
Spread of values |
4. Mini Practice Problems
| # | Question | Hint |
|---|---|---|
| 1 | A bag has 3 red and 7 blue marbles. If you pick 2 marbles without replacement, what is the probability that both are red? | Use combinations. |
| 2 | In a test, 90% of students answer correctly. A student is chosen at random and answers incorrectly. What is the probability that this student was from the “difficult” group (20% of all students)? | Apply Bayes’ Theorem. |
| 3 | Toss a fair coin 4 times. Find the expected number of heads. | Discrete PMF + expectation. |
| 4 | A random variable X has PMF: P(X=1)=0.2, P(X=2)=0.5, P(X=3)=0.3. Find Var(X). | Compute mean first, then variance. |
Solutions are in the next section.
5. Solutions (Brief)
| # | Answer |
|---|---|
| 1 | C(3,2)/C(10,2) = 3/45 = 1/15 ≈ 0.0667 |
| 2 | `P(A |
| 3 | E[X] = 4 × 0.5 = 2 |
| 4 | E[X] = 1(0.2)+2(0.5)+3(0.3)=2.1Var = (1-2.1)²(0.2)+(2-2.1)²(0.5)+(3-2.1)²(0.3)=0.61 |
6. Common Mistakes to Avoid
|