Conditional Probability

Conditional Probability

Understanding how probabilities change when new information is available, including the Multiplication Rule, Independence, the Theorem of Total Probability, and Bayes' Theorem.

In engineering, we rarely evaluate risks in isolation. Our assessment of a structure's failure probability changes if we already know that a defect was present during construction. This updating of probabilities based on prior knowledge is called conditional probability.

The Concept of Conditional Probability

Adjusting the probability of an event given that another event has already occurred.

Conditional Probability, $P(B|A)$

The probability that event

B

occurs, given that event

A

has already occurred. It effectively reduces the sample space from

S

to just the outcomes in

A

P(B|A) = \frac{P(A \cap B)}{P(A)} \quad \text{for } P(A) > 0

The Multiplication Rule (General)

Used to find the probability that two events

A

and

B

occur simultaneously (

A \cap B

). It is a direct rearrangement of the conditional probability formula.

P(A \cap B) = P(A) \cdot P(B|A)

Or, symmetrically:

P(A \cap B) = P(B) \cdot P(A|B)

Independent Events

When the occurrence of one event has absolutely no effect on the probability of another.

In structural engineering, deciding whether the failure of one column affects the failure probability of an adjacent column is a critical assessment of independence.

Independence

Two events

A

and

B

are independent if and only if the knowledge that

A

occurred does not change the probability of

B

occurring. Mathematically, this is expressed as:

P(B|A) = P(B) \quad \text{and} \quad P(A|B) = P(A)

Substituting this into the general multiplication rule yields the Special Multiplication Rule for Independent Events:

P(A \cap B) = P(A) \cdot P(B)

Independence of Multiple Events

For three events

A, B, C

to be mutually independent, they must be pairwise independent (

P(A \cap B) = P(A)P(B)

, etc.), AND their joint probability must equal the product of their individual probabilities:

P(A \cap B \cap C) = P(A)P(B)P(C)

The Theorem of Total Probability and Bayes' Theorem

Advanced tools for calculating probabilities when an event can occur through multiple, distinct pathways.

The Theorem of Total Probability

If a sample space

S

is partitioned into

n

mutually exclusive and collectively exhaustive events (

B_1, B_2, \dots, B_n

), then the probability of any event

A

occurring is the sum of the probabilities of

A

occurring in conjunction with each partition.

P(A) = \sum_{i=1}^{n} P(B_i \cap A) = \sum_{i=1}^{n} P(B_i) \cdot P(A|B_i)

Engineering Application: If a concrete batch

A

can fail due to poor mixing (

B_1

), improper curing (

B_2

), or bad aggregates (

B_3

), the total probability of failure

P(A)

is the sum of the probabilities of failure given each specific cause, weighted by how frequently each cause occurs.

Bayes' Theorem

A powerful mathematical formula used to update the probabilities of hypotheses when given new evidence. It essentially reverses the conditional probability. If we know the probability of an effect given a cause (

P(A|B_i)

), Bayes' Theorem lets us find the probability of a specific cause given that the effect occurred (

P(B_i|A)

P(B_i|A) = \frac{P(B_i) \cdot P(A|B_i)}{\sum_{j=1}^{n} P(B_j) \cdot P(A|B_j)}

Prior Probability ( $P(B_i)$ ): Our initial estimate of the probability of cause $B_i$ before observing the evidence $A$ .
Likelihood ( $P(A|B_i)$ ): The probability of observing evidence $A$ if cause $B_i$ is true.
Posterior Probability ( $P(B_i|A)$ ): The updated probability of cause $B_i$ after observing the evidence $A$ .

Bayes' Theorem Explorer

Base Rate $P(D)$ (Defective)2.0%

Initial probability of a defect.

True Positive Rate $P(T|D)$95.0%

Probability test is positive when defect is present.

False Positive Rate $P(T|G)$10.0%

Probability test is positive when NO defect is present.

Posterior Probability

16.2%

$P(D|T)$ - Probability it is actually defective given a positive test.

Total Positives $P(T)$11.7%

True Positives $P(T|D) \times P(D)$1.90%

False Positives $P(T|G) \times P(G)$9.80%

Key Takeaways

Conditional Probability ( $P(B|A)$ ): The probability of $B$ given that $A$ has occurred; shrinks the sample space to $A$ .
Multiplication Rule: Used for "A AND B" scenarios ( $A \cap B$ ).
Independence: If $A$ and $B$ are independent, $P(A \cap B) = P(A) \cdot P(B)$ .
Theorem of Total Probability: Useful for finding the total probability of an event that can occur across multiple mutually exclusive pathways.
Bayes' Theorem: Allows engineers to "work backward" from an observed effect (e.g., structural failure) to determine the most likely cause, updating prior beliefs with new evidence.

PreviousProbability Fundamentals - Examples & Applications

Quiz Me

NextConditional Probability - Examples & Applications

The Concept of Conditional Probability

Conditional Probability, P(B∣A)P(B|A)P(B∣A)