Fundamentals
Union of two events
p(A∪B)=p(A)+p(B)−p(A∩B)
Joint probabilities
p(A,B)=p(A∩B)=p(A∣B)p(B)
This is known as the product rule.
Given a joint distribution on two events p(A,B), we define the marginal distribution as follows:
p(A)=b∑p(A,B)=b∑p(A∣B=b)p(B=b)
This is the sum rule or the rule of total probability.
Conditional probability
Conditional probability of event A, given that B is true:
p(A∣B)=p(B)p(A,B) if p(B)>0