Sample Statistics

A population parameter is the value of a statistic based on population data. This is almost always not measurable. A sample statistic is the value of a statistic based on sample data. We use sample statistics to estimate population parameters.

Experiment and Events

An experiment is a process that results in a random outcome that cannot be known in advance with certainty. We are interested in a particular subset of outcomes: an event.

For example, consider rolling a 6-sided die. The act of rolling it is the experiment, and the event can be rolling an odd number or rolling a 6.

Event Operations

Consider two events $A,B$.

The union of those two events are the outcomes that belongs to A, B, or both.

The intersection of those two events are the outcomes that belongs to both and only both.

The complement of event A is all outcomes that does not belong to A.

Terminology

The two events are mutually disjoint if their intersection is the null set.

Probability

The probability of an event is a number representing how likely an outcome belongs to the event. It is pretty intuitive so I'm going to skip on explaining it.

Classic Probability

Logic based (or classic) probability assumes all possible events are equally likely based on a logical/natural assumption. We assume we know all possible otucomes in advance, and the probability is calculated by

$P(A)={\frac {{\text{Number of events with }}A}{\text{Number of all possible events}}}$

This, naturally, requires a lot of assumptions. Who is to say that all outcomes are equally likely? The counterpart is then experimental probability.

Experimental Probability

Experimental (or relative frequency) probability is based on experiments and/or samples.

${\hat {P}}(A)={\frac {{\text{Number of events with }}A{\text{ occurred in the sample}}}{{\text{Sample size }}n}}$

As the number of samples increased, so do the accuracy of this sample probability.