\( \newcommand{\water}{{\rm H_{2}O}} \newcommand{\R}{\mathbb{R}} \newcommand{\N}{\mathbb{N}} \newcommand{\Z}{\mathbb{Z}} \newcommand{\Q}{\mathbb{Q}} \newcommand{\E}{\mathbb{E}} \newcommand{\d}{\mathop{}\!\mathrm{d}} \newcommand{\grad}{\nabla} \newcommand{\T}{^\text{T}} \newcommand{\mathbbone}{\unicode{x1D7D9}} \renewcommand{\:}{\enspace} \DeclareMathOperator*{\argmax}{arg\,max} \DeclareMathOperator*{\argmin}{arg\,min} \DeclareMathOperator{\Tr}{Tr} \newcommand{\norm}[1]{\lVert #1\rVert} \newcommand{\KL}[2]{ \text{KL}\left(\left.\rule{0pt}{10pt} #1 \; \right\| \; #2 \right) } \newcommand{\slashfrac}[2]{\left.#1\middle/#2\right.} \)

Sigma algebra: A collection of events

Why it is useful

Given a sample space \(\; \mathcal{X} = \{ w_1, w_2, \ldots, w_n \} \;\) of all possible outcomes, a sigma algebra \(\; \mathcal{F} \;\) is an enumeration of possible events (often all of them) that is self consistent in the sense that we can manipulate its events according to the rules of probability, and stay within the sigma algebra. Each event \(\; A \in \mathcal{F} \;\) is just a set of possible outcomes, \(\; A = \{ w_1, w_2, \ldots, w_n \}, \; w_i \in \mathcal{X} \;\). Sigma algebras are defined because they are useful to define higher constructs, such as probability spaces.

\[ \textrm{Sample space} \;\; \mathcal{X} \;\; \rightarrow \;\; \textrm{Event space}\;\; \mathcal{F} \]

Example

For example, consider the sample space of throwing a die, \(\; \mathcal{X} = \{ 1, 2, 3, 4, 5, 6 \} \;\). In this case, the event space would be the set of all subsets of \(\; \mathcal{X} \;\), which includes events such as all throws smaller than 3, \(\; \{ 1, 2 \} \;\), or all even throws, \(\; \{ 2, 4, 6 \} \;\).

Definition

Given a set \(\;\mathcal{X}\;\), a \(\sigma\)-algebra \(\;\mathcal{F}\;\), \(\;\mathcal{E}\;\) or \(\; \Sigma \;\) is a non-empty collection of subsets of \(\;\mathcal{X}\;\) such that:

  1. Includes the whole set: \[ \mathcal{X} \in \mathcal{F} \]
  2. Closed under complement: \[ \textrm{If} \; \; A \in \mathcal{F}, \; \; \textrm{then} \; \; A^c \in \mathcal{F} \; \; \textrm{too.} \]
  3. Closed under countable union: \[ \textrm{If} \;\; A_n \;\; \textrm{is a countable sequence of elements of} \;\; \mathcal{F}, \;\; \textrm{(finite or infinite)} \] \[ \textrm{then the union of} \;\; A_n \;\; \textrm{is in} \;\; \mathcal{F}. \]

NOTE A sigma algebra is just a subset of the powerset that includes itself, is closed under complement, and is closed under addition. Thus, for every set there is only one powerset, but there are many possible sigma algebras.


References

1 https://en.wikipedia.org/wiki/%CE%A3-algebra