We are given a dataset $D = {(x_i, y_i)}_{i=1}^n$ sampled from an unknown distribution $P$.

We want to find a hypothesis function $h$ out of the complete hypothesis space $H$ that minimizes the risk function $R(h)$.