###### Definition 4.5.1

A vector whose entries are nonnegative and add to 1 is called a *probability vector*. A square matrix whose columns are probability vectors is called a *stochastic* matrix.

A vector whose entries are nonnegative and add to 1 is called a *probability vector*. A square matrix whose columns are probability vectors is called a *stochastic* matrix.