A Markov model is a mathematical model that defines transition probablities between a set of states {S1...SN}. These probabilities may be defined in a 2-d transition matrix, where rows represent the current state and columns represent the possible transition states.
Markov Models are widely used in natural language processing applications, biogenetics, and a handful of other fields. There has been some academic work applying markov modeling to musical melody and harmony, usually focusing on sophisticated classical composers who constructed highly formal compositions, such as Bach. Somewhat strangely, markov modeling of pop music songs remains underdeveloped, despite being far less formally complex.