The concept of modeling sequences of random events using states and transitions between states became to known as Markov Chains. Introduction to Markov chains. Created by Brit Cruise.