Born in DeFuniak Springs, Florida, Anderson was raised in Channelview, Texas where his father was a high school football head coach. He played quarterback for his father at Channelview. Later, he played football for Sam Houston State University, where he was a two-time Academic All-American and lettered four years. He graduated from Sam Houston State in 1974.