Harrell grew up in Fort Worth, Texas. When he was a teenager, his father became too ill to work and left his wife and son and moved in with his own mother in Arlington. In spite of his desperate situation, Harrell stayed focused on his promising football career, and when his coach at Polytechnic High School, Wes Bradshaw, heard about the boy's predicament, he invited Harrell to stay with him.