He graduated from John Burroughs High School in Burbank, California in June 2004. In the early 2000s, Sweet was a member of the music group Atalanta. In 2005 Sweet formed a band named The Celestial Matinee. He toured with this band during 2007.