Pettit was born in Chicago and moved as a small child to the Milwaukee suburb of Shorewood, Wisconsin, where he graduated from Shorewood High School. He went on to study at Northwestern University, and graduated in 1950 with a degree in television and radio journalism. He is a member of the Sigma Chi Fraternity. He worked at WMAW-AM and WTMJ-AM as a sports broadcaster until 1956.