Leahy was born in O'Neill, Nebraska and graduated from Winner High School in Winner, South Dakota where he was a football standout. He attended the University of Notre Dame, where he played football as a tackle on Knute Rockne's last three teams (1928–1930), and graduated from the university in 1931.