Little was born in May 1889 in Washington, D.C. His father, George Little, was a Pennsylvania native and a school teacher. His mother, Marion Little, was also a Pennsylvania native. He had a younger brother, Howard Little (born July 1890), and a younger sister, Elizabeth Little (born February 1897). At the time of the 1900 United States Census, the family was living in Wolf Township, Lycoming County, Pennsylvania.