Little, who graduated from Worcester Academy, played college football at the University of Pennsylvania. Little gained national notoriety as a varsity tackle during 1916 and 1919. Between those years, he served with distinction during World War I with the American Expeditionary Forces in France. Commissioned as a lieutenant, he was promoted to a captain in the 6th Infantry Division. He saw action in the Meuse-Argonne Offensive.