The house was built from 1913 to 1916 by former governor O'Brian as a retreat following his retirement from politics. He and his wife lived in the house for many years. O'Brian died in 1941 and his wife Grace remained there until her death in 1960, when the house was left to the state. For years the house was closed off and fell into disrepair. Due to public petition in the 1980s, restoration work was done in 1984 and 1985, with plans to convert it into a museum.