Recorded since the 13th century, the castle has belonged to several families: Courtenay, Aubusson-La Feuillade and d'Aguesseau. Ownership passed from Henriette d'Aguesseau to her daughter Adrienne de La Fayette. She passed it on to her husband, General de Gilbert du Motier, marquis de La Fayette, who lived there from 1802 until his death in 1834. It has been listed since 1942 as a monument historique by the French Ministry of Culture.