The presence of the family of Kergroadez is attested as of XIVème century.
At that time a manor built in the east of the current castle was.