When the male line of owners ended the castle passed into the hands of Hawise de Londres. She married into the powerful de Braose family but her husband died in 1233 and the castle at this time was back in Welsh possession. In around 1244 Hawise married Peter de Chaworth who won back the castle. Peter de Chaworth successfully held the castle until 1258 when he was killed and the castle was inherited by the elder of his two young sons, Payn. Hawise took control of the castle until Payn was old enough to do so himself. Payn died without an heir and after his brother's death the castle was inhirited by his brother's daughter Matilda.