White Castle, along with Skenfrith and Grosmont, is one of three castles built to protect one of the main routes through the border region between England and South Wales. In the late 1130's King Stephen brought all three castles together under a single Lordship that controlled the 'Three Castles' as one defensive unit. In the 1180's White Castle appears to have been the first of the Three Castles to be rebuilt in stone. White Castle was originally called Llantilio Castle, but gained its new name from the white plaster rendering that covered the walls. In the early 13th century Hubert de Burgh held the lordship of the Three Castles. He built modern stone castles at Grosmont and Skenfrith, but left the existing stone defences at White Castle. Unlike the other two castles White Castle appears to have been mainly a military outpost rather than a home for a noble family.