Newcastleton is situated on the Liddel Water in Liddesdale, east of Langholm.
The remains of Hermitage Castle lie on moorland north of Newcastleton. Most of the castle dates from the 13th century, although the keep and corner towers visible today date mainly from the 14th century.