The Milestone Hotel and Apartments take their name from the old cast iron milestone that stands in its original position beside the hotel. Previous residents of the properties that have stood on this site include a mistress of James II, a man who believed himself to be Shakespeare's grandson, and an aristocratic governess to the daughters of George II.