Originally built as a deer park in the 13th century, the house would have initially been built around an enclosed courtyard.
The house has been demolished and rebuilt a total of 4 times; however, the courtyard area has remained unchanged.

The Herrick family owned this property as a family residence for 350 years, but in 1939, the Ministry of Defence took over the building and worked as a sub-listening station to Bletchley Park.