Contrary to popular belief manorial rights are not part of a manor house.
A manor house may be the centre of an old manor. However it is the manorial land that denotes its physical location. During the life of a Manor, which for the majority would be over 1000 years, there would have been many manor houses built on a Manor. Traditionally these would have geographically been in the centre (roughly) of the manorial land. However, as manor houses were replaced with newer bigger ones or extended we can no longer guarantee that a manor house is still on manorial land let alone in the centre of a Manor