Prince William and Kate Middleton may have found their “forever home,” but it’s reportedly coming at a cost to their neighbors.

A palace spokesperson spoke to People on Aug. 16 and confirmed that “the Wales family will move house later this year,” but it’s not without controversy. According to The Mail on Sunday, two sets of neighbors “have been asked to leave their homes” near Forest Lodge. The request was made earlier this summer because the properties are owned and rented out by the Crown Estate.

The U.K media outlet shared that the families were “surprised” by the order, but a palace insider is noting that it’s best for Kate and William’s privacy.

“They were told to move out. I guess they were given somewhere else, but they were told they had to move,” the source said. “They were no

See Full Page