Residents opposing plans to build 291 homes on a golf course and extend a hotel fear it could damage a key part of Hythe’s history.