A traveller family hoping to make a new home in protected Kent countryside fear attitudes towards their background could count against them.