Long-awaited plans to build affordable homes have moved a step closer despite fears they will “alter the character” of a Kent village.