A plan to build six homes on a field in a village has been thrown out amid concerns over its impact on a potential badger sett.