A housing developer has been accused of breaching planning rules by encroaching on land set aside to protect wildlife for private gardens.