Residents are preparing for a High Court battle and say they are “not backing down” in their bid to prevent building on a recreation space.