A derelict social club and a half-finished tower block have sparked concerns about building safety in a town centre.