The former bar and music venue lies within the cobbled streets of the town's Nelson Square conservation area