Councillors agreed the site is an 'eyesore' and needs 'sorting out' but some did not think this was the right approach