A major crowd has rallied in Sydney against Anthony Albanese and his government's plan to sell off a major historic site.