Anthony Albanese has been grilled by one of his former most senior advisers, over claims the government is not transparent.