It was once the scene of lavish society parties that often included royalty among the guests when it was owned by a rich industrialist.