Andrew Thirkill, one of the UK's richest men, said the country will not be able to stand another five years of a Labour government.