Until this weekend, most Cabinet ministers believed Andy Burnham was bluffing when he stated he was not ruling out a return to the EU.