A former bodybuilder who believes he contracted tuberculosis while working at a Kent asylum centre has been left struggling to walk up stairs.