A town centre bakery has been shut down after a widespread mice infestation was discovered in a building with a troubled history of rodents.