More than a quarter of million pounds is being invested on upgrades to a leisure centre amid news its cafe is closing.